-- Logs begin at Thu 2022-05-05 14:50:50 UTC, end at Thu 2022-05-05 16:03:14 UTC. -- May 05 15:27:29.112310 dv-cinder-839793-9-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 05 15:27:29.119542 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 5 15:27:29 2022] *** May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: nodename: dv-cinder-839793-9-iscsi May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: machine: x86_64 May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: clock source: unix May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: pcre jit disabled May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: detected number of CPU cores: 4 May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: current working directory: / May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: detected binary path: /usr/bin/uwsgi-core May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: your processes number limit is 47680 May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: your memory page size is 4096 bytes May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: detected max file descriptor number: 2048 May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: lock engine: pthread robust mutexes May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: thunder lock: enabled May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 05 15:27:29.126188 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 05 15:27:29.170179 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: Python main interpreter initialized at 0x5603a71ea9c0 May 05 15:27:29.170179 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: python threads support enabled May 05 15:27:29.170179 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: your server socket listen backlog is limited to 100 connections May 05 15:27:29.170179 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: your mercy for graceful operations on workers is 90 seconds May 05 15:27:29.170569 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: mapped 403077 bytes (393 KB) for 2 cores May 05 15:27:29.170646 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: *** Operational MODE: preforking *** May 05 15:27:29.170888 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: *** uWSGI is running in multiple interpreter mode *** May 05 15:27:29.170888 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: spawned uWSGI master process (pid: 80033) May 05 15:27:29.171107 dv-cinder-839793-9-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 05 15:27:29.174211 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: spawned uWSGI worker 1 (pid: 80045, cores: 1) May 05 15:27:29.174211 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: spawned uWSGI worker 2 (pid: 80046, cores: 1) May 05 15:27:29.174211 dv-cinder-839793-9-iscsi devstack@keystone.service[80033]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 05 15:27:34.916420 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 15:27:34.916420 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: from cryptography.utils import int_from_bytes May 05 15:27:34.917209 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 15:27:34.917209 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: from cryptography.utils import int_from_bytes May 05 15:27:34.917319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 15:27:34.917319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: from cryptography.utils import int_from_bytes May 05 15:27:34.917319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 15:27:34.917319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: from cryptography.utils import int_from_bytes May 05 15:27:34.967092 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 05 15:27:34.967247 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 05 15:27:34.967327 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 05 15:27:34.967402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 05 15:27:34.967462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] command line args: [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 05 15:27:34.967530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] command line args: [] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 05 15:27:34.967762 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 05 15:27:34.967852 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 05 15:27:34.967917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ================================================================================ {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 05 15:27:34.967974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ================================================================================ {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 05 15:27:34.968137 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] admin_token = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.968223 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] admin_token = **** {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.968357 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] config_dir = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.968432 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] config_dir = [] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.968496 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.968558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.968701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] config_source = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.968787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] config_source = [] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.968852 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] debug = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.968916 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] debug = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.969056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.971367 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.971367 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.971516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.971580 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.971637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.971704 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.971767 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.971828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.971884 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.971944 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] list_limit = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972004 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] list_limit = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] log_config_append = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] log_config_append = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972184 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972300 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] log_dir = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] log_dir = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972418 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] log_file = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] log_file = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972656 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972841 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.972964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.973021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.973082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.973148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.973214 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.973214 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.973314 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.973369 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.973442 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.973509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.973566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.973620 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.973680 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.973735 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.974042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.974107 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.974193 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.974263 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.974324 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.974389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.974458 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.974520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.974582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.975294 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.975515 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.975715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] publish_errors = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.975878 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] publish_errors = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.976073 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.976298 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.976459 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.976644 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.976829 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.977017 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.977209 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.977483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.977678 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.977874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.978079 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] standard_threads = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.978314 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] standard_threads = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.978516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.978677 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.978863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.979069 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.979264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.979457 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.979653 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] use_journal = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.979847 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] use_journal = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.980034 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] use_json = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.980193 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] use_json = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.980320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] use_stderr = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.980476 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] use_stderr = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.980619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] use_syslog = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.980777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] use_syslog = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.980907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.981031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 15:27:34.981156 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.981280 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.981413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.982247 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.982389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.982515 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.982641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.982765 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.982902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.983035 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.983179 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.983313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.983439 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.983639 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.983767 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.983892 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.984023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.984149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.984279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.984418 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.984550 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.984682 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.984807 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.984948 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.985074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.985207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.985334 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.985459 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.985594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.985719 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.985953 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.986126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.986290 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.986419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.986543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.986543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.986799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.986933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.987059 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.987183 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.987307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.987431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.987562 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.987699 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.987830 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.987955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.988088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.988223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.988356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.988492 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.988629 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.988755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.988878 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.989007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.989132 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.989264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.989389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.989512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.989636 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.989766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.989890 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.990088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.990269 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.990407 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.990533 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.990657 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.990781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.990916 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.991042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.991165 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.991288 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.991412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.991535 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.991669 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.991794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.991923 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.992048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.992187 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.992321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.992445 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.992569 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.992693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.992817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.992940 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.993072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.993198 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.993321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.993450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.993581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.993706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.994955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.995128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.995320 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.995512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.995700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.995887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.996109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.996271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.996465 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.996652 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.996839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.997032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.998129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.998347 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.998695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.998919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.999093 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.999283 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.999478 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.999674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:34.999870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.000060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.000248 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.000408 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.000575 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.000705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.000866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.001003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.001170 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.001300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.001435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.001571 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.001571 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.001845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.001845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.002100 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.002268 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.002408 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.002408 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.002656 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.002791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.002916 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.003042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.003195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.003195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.003451 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.003576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.003701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.003701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.003941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.003941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.004187 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.004187 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.004424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.004559 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.004684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.004816 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.004942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.005066 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.005191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.005316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.005449 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.005593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.005721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.005877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.006036 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.006204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.006340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.006555 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.006686 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.006812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.006938 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.007063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.007188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.007325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.007453 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.007579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.007704 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.007829 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.007963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.008089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.008225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.008351 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.008477 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.008609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.008747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.008874 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.008999 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.009123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.009255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.009380 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.009514 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.009650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.009789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.009915 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.010049 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.010201 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.010334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.010460 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.010597 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.010724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.010849 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.010974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.011105 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.011239 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.011374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.011500 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.011632 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.011758 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.011893 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.011893 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.012138 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.012271 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.012397 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.012397 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.012634 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.012759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] auth.external = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.012922 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.013052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.013177 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.013177 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] auth.external = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.013412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.013550 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.013708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.013708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] auth.password = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.013971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.014099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] auth.token = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.014268 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.014408 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.014536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] auth.password = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.014662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.014797 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] auth.token = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.014924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.015056 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.015182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.015307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.015452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.015590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.015717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.015844 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.015969 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.016096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.016230 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] credential.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.016357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.016483 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.016608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.016734 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.016861 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] credential.caching = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.016995 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.017138 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.017266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.017392 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.017518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.017649 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.017788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.017916 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.018041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.018257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.018415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.018545 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.018680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.018814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.018942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.019087 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.019087 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.019327 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.019327 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.019581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.019713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.019839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.019965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.020090 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.020224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.020351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.020476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.020601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.020736 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.020862 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.020996 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.021124 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] federation.caching = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.021257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.021383 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.021516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.021642 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.021842 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.021973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.022100 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.022259 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.022389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.022516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.022662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.022790 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.022916 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.023042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.023169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.023294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.023429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.023556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.023682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.023808 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.023933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.024058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.024193 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.024330 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity.caching = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.024456 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.024581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.024713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.024839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.024973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.025100 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.025227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.025353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.025483 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.025614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.025749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.025876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.026002 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.026136 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.026308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.026435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.026572 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.026699 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.026831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.026958 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.027090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.027225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.027352 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.027486 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.027617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.027743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.027869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.028018 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.028146 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.028272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.028399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.028558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.028686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.028824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.028953 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.028953 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.029196 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.029322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.029448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.029583 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.029757 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.029888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.030015 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.030140 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.030312 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.030452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.030580 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.030704 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.030830 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.030990 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.031122 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.031256 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.031383 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.031510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.031645 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.031771 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.031896 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.032029 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.032155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.032280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.032405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.032627 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.032786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.032924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.033052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.033177 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.033303 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.033443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.033569 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.033705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.033831 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.033956 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.034081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.034368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.034507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.034646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.034781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.034909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.035035 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.035160 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.035285 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.035429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.035565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.035693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.035818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.035951 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.036079 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.036213 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.036341 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.036467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.036592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.036717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.036844 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.036977 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.037104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.037240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.037366 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.037491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.037617 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.037751 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.037881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.038007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.038133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.038325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.038453 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.038590 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.038718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.038845 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.038981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.039107 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.039233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.039366 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.039493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.039618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.039744 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.039869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.040003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.040130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.040256 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.040381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.040506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.040632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.040781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.040909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.041036 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.041161 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.041287 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.041412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.041546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.041673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.041799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.041931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.042059 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.042202 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.042346 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.042485 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.042611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.042737 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.042862 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.042987 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.043122 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.043249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.043249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.043487 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.043613 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.043738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.043872 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.044000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.044684 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.044831 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.044958 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.045084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.045220 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.045347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.045473 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.045598 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.045723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.045848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.045987 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.046119 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.046288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.046432 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.046566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.046708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.046850 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.046983 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.047114 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.047247 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.047378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.047509 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.047716 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.047852 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.047984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.048115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.048246 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.048379 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.048519 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.048663 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] resource.caching = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.048796 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.048927 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.049059 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.049190 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.049331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.049465 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.049603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.049737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.049868 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.050000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.050139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] role.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.050296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.050441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] role.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.050574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.050706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.050837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.050980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.051114 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.051246 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.051379 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] role.caching = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.051512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.051643 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] role.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.051783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.051916 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.052048 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.052181 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.052326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.052460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.052602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.052735 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.052867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.052998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.053130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.053262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.053403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.053543 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.053676 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.053808 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.053940 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.054091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.054290 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.054445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.054445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.054700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.054700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.054963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.055098 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.055230 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.055362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.055494 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.055627 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.055768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.055912 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.056056 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.056189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.056321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.056454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.056595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.056730 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.056862 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.056993 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.057125 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.057257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.057398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.057533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.057675 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.057809 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.057940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.058072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.058321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.058463 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.058596 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.058775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.058915 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.059047 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.059188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.059323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.059461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.059594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.059841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.060038 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.060185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.060320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.060452 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.060585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.060718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.060851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.060996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.061131 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.061263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] token.caching = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.061395 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.061526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.061678 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.061813 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.061946 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.062078 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.062243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.062243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.062513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.062648 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.062780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.062912 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.063045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.063177 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.063323 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.063457 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.063601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.063735 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.063906 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.064045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.064186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.064320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.064453 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.064586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.064718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.064850 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.connection = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.064996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.065140 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.065282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.065416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.065560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.065693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.065825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.065957 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.066111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.066312 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.066312 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.066566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.connection = **** {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.066711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.066853 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.067028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.067171 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.067306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.067438 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.067615 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.067801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.067939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.068082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.068217 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.068349 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.068482 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.068622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.068762 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.068905 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.069039 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.069171 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.069305 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.069447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.069581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.069795 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.069932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.070065 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.070217 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 05 15:27:35.070360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.070360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.070360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.070360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.070360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.070360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 15:27:35.070360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 05 15:27:35.082402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.082643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.082822 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.082965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.083104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.083239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.092087 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.092681 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.120808 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.121048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.121203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.121379 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.174939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.175316 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.232563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.232954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.245883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.246114 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.302099 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.302570 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.302901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.303265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.303373 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.303509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.303731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.303811 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.303948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.304162 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.304243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.304373 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.330296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.330528 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.330746 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.330966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.331172 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.331386 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.331602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.331680 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.331978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.332305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.332630 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.332955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.333334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.333685 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.343610 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.345003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.358485 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.358749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.358931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.359141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.359229 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.359400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.359483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.359556 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.359620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.359871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.359954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.360016 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.360216 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.360407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80045) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 05 15:27:35.377585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.377774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.377859 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 15:27:35.377935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 15:27:35.378188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.378343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.378425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 15:27:35.378588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 05 15:27:35.378667 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.378831 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.378924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.379092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.379170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.379331 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.379409 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.379585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.391125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.391227 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.391411 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.391494 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.391655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.391750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.391916 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.391996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.399974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.400138 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.403263 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.403566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.403729 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.403957 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.404044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.404231 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.404315 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.404516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.404669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.404814 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.404954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.405043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.405221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.405301 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.405462 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.405541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.405714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.405794 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.405955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.406034 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.406235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.406503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.432982 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.433481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.434553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.434917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.435284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.435632 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.440270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.440545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.440816 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.440901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.441145 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.441424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.448058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.448334 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.448699 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.448979 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.453444 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.453719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.453994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.454204 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.454370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.454523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.454661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.454797 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.454934 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.455071 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.455218 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.455357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.455494 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.455631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.455795 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.456060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.473748 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.474307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.474996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.475272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.478791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.479774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.482964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.483247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.484277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.484567 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.489667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.493281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.493441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.496911 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.497063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.497503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.497775 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.498621 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.498906 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.499189 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.501302 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.501599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.501876 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.502152 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.502445 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.502719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.519615 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.519999 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.520270 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.520532 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.523088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.523088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.523088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.523088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.529141 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.531434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.531734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.532132 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.533144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.533417 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.535227 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.535687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.535983 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.536261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.536536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.537762 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.538042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.538371 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.538649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.538927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.550160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.550462 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.550744 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.551021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.551300 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.551573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.551858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.552601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.552880 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.553157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.553432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.553710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.553979 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.554283 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.571197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.572842 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.574518 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.576699 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.578519 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.580051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.580218 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.581654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.581816 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.582021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.582328 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.583295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.583570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.583847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.589739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.592056 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.592147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.593709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.595316 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.595605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.595899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.596176 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.596945 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.597227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.597509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.597775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.606043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.606373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.606726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.607690 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.607980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.608252 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.615041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80045) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.615318 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.615597 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.615878 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.616146 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.616230 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 05 15:27:35.616416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.616510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.616682 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.616763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.616941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.617023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.617218 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.617303 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.617481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.617575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.617805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.617888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.618048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.618128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.618361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.618436 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.618611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80045) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.618692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.618852 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.619074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.619428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.619707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 05 15:27:35.659278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603a71ea9c0 pid: 80045 (default app) May 05 15:27:35.659707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603a71ea9c0 pid: 80046 (default app) May 05 15:27:35.662752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6868539-2e84-49df-967d-8dde356cff9e None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:35.663055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6868539-2e84-49df-967d-8dde356cff9e None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:35.663339 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6868539-2e84-49df-967d-8dde356cff9e None None] PATH_INFO: `/v3` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:35.667536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Thu May 5 15:27:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:27:43.741570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836189f-38aa-42e0-a011-93724946f989 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:43.742130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836189f-38aa-42e0-a011-93724946f989 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:43.742130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836189f-38aa-42e0-a011-93724946f989 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:43.746450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:27:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:27:43.752685 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2798097-5f53-4fec-8520-990be9b55bce None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:43.753147 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2798097-5f53-4fec-8520-990be9b55bce None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:43.753376 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2798097-5f53-4fec-8520-990be9b55bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:43.783598 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG oslo_db.sqlalchemy.engines [None req-f2798097-5f53-4fec-8520-990be9b55bce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80045) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 15:27:43.966784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG passlib.handlers.bcrypt [None req-f2798097-5f53-4fec-8520-990be9b55bce None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80045) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 05 15:27:43.967206 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG passlib.handlers.bcrypt [None req-f2798097-5f53-4fec-8520-990be9b55bce None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80045) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 05 15:27:44.022618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-f2798097-5f53-4fec-8520-990be9b55bce None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:44.024198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-f2798097-5f53-4fec-8520-990be9b55bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:44.146757 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:27:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 05 15:27:44.312246 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836189f-38aa-42e0-a011-93724946f989 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:44.345833 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG oslo_db.sqlalchemy.engines [None req-7836189f-38aa-42e0-a011-93724946f989 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 15:27:44.471522 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836189f-38aa-42e0-a011-93724946f989 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:44.475900 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1ef29-ff79-4bb4-abb4-4419a0e011bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:44.476557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1ef29-ff79-4bb4-abb4-4419a0e011bc admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:44.476835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1ef29-ff79-4bb4-abb4-4419a0e011bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:44.477107 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1ef29-ff79-4bb4-abb4-4419a0e011bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:44.485613 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1ef29-ff79-4bb4-abb4-4419a0e011bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:44.538333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: WARNING keystone.common.rbac_enforcer.enforcer [None req-11b1ef29-ff79-4bb4-abb4-4419a0e011bc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 05 15:27:44.538682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1ef29-ff79-4bb4-abb4-4419a0e011bc admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:44.548700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1324 bytes} [Thu May 5 15:27:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:27:44.554668 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2798097-5f53-4fec-8520-990be9b55bce None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:44.568797 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2798097-5f53-4fec-8520-990be9b55bce None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:44.573179 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cc67e-de80-46fa-98f7-19659c1393d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:44.574336 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cc67e-de80-46fa-98f7-19659c1393d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:44.574631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cc67e-de80-46fa-98f7-19659c1393d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:44.574913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cc67e-de80-46fa-98f7-19659c1393d8 admin admin] PATH_INFO: `/v3/projects/e901518e00104463a2aa36d4de393e28` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:44.577089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cc67e-de80-46fa-98f7-19659c1393d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=e901518e00104463a2aa36d4de393e28)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:44.627708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dc9cc67e-de80-46fa-98f7-19659c1393d8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 05 15:27:44.628045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cc67e-de80-46fa-98f7-19659c1393d8 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:44.632989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 3/5] 10.222.0.58 () {56 vars in 1207 bytes} [Thu May 5 15:27:44 2022] GET /identity/v3/projects/e901518e00104463a2aa36d4de393e28 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:27:46.855576 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf6dbe-216f-4b03-a4a1-fc051d614597 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:46.856126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf6dbe-216f-4b03-a4a1-fc051d614597 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:46.856126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf6dbe-216f-4b03-a4a1-fc051d614597 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:46.861405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 3/6] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:27:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:46.866911 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc74ce-4424-4fdd-a98e-fdc5cbeddd51 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:46.867326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc74ce-4424-4fdd-a98e-fdc5cbeddd51 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:46.867457 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc74ce-4424-4fdd-a98e-fdc5cbeddd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:46.887985 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-d3dc74ce-4424-4fdd-a98e-fdc5cbeddd51 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:46.889486 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d3dc74ce-4424-4fdd-a98e-fdc5cbeddd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:46.897215 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:27:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 05 15:27:46.920117 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf6dbe-216f-4b03-a4a1-fc051d614597 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:46.932048 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf6dbe-216f-4b03-a4a1-fc051d614597 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:46.937153 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bad5b-a3eb-4535-8f03-c1dac29b7964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:46.937782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bad5b-a3eb-4535-8f03-c1dac29b7964 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:46.938065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bad5b-a3eb-4535-8f03-c1dac29b7964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:46.938376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bad5b-a3eb-4535-8f03-c1dac29b7964 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:46.945831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bad5b-a3eb-4535-8f03-c1dac29b7964 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:46.947635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bad5b-a3eb-4535-8f03-c1dac29b7964 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:46.956255 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1324 bytes} [Thu May 5 15:27:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:27:46.961463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc74ce-4424-4fdd-a98e-fdc5cbeddd51 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:46.970280 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc74ce-4424-4fdd-a98e-fdc5cbeddd51 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:46.974757 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c4c0f-33c2-4bb7-aee9-1bfaec99f259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:46.975598 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c4c0f-33c2-4bb7-aee9-1bfaec99f259 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:46.975873 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c4c0f-33c2-4bb7-aee9-1bfaec99f259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:46.976141 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c4c0f-33c2-4bb7-aee9-1bfaec99f259 admin admin] PATH_INFO: `/v3/users/8497965f53ce4709b6b853568b47ea71` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:46.977498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c4c0f-33c2-4bb7-aee9-1bfaec99f259 admin admin] RBAC: Authorizing `identity:get_user(user_id=8497965f53ce4709b6b853568b47ea71)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:46.979318 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c4c0f-33c2-4bb7-aee9-1bfaec99f259 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:46.980845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 5/9] 10.222.0.58 () {56 vars in 1198 bytes} [Thu May 5 15:27:46 2022] GET /identity/v3/users/8497965f53ce4709b6b853568b47ea71 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:27:49.285132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1e0f-ba82-41e8-90d2-6e754d543ea8 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:49.285671 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1e0f-ba82-41e8-90d2-6e754d543ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:49.285671 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1e0f-ba82-41e8-90d2-6e754d543ea8 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:49.287207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:49.292389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f35fc-7d87-4ee0-a5e6-96277dc084e1 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:49.292795 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f35fc-7d87-4ee0-a5e6-96277dc084e1 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:49.292951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f35fc-7d87-4ee0-a5e6-96277dc084e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:49.314924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec962ea7-1252-4489-8c90-f7fb42628e5f None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:49.315207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec962ea7-1252-4489-8c90-f7fb42628e5f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:49.315483 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec962ea7-1252-4489-8c90-f7fb42628e5f None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:49.316849 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 6/11] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:27:49.322583 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ba0f8-1073-40ab-ae60-4941f1b038fc None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:49.322867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ba0f8-1073-40ab-ae60-4941f1b038fc None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:49.323148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ba0f8-1073-40ab-ae60-4941f1b038fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:49.366670 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG passlib.handlers.bcrypt [None req-ae2ba0f8-1073-40ab-ae60-4941f1b038fc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80046) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 05 15:27:49.367078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG passlib.handlers.bcrypt [None req-ae2ba0f8-1073-40ab-ae60-4941f1b038fc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80046) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 05 15:27:49.414834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ae2ba0f8-1073-40ab-ae60-4941f1b038fc None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:49.416445 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ae2ba0f8-1073-40ab-ae60-4941f1b038fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:49.424494 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-e76f35fc-7d87-4ee0-a5e6-96277dc084e1 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:49.425657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e76f35fc-7d87-4ee0-a5e6-96277dc084e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:49.506012 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 6/12] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:27:49.514798 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:27:49.530791 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f35fc-7d87-4ee0-a5e6-96277dc084e1 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:49.536442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ba0f8-1073-40ab-ae60-4941f1b038fc None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:49.630522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f35fc-7d87-4ee0-a5e6-96277dc084e1 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:49.640847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ba0f8-1073-40ab-ae60-4941f1b038fc None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:49.663716 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcd0dd-4f3d-4f7a-a148-0b2cbd96485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:49.664507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcd0dd-4f3d-4f7a-a148-0b2cbd96485e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:49.664795 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcd0dd-4f3d-4f7a-a148-0b2cbd96485e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:49.665075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcd0dd-4f3d-4f7a-a148-0b2cbd96485e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:49.672861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242cf19-d1ba-4f11-ba4d-1e0a5c096852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:49.673746 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242cf19-d1ba-4f11-ba4d-1e0a5c096852 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:49.674035 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242cf19-d1ba-4f11-ba4d-1e0a5c096852 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:49.674340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242cf19-d1ba-4f11-ba4d-1e0a5c096852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:49.676694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcd0dd-4f3d-4f7a-a148-0b2cbd96485e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-75fcd0dd-4f3d-4f7a-a148-0b2cbd96485e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:27:49.688872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:27:49.690037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:27:49.691055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:27:49.691055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:27:49.691055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:27:49.691055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:27:49.691055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:27:49.691055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:27:49.691055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:27:49.691055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:27:49.691055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:27:49.691055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:27:49.691055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:27:49.691055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:27:49.691055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 7/14] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:27:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:27:49.695913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcd0dd-4f3d-4f7a-a148-0b2cbd96485e None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:49.741695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242cf19-d1ba-4f11-ba4d-1e0a5c096852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:49.743238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242cf19-d1ba-4f11-ba4d-1e0a5c096852 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:49.793370 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcd0dd-4f3d-4f7a-a148-0b2cbd96485e None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:49.826807 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d20eab-4959-486f-9e19-16166e20b370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:49.827463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d20eab-4959-486f-9e19-16166e20b370 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:49.827758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d20eab-4959-486f-9e19-16166e20b370 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:49.828030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d20eab-4959-486f-9e19-16166e20b370 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:49.828776 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d20eab-4959-486f-9e19-16166e20b370 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:27:49.829084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d20eab-4959-486f-9e19-16166e20b370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:49.830493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d20eab-4959-486f-9e19-16166e20b370 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:49.837227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 8/15] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:27:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:27:49.841980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 8/16] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:27:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:27:49.843070 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242cf19-d1ba-4f11-ba4d-1e0a5c096852 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:49.847319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d20eab-4959-486f-9e19-16166e20b370 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:49.937129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242cf19-d1ba-4f11-ba4d-1e0a5c096852 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:49.944649 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d20eab-4959-486f-9e19-16166e20b370 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:49.967881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e406be-4f27-4b46-a9d4-755cfd91fdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:49.968668 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e406be-4f27-4b46-a9d4-755cfd91fdaa None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:49.968944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e406be-4f27-4b46-a9d4-755cfd91fdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:49.969214 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e406be-4f27-4b46-a9d4-755cfd91fdaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:49.979226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0d4de-b77e-4612-b2f6-9b9a0806248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:49.980116 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0d4de-b77e-4612-b2f6-9b9a0806248c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:49.980400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0d4de-b77e-4612-b2f6-9b9a0806248c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:49.980675 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0d4de-b77e-4612-b2f6-9b9a0806248c None admin] PATH_INFO: `/v3/users/8497965f53ce4709b6b853568b47ea71` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:49.983111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0d4de-b77e-4612-b2f6-9b9a0806248c None admin] RBAC: Authorizing `identity:get_user(user_id=8497965f53ce4709b6b853568b47ea71)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:49.984607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0d4de-b77e-4612-b2f6-9b9a0806248c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:49.986351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 9/17] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:27:49 2022] GET /identity/v3/users/8497965f53ce4709b6b853568b47ea71 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:27:49.992222 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0d4de-b77e-4612-b2f6-9b9a0806248c None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:50.095637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e406be-4f27-4b46-a9d4-755cfd91fdaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:50.097071 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e406be-4f27-4b46-a9d4-755cfd91fdaa None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:50.097254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0d4de-b77e-4612-b2f6-9b9a0806248c None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:50.117586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d2e406be-4f27-4b46-a9d4-755cfd91fdaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:27:50.117586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:27:50.117586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:27:50.117586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:27:50.117586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:27:50.117586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:27:50.117586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:27:50.117586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:27:50.117586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:27:50.117586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:27:50.117586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:27:50.117586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:27:50.117586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:27:50.117586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:27:50.117586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:27:50.118476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:27:50.119270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:27:50.119270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:27:50.119270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:27:50.119270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:27:50.119270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 9/18] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:27:50.125206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e406be-4f27-4b46-a9d4-755cfd91fdaa None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:50.131542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c5764-bacc-4570-a206-8ea8360ab025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:50.132335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c5764-bacc-4570-a206-8ea8360ab025 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:50.132621 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c5764-bacc-4570-a206-8ea8360ab025 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:50.132896 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c5764-bacc-4570-a206-8ea8360ab025 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:50.134077 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c5764-bacc-4570-a206-8ea8360ab025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:50.135531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c5764-bacc-4570-a206-8ea8360ab025 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:50.137119 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 10/19] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:27:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:27:50.143359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c5764-bacc-4570-a206-8ea8360ab025 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:50.223270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e406be-4f27-4b46-a9d4-755cfd91fdaa None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:50.235078 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c5764-bacc-4570-a206-8ea8360ab025 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:50.255735 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167a847-ece0-4fee-ad58-19ba76fd75d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:50.256390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a847-ece0-4fee-ad58-19ba76fd75d2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:50.256670 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a847-ece0-4fee-ad58-19ba76fd75d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:50.256952 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a847-ece0-4fee-ad58-19ba76fd75d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:50.257664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167a847-ece0-4fee-ad58-19ba76fd75d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:27:50.257968 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167a847-ece0-4fee-ad58-19ba76fd75d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:50.259389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167a847-ece0-4fee-ad58-19ba76fd75d2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:50.267949 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd8d79-6017-41ec-84af-6b548eb843c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:50.268599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd8d79-6017-41ec-84af-6b548eb843c0 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:50.268885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd8d79-6017-41ec-84af-6b548eb843c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:50.269163 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd8d79-6017-41ec-84af-6b548eb843c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:50.269991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd8d79-6017-41ec-84af-6b548eb843c0 None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.domain.id=default, user.id=8497965f53ce4709b6b853568b47ea71) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:27:50.270339 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd8d79-6017-41ec-84af-6b548eb843c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:50.271754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd8d79-6017-41ec-84af-6b548eb843c0 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:50.276729 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 10/20] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:27:50.278495 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 11/21] 10.222.0.58 () {56 vars in 1322 bytes} [Thu May 5 15:27:50 2022] GET /identity/v3/role_assignments?user.id=8497965f53ce4709b6b853568b47ea71&scope.domain.id=default&role.id=70f81a43849a47f7bf393b354a46d048 => generated 233 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:27:52.832063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3748a25-2408-40dd-89d0-656c6e356463 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:52.832585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3748a25-2408-40dd-89d0-656c6e356463 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:52.832659 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3748a25-2408-40dd-89d0-656c6e356463 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:52.834105 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 11/22] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:52.839630 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ea345-df9f-48b1-8677-0a2b5cb4e989 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:52.840416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ea345-df9f-48b1-8677-0a2b5cb4e989 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:52.840940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ea345-df9f-48b1-8677-0a2b5cb4e989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:52.863155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-c50ea345-df9f-48b1-8677-0a2b5cb4e989 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:52.864599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c50ea345-df9f-48b1-8677-0a2b5cb4e989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:52.948484 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 12/23] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:27:52.983839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3748a25-2408-40dd-89d0-656c6e356463 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:53.107155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3748a25-2408-40dd-89d0-656c6e356463 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:53.164570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d86aab-1fa4-40e3-97ae-111e9f86503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:53.165402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d86aab-1fa4-40e3-97ae-111e9f86503a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:53.165679 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d86aab-1fa4-40e3-97ae-111e9f86503a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:53.165960 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d86aab-1fa4-40e3-97ae-111e9f86503a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:53.193299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d86aab-1fa4-40e3-97ae-111e9f86503a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-f2d86aab-1fa4-40e3-97ae-111e9f86503a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:27:53.202539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:27:53.203388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:27:53.204145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:27:53.204145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:27:53.204145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:27:53.204145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:27:53.204145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:27:53.204145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:27:53.204145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:27:53.204145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:27:53.204145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:27:53.204145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:27:53.204145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:27:53.204145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:27:53.208337 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 12/24] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:27:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:27:53.209625 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ea345-df9f-48b1-8677-0a2b5cb4e989 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:53.341136 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ea345-df9f-48b1-8677-0a2b5cb4e989 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:53.367402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372943d0-0de5-4903-a32d-4b7153fa3b05 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:53.367704 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372943d0-0de5-4903-a32d-4b7153fa3b05 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:53.367884 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372943d0-0de5-4903-a32d-4b7153fa3b05 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:53.369571 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 13/25] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:53.374869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d219b7e-188c-43c2-9153-d5ab995602f7 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:53.375160 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d219b7e-188c-43c2-9153-d5ab995602f7 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:53.375443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d219b7e-188c-43c2-9153-d5ab995602f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:53.384311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9bb74-de91-4de1-b308-47a30df6fcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:53.385273 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9bb74-de91-4de1-b308-47a30df6fcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:53.385753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9bb74-de91-4de1-b308-47a30df6fcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:53.386259 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9bb74-de91-4de1-b308-47a30df6fcf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:53.387234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9bb74-de91-4de1-b308-47a30df6fcf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:27:53.387812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9bb74-de91-4de1-b308-47a30df6fcf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:53.389509 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9bb74-de91-4de1-b308-47a30df6fcf3 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:53.402769 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 13/26] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:27:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:27:53.409147 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9bb74-de91-4de1-b308-47a30df6fcf3 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:53.411947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8d219b7e-188c-43c2-9153-d5ab995602f7 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:53.413154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8d219b7e-188c-43c2-9153-d5ab995602f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:53.527555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9bb74-de91-4de1-b308-47a30df6fcf3 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:53.571335 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 14/27] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:27:53.572690 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b9194-3b62-4c9d-a9b5-5032643f145e None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:53.572974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b9194-3b62-4c9d-a9b5-5032643f145e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:53.573249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b9194-3b62-4c9d-a9b5-5032643f145e None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:53.577382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 15/28] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:53.583079 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837518b-af62-4c7c-be77-9d5b799e32c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:53.583079 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837518b-af62-4c7c-be77-9d5b799e32c9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:53.583079 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837518b-af62-4c7c-be77-9d5b799e32c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:53.583079 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837518b-af62-4c7c-be77-9d5b799e32c9 None admin] PATH_INFO: `/v3/users/8497965f53ce4709b6b853568b47ea71` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:53.584613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837518b-af62-4c7c-be77-9d5b799e32c9 None admin] RBAC: Authorizing `identity:get_user(user_id=8497965f53ce4709b6b853568b47ea71)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:53.586426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837518b-af62-4c7c-be77-9d5b799e32c9 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:53.587263 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acaeb5-9254-415c-94af-532860eacc13 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:53.587546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acaeb5-9254-415c-94af-532860eacc13 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:53.587818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acaeb5-9254-415c-94af-532860eacc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:53.589420 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 14/29] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:27:53 2022] GET /identity/v3/users/8497965f53ce4709b6b853568b47ea71 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:27:53.595282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837518b-af62-4c7c-be77-9d5b799e32c9 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:53.624598 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-61acaeb5-9254-415c-94af-532860eacc13 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:53.625718 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-61acaeb5-9254-415c-94af-532860eacc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:53.699989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 16/30] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:27:53.700842 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acaeb5-9254-415c-94af-532860eacc13 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:53.774255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837518b-af62-4c7c-be77-9d5b799e32c9 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:53.802247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acaeb5-9254-415c-94af-532860eacc13 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:53.816746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1610eb-ce4e-4854-bb62-64a6068b1365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:53.817821 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1610eb-ce4e-4854-bb62-64a6068b1365 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:53.818109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1610eb-ce4e-4854-bb62-64a6068b1365 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:53.818579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1610eb-ce4e-4854-bb62-64a6068b1365 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:53.819994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1610eb-ce4e-4854-bb62-64a6068b1365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:53.821443 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1610eb-ce4e-4854-bb62-64a6068b1365 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:53.823487 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 15/31] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:27:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:27:53.824687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caae6e-2647-43fc-bf0e-63d994db6254 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:53.824997 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caae6e-2647-43fc-bf0e-63d994db6254 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:53.825272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caae6e-2647-43fc-bf0e-63d994db6254 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:53.827751 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 16/32] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:53.828626 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caae6e-2647-43fc-bf0e-63d994db6254 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:53.848456 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186cb3a-58c9-4d46-ad36-d0a6a42807ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:53.849390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186cb3a-58c9-4d46-ad36-d0a6a42807ea None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:53.849867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186cb3a-58c9-4d46-ad36-d0a6a42807ea None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:53.850326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186cb3a-58c9-4d46-ad36-d0a6a42807ea None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:53.851205 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186cb3a-58c9-4d46-ad36-d0a6a42807ea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:53.852764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186cb3a-58c9-4d46-ad36-d0a6a42807ea None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:53.942682 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caae6e-2647-43fc-bf0e-63d994db6254 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:53.977318 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0837f24-ed70-4eec-a174-40d9fe8a7e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:53.978034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0837f24-ed70-4eec-a174-40d9fe8a7e98 None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:53.978363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0837f24-ed70-4eec-a174-40d9fe8a7e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:53.978638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0837f24-ed70-4eec-a174-40d9fe8a7e98 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:53.979380 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0837f24-ed70-4eec-a174-40d9fe8a7e98 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:53.980749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0837f24-ed70-4eec-a174-40d9fe8a7e98 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:53.983105 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 17/33] 10.222.0.58 () {60 vars in 1131 bytes} [Thu May 5 15:27:53 2022] POST /identity/v3/roles => generated 225 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:27:53.985105 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ab6d2-0873-4d5f-8d83-d770ec15e488 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:53.985596 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ab6d2-0873-4d5f-8d83-d770ec15e488 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:53.986072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ab6d2-0873-4d5f-8d83-d770ec15e488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:54.014638 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-0c0ab6d2-0873-4d5f-8d83-d770ec15e488 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:54.016980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0c0ab6d2-0873-4d5f-8d83-d770ec15e488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:54.136716 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 18/34] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:27:54.138330 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ab6d2-0873-4d5f-8d83-d770ec15e488 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:54.158358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 17/35] 10.222.0.58 () {60 vars in 1131 bytes} [Thu May 5 15:27:53 2022] POST /identity/v3/roles => generated 219 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:27:54.176025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0837f24-ed70-4eec-a174-40d9fe8a7e98 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:54.295243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ab6d2-0873-4d5f-8d83-d770ec15e488 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:54.320274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0837f24-ed70-4eec-a174-40d9fe8a7e98 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:54.341661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f213a1-5bda-46e5-a492-2dbf9bb9939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:54.342685 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f213a1-5bda-46e5-a492-2dbf9bb9939f None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:54.342968 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f213a1-5bda-46e5-a492-2dbf9bb9939f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:54.343248 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f213a1-5bda-46e5-a492-2dbf9bb9939f None admin] PATH_INFO: `/v3/domains/default/users/8497965f53ce4709b6b853568b47ea71/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:54.345891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f213a1-5bda-46e5-a492-2dbf9bb9939f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8497965f53ce4709b6b853568b47ea71, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:54.347641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f213a1-5bda-46e5-a492-2dbf9bb9939f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:54.366571 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d65696-0ccf-43d9-b065-c81174d1e956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:54.367707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d65696-0ccf-43d9-b065-c81174d1e956 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:54.368261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d65696-0ccf-43d9-b065-c81174d1e956 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:54.374242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 19/36] 10.222.0.58 () {58 vars in 1361 bytes} [Thu May 5 15:27:54 2022] PUT /identity/v3/domains/default/users/8497965f53ce4709b6b853568b47ea71/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:27:54.374242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f7982-c406-42a8-b537-11af665bdb6b None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:54.374242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f7982-c406-42a8-b537-11af665bdb6b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:54.374242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f7982-c406-42a8-b537-11af665bdb6b None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:54.374943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 20/37] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:27:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:54.375555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d65696-0ccf-43d9-b065-c81174d1e956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:54.385481 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05eb05-0876-4ee2-9e46-de5e40ec3cfb None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:54.385835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05eb05-0876-4ee2-9e46-de5e40ec3cfb None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:54.386020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05eb05-0876-4ee2-9e46-de5e40ec3cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:54.395122 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d65696-0ccf-43d9-b065-c81174d1e956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:54.396885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d65696-0ccf-43d9-b065-c81174d1e956 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:54.421484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-cd05eb05-0876-4ee2-9e46-de5e40ec3cfb None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:54.427532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-cd05eb05-0876-4ee2-9e46-de5e40ec3cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:54.435129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-87d65696-0ccf-43d9-b065-c81174d1e956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:27:54.435129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:27:54.435129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:27:54.435129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:27:54.435129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:27:54.435129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:27:54.435129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:27:54.435129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:27:54.435129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:27:54.435129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:27:54.435129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:27:54.435129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:27:54.435129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:27:54.435129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:27:54.435129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:27:54.436011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:27:54.436801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:27:54.436801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:27:54.436801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:27:54.436801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:27:54.436801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 18/38] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:27:54.445039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d65696-0ccf-43d9-b065-c81174d1e956 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:54.561965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 21/39] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:27:54.586789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05eb05-0876-4ee2-9e46-de5e40ec3cfb None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:54.601387 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d65696-0ccf-43d9-b065-c81174d1e956 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:54.643666 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b74344-9d19-422c-977e-877117464052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:54.644348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b74344-9d19-422c-977e-877117464052 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:54.645188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b74344-9d19-422c-977e-877117464052 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:54.645188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b74344-9d19-422c-977e-877117464052 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:54.645616 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b74344-9d19-422c-977e-877117464052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:27:54.645925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b74344-9d19-422c-977e-877117464052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:54.647399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b74344-9d19-422c-977e-877117464052 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:54.665182 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 19/40] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:27:54.671208 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b74344-9d19-422c-977e-877117464052 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:54.707469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05eb05-0876-4ee2-9e46-de5e40ec3cfb None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:54.753623 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee8623-4782-4380-914d-8332ba2f4d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:54.755128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee8623-4782-4380-914d-8332ba2f4d24 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:54.755619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee8623-4782-4380-914d-8332ba2f4d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:54.756092 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee8623-4782-4380-914d-8332ba2f4d24 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:54.757412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee8623-4782-4380-914d-8332ba2f4d24 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:54.759655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee8623-4782-4380-914d-8332ba2f4d24 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:54.786240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b74344-9d19-422c-977e-877117464052 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:54.786565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 22/41] 10.222.0.58 () {60 vars in 1131 bytes} [Thu May 5 15:27:54 2022] POST /identity/v3/roles => generated 223 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:27:54.824662 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d2ad8-b2f7-4a38-a30d-9e5b9f14924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:54.825931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d2ad8-b2f7-4a38-a30d-9e5b9f14924b None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:54.826389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d2ad8-b2f7-4a38-a30d-9e5b9f14924b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:54.826823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d2ad8-b2f7-4a38-a30d-9e5b9f14924b None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:54.827743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d2ad8-b2f7-4a38-a30d-9e5b9f14924b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:54.829545 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d2ad8-b2f7-4a38-a30d-9e5b9f14924b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:54.864091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 20/42] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 5 15:27:54 2022] POST /identity/v3/projects => generated 301 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:27:54.896071 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78342f1-e82d-42d4-9a84-49ae808d8584 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:54.896663 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78342f1-e82d-42d4-9a84-49ae808d8584 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:54.896663 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78342f1-e82d-42d4-9a84-49ae808d8584 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:54.898099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 23/43] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:54.904819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39dbad9-5aa1-4b75-8f88-1c8df56af1af None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:54.905163 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39dbad9-5aa1-4b75-8f88-1c8df56af1af None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:54.905445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39dbad9-5aa1-4b75-8f88-1c8df56af1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:54.924617 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-d39dbad9-5aa1-4b75-8f88-1c8df56af1af None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:54.926260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d39dbad9-5aa1-4b75-8f88-1c8df56af1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:55.004754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 21/44] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:27:55.030472 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78342f1-e82d-42d4-9a84-49ae808d8584 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:55.141645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78342f1-e82d-42d4-9a84-49ae808d8584 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:55.175594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5331c-7a8a-47e0-b3ad-2ada0dd76431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:55.176385 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5331c-7a8a-47e0-b3ad-2ada0dd76431 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:55.176667 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5331c-7a8a-47e0-b3ad-2ada0dd76431 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:55.176942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5331c-7a8a-47e0-b3ad-2ada0dd76431 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:55.178104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5331c-7a8a-47e0-b3ad-2ada0dd76431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:55.179569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5331c-7a8a-47e0-b3ad-2ada0dd76431 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:55.181167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 24/45] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:27:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:27:55.187336 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39dbad9-5aa1-4b75-8f88-1c8df56af1af None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:55.280517 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39dbad9-5aa1-4b75-8f88-1c8df56af1af None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:55.313246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87b3d5-9124-4a9e-bc11-dfe66ad5bcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:55.313906 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87b3d5-9124-4a9e-bc11-dfe66ad5bcf1 None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:55.314216 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87b3d5-9124-4a9e-bc11-dfe66ad5bcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:55.314500 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87b3d5-9124-4a9e-bc11-dfe66ad5bcf1 None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:55.315212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87b3d5-9124-4a9e-bc11-dfe66ad5bcf1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:55.316664 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87b3d5-9124-4a9e-bc11-dfe66ad5bcf1 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:55.339969 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 22/46] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 5 15:27:55 2022] POST /identity/v3/projects => generated 312 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:27:56.734413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df8823-ef9e-4d83-976d-9d30f0c02463 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:56.734919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df8823-ef9e-4d83-976d-9d30f0c02463 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:56.735026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df8823-ef9e-4d83-976d-9d30f0c02463 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:56.736325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 25/47] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:56.741511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db65a51-9ca2-40fd-b17e-2083269427eb None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:56.741908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db65a51-9ca2-40fd-b17e-2083269427eb None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:56.742064 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db65a51-9ca2-40fd-b17e-2083269427eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:56.758475 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-2db65a51-9ca2-40fd-b17e-2083269427eb None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:56.759689 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-2db65a51-9ca2-40fd-b17e-2083269427eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:56.823974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 23/48] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:27:56.846901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df8823-ef9e-4d83-976d-9d30f0c02463 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:56.943271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df8823-ef9e-4d83-976d-9d30f0c02463 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:56.975522 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ffd5d-8f49-4d87-b852-f9a7d247406c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:56.976307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ffd5d-8f49-4d87-b852-f9a7d247406c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:56.976587 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ffd5d-8f49-4d87-b852-f9a7d247406c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:56.976859 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ffd5d-8f49-4d87-b852-f9a7d247406c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:56.986490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ffd5d-8f49-4d87-b852-f9a7d247406c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-a04ffd5d-8f49-4d87-b852-f9a7d247406c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:27:56.993896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:27:56.994810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:27:56.995573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:27:56.995573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:27:56.995573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:27:56.995573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:27:56.995573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:27:56.995573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:27:56.995573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:27:56.995573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:27:56.995573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:27:56.995573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:27:56.995573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:27:56.995573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:27:56.995573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 26/49] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:27:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:27:57.001523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db65a51-9ca2-40fd-b17e-2083269427eb None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:57.096692 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db65a51-9ca2-40fd-b17e-2083269427eb None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:57.129155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e71bf2-01cb-4b06-ad1a-b3eaf77c481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:57.129903 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e71bf2-01cb-4b06-ad1a-b3eaf77c481e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:57.130217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e71bf2-01cb-4b06-ad1a-b3eaf77c481e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:57.130504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e71bf2-01cb-4b06-ad1a-b3eaf77c481e None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:57.131250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e71bf2-01cb-4b06-ad1a-b3eaf77c481e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:27:57.131561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e71bf2-01cb-4b06-ad1a-b3eaf77c481e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:57.132948 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e71bf2-01cb-4b06-ad1a-b3eaf77c481e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:57.140967 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 24/50] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:27:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:27:57.146493 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ffd5d-8f49-4d87-b852-f9a7d247406c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:57.250347 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ffd5d-8f49-4d87-b852-f9a7d247406c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:57.283834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bf7d3-6452-4586-b5d0-88fdffa2ea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:57.284701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bf7d3-6452-4586-b5d0-88fdffa2ea2a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:57.284984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bf7d3-6452-4586-b5d0-88fdffa2ea2a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:57.285258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bf7d3-6452-4586-b5d0-88fdffa2ea2a None admin] PATH_INFO: `/v3/users/8497965f53ce4709b6b853568b47ea71` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:57.286511 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bf7d3-6452-4586-b5d0-88fdffa2ea2a None admin] RBAC: Authorizing `identity:get_user(user_id=8497965f53ce4709b6b853568b47ea71)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:57.287957 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bf7d3-6452-4586-b5d0-88fdffa2ea2a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:57.289573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 27/51] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:27:57 2022] GET /identity/v3/users/8497965f53ce4709b6b853568b47ea71 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:27:57.295135 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e71bf2-01cb-4b06-ad1a-b3eaf77c481e None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:57.390745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e71bf2-01cb-4b06-ad1a-b3eaf77c481e None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:57.425319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ce674-0cf3-4fb1-91bc-267d0719afb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:57.426138 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ce674-0cf3-4fb1-91bc-267d0719afb4 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:57.426455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ce674-0cf3-4fb1-91bc-267d0719afb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:57.426898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ce674-0cf3-4fb1-91bc-267d0719afb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:57.428174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ce674-0cf3-4fb1-91bc-267d0719afb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:57.429645 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ce674-0cf3-4fb1-91bc-267d0719afb4 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:57.431442 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 25/52] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:27:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:27:57.438024 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bf7d3-6452-4586-b5d0-88fdffa2ea2a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:57.540717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bf7d3-6452-4586-b5d0-88fdffa2ea2a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:57.573764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece53d3-9dbe-46f8-8518-deb682dd7141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:57.574448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece53d3-9dbe-46f8-8518-deb682dd7141 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:57.574733 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece53d3-9dbe-46f8-8518-deb682dd7141 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:57.575051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece53d3-9dbe-46f8-8518-deb682dd7141 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:57.576002 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece53d3-9dbe-46f8-8518-deb682dd7141 None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.domain.id=default, user.id=8497965f53ce4709b6b853568b47ea71) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:27:57.576341 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece53d3-9dbe-46f8-8518-deb682dd7141 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:57.577773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece53d3-9dbe-46f8-8518-deb682dd7141 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:57.585590 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 28/53] 10.222.0.58 () {56 vars in 1322 bytes} [Thu May 5 15:27:57 2022] GET /identity/v3/role_assignments?user.id=8497965f53ce4709b6b853568b47ea71&scope.domain.id=default&role.id=70f81a43849a47f7bf393b354a46d048 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:27:57.600715 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f68c4-333e-4f2e-baf1-3d7def55edfe None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:57.601120 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f68c4-333e-4f2e-baf1-3d7def55edfe None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:57.601475 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f68c4-333e-4f2e-baf1-3d7def55edfe None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:57.603017 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 26/54] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:27:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:27:57.609539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0a9a4-4283-405b-8450-40a40754e421 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:57.609829 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0a9a4-4283-405b-8450-40a40754e421 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:57.610111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0a9a4-4283-405b-8450-40a40754e421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:57.627844 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f7c0a9a4-4283-405b-8450-40a40754e421 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:27:57.629108 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f7c0a9a4-4283-405b-8450-40a40754e421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:27:57.699275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 29/55] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:27:57.722552 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f68c4-333e-4f2e-baf1-3d7def55edfe None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:57.824425 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f68c4-333e-4f2e-baf1-3d7def55edfe None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:57.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d9e0f-d0bc-4a48-958f-5351cf433476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:57.859365 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d9e0f-d0bc-4a48-958f-5351cf433476 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:57.859652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d9e0f-d0bc-4a48-958f-5351cf433476 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:57.859929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d9e0f-d0bc-4a48-958f-5351cf433476 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:57.861093 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d9e0f-d0bc-4a48-958f-5351cf433476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:57.862561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d9e0f-d0bc-4a48-958f-5351cf433476 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:57.864261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 27/56] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:27:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:27:57.869899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0a9a4-4283-405b-8450-40a40754e421 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:27:57.962353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0a9a4-4283-405b-8450-40a40754e421 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:27:57.994271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34dc1c-d79a-47a4-bfa1-5b5d6b9d3c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:27:57.994919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34dc1c-d79a-47a4-bfa1-5b5d6b9d3c88 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:27:57.995202 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34dc1c-d79a-47a4-bfa1-5b5d6b9d3c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:27:57.995475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34dc1c-d79a-47a4-bfa1-5b5d6b9d3c88 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:27:57.996182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34dc1c-d79a-47a4-bfa1-5b5d6b9d3c88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:27:57.998340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34dc1c-d79a-47a4-bfa1-5b5d6b9d3c88 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:27:58.022972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 30/57] 10.222.0.58 () {60 vars in 1140 bytes} [Thu May 5 15:27:57 2022] POST /identity/v3/projects => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:28:00.369160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4a06a-ce87-4d36-9798-bab73b51439d None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:00.369670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4a06a-ce87-4d36-9798-bab73b51439d None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:00.369753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4a06a-ce87-4d36-9798-bab73b51439d None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:00.371124 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 28/58] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:00.376770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8874fe2-7caf-471d-bcdb-c4ff53226117 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:00.377165 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8874fe2-7caf-471d-bcdb-c4ff53226117 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:00.377328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8874fe2-7caf-471d-bcdb-c4ff53226117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:00.393587 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d8874fe2-7caf-471d-bcdb-c4ff53226117 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:00.394798 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d8874fe2-7caf-471d-bcdb-c4ff53226117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:00.456849 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 31/59] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:00.480674 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4a06a-ce87-4d36-9798-bab73b51439d None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:00.581183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4a06a-ce87-4d36-9798-bab73b51439d None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:00.614346 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699763d-cd79-420c-9314-ee3063885dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:00.615132 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699763d-cd79-420c-9314-ee3063885dab None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:00.615419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699763d-cd79-420c-9314-ee3063885dab None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:00.615699 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699763d-cd79-420c-9314-ee3063885dab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:00.616926 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699763d-cd79-420c-9314-ee3063885dab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:00.618442 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699763d-cd79-420c-9314-ee3063885dab None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:00.620096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 29/60] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:28:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:00.625640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8874fe2-7caf-471d-bcdb-c4ff53226117 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:00.717372 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8874fe2-7caf-471d-bcdb-c4ff53226117 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:00.748999 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf020d-01f1-4ac9-9bb8-1555a785238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:00.749685 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf020d-01f1-4ac9-9bb8-1555a785238b None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:00.749969 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf020d-01f1-4ac9-9bb8-1555a785238b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:00.750320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf020d-01f1-4ac9-9bb8-1555a785238b None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:00.751021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf020d-01f1-4ac9-9bb8-1555a785238b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:00.752460 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf020d-01f1-4ac9-9bb8-1555a785238b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:00.776474 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 32/61] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:28:00 2022] POST /identity/v3/users => generated 275 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:28:04.092876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad387da-d6c2-4be3-9fe1-204c7565835b None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:04.093440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad387da-d6c2-4be3-9fe1-204c7565835b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:04.093440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad387da-d6c2-4be3-9fe1-204c7565835b None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:04.094835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 30/62] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:04.100651 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347c89-53b3-43cf-bde9-162648ece577 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:04.101089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347c89-53b3-43cf-bde9-162648ece577 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:04.101267 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347c89-53b3-43cf-bde9-162648ece577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:04.122367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e1347c89-53b3-43cf-bde9-162648ece577 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:04.123585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e1347c89-53b3-43cf-bde9-162648ece577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:04.217023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 33/63] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:04.268912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad387da-d6c2-4be3-9fe1-204c7565835b None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:04.415925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad387da-d6c2-4be3-9fe1-204c7565835b None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:04.456920 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef6ceb-6b4f-4867-ab28-c5c5fdfe8bf9 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:04.457566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef6ceb-6b4f-4867-ab28-c5c5fdfe8bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:04.458047 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef6ceb-6b4f-4867-ab28-c5c5fdfe8bf9 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:04.458863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad115535-2f37-4c4e-86c6-cbc532f6a454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:04.459656 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad115535-2f37-4c4e-86c6-cbc532f6a454 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:04.459939 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad115535-2f37-4c4e-86c6-cbc532f6a454 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:04.460213 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad115535-2f37-4c4e-86c6-cbc532f6a454 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:04.460516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 34/64] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:28:04.466684 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb25df-ef26-4687-9b7b-5d4e34db4bf3 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:04.467337 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb25df-ef26-4687-9b7b-5d4e34db4bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:04.467850 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb25df-ef26-4687-9b7b-5d4e34db4bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:04.478211 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad115535-2f37-4c4e-86c6-cbc532f6a454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-ad115535-2f37-4c4e-86c6-cbc532f6a454 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:04.482041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:04.483683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:04.484528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:04.484528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:04.484528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:04.484528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:04.484528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:04.484528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:04.484528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:04.484528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:04.484528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:04.484528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:04.484528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:04.484528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:04.484528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 31/65] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:28:04.494298 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad115535-2f37-4c4e-86c6-cbc532f6a454 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:04.519470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8ffb25df-ef26-4687-9b7b-5d4e34db4bf3 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:04.520761 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8ffb25df-ef26-4687-9b7b-5d4e34db4bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:04.605459 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad115535-2f37-4c4e-86c6-cbc532f6a454 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:04.644581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eba26d-4d57-4f36-95db-d78297037833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:04.645632 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eba26d-4d57-4f36-95db-d78297037833 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:04.646129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eba26d-4d57-4f36-95db-d78297037833 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:04.646614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eba26d-4d57-4f36-95db-d78297037833 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:04.648664 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eba26d-4d57-4f36-95db-d78297037833 None admin] RBAC: Adding query filter params (name=member) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:04.649166 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eba26d-4d57-4f36-95db-d78297037833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:04.651479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eba26d-4d57-4f36-95db-d78297037833 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:04.666286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 32/66] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:04.673087 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eba26d-4d57-4f36-95db-d78297037833 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:04.692599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 35/67] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:04.730099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb25df-ef26-4687-9b7b-5d4e34db4bf3 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:04.794445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eba26d-4d57-4f36-95db-d78297037833 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:04.829504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8807296-d0b7-441d-a25a-68a86b122438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:04.830420 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8807296-d0b7-441d-a25a-68a86b122438 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:04.830709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8807296-d0b7-441d-a25a-68a86b122438 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:04.830988 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8807296-d0b7-441d-a25a-68a86b122438 None admin] PATH_INFO: `/v3/users/d5392740d74041fc8ae879c1f5794f83` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:04.843383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb25df-ef26-4687-9b7b-5d4e34db4bf3 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:04.844446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8807296-d0b7-441d-a25a-68a86b122438 None admin] RBAC: Authorizing `identity:get_user(user_id=d5392740d74041fc8ae879c1f5794f83)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:04.845923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8807296-d0b7-441d-a25a-68a86b122438 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:04.847633 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 33/68] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:04 2022] GET /identity/v3/users/d5392740d74041fc8ae879c1f5794f83 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:04.849378 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4c8c0-b8cf-4bd0-aa22-78c50d271549 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:04.849658 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4c8c0-b8cf-4bd0-aa22-78c50d271549 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:04.850085 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4c8c0-b8cf-4bd0-aa22-78c50d271549 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:04.855479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 34/69] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:04.856396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea112b4-614b-4cb1-b138-2d4448bab3af None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:04.856855 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea112b4-614b-4cb1-b138-2d4448bab3af None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:04.857134 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea112b4-614b-4cb1-b138-2d4448bab3af None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:04.858889 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 35/70] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:04.859365 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea112b4-614b-4cb1-b138-2d4448bab3af None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:04.885970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78430e90-63c1-4eb1-abc7-13a9020fcf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:04.886800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78430e90-63c1-4eb1-abc7-13a9020fcf12 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:04.887624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78430e90-63c1-4eb1-abc7-13a9020fcf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:04.888489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78430e90-63c1-4eb1-abc7-13a9020fcf12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:04.898666 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78430e90-63c1-4eb1-abc7-13a9020fcf12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-78430e90-63c1-4eb1-abc7-13a9020fcf12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:04.907031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:04.907906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:04.908795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:04.908795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:04.908795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:04.908795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:04.908795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:04.908795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:04.908795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:04.908795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:04.908795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:04.908795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:04.908795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:04.908795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:04.908795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 36/71] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:28:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:04.911478 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ee9fd-38c8-4d02-bd94-88845b033ec8 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:04.911771 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ee9fd-38c8-4d02-bd94-88845b033ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:04.912052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ee9fd-38c8-4d02-bd94-88845b033ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:04.929757 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b83ee9fd-38c8-4d02-bd94-88845b033ec8 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:04.930884 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b83ee9fd-38c8-4d02-bd94-88845b033ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:04.964776 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea112b4-614b-4cb1-b138-2d4448bab3af None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:04.994748 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 37/72] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:04.996022 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfe890-29bf-4186-b86b-56d01b04edd4 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:04.996309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfe890-29bf-4186-b86b-56d01b04edd4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:04.996612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfe890-29bf-4186-b86b-56d01b04edd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:04.998512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb3efa-3d0f-4ea9-b291-793b3b3bf8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:04.999156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb3efa-3d0f-4ea9-b291-793b3b3bf8ea None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:04.999439 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb3efa-3d0f-4ea9-b291-793b3b3bf8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:04.999711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb3efa-3d0f-4ea9-b291-793b3b3bf8ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:05.018039 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a2cfe890-29bf-4186-b86b-56d01b04edd4 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:05.019244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a2cfe890-29bf-4186-b86b-56d01b04edd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:05.064161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb3efa-3d0f-4ea9-b291-793b3b3bf8ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:05.065609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb3efa-3d0f-4ea9-b291-793b3b3bf8ea None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:05.082135 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 38/73] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:05.090407 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfe890-29bf-4186-b86b-56d01b04edd4 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:05.159150 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 36/74] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:05.160456 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa29c0-5924-45c2-8846-d8b3856e43af None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:05.160749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa29c0-5924-45c2-8846-d8b3856e43af None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:05.161025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa29c0-5924-45c2-8846-d8b3856e43af None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:05.162440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 37/75] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:05.163011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa29c0-5924-45c2-8846-d8b3856e43af None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:05.177646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfe890-29bf-4186-b86b-56d01b04edd4 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:05.210586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24c276-6097-4235-ac7e-dc3af294c304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:05.211181 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24c276-6097-4235-ac7e-dc3af294c304 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:05.211465 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24c276-6097-4235-ac7e-dc3af294c304 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:05.211740 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24c276-6097-4235-ac7e-dc3af294c304 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:05.212478 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24c276-6097-4235-ac7e-dc3af294c304 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:05.212784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24c276-6097-4235-ac7e-dc3af294c304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:05.214186 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24c276-6097-4235-ac7e-dc3af294c304 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:05.226794 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 39/76] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:05.227538 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24c276-6097-4235-ac7e-dc3af294c304 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:05.259466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa29c0-5924-45c2-8846-d8b3856e43af None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:05.292540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea6592-a010-4974-90ee-38d010d9f919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:05.293317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea6592-a010-4974-90ee-38d010d9f919 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:05.293754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea6592-a010-4974-90ee-38d010d9f919 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:05.294037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea6592-a010-4974-90ee-38d010d9f919 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:05.303512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea6592-a010-4974-90ee-38d010d9f919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-dfea6592-a010-4974-90ee-38d010d9f919 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:05.311761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:05.312599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:05.313347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:05.313347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:05.313347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:05.313347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:05.313347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:05.313347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:05.313347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:05.313347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:05.313347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:05.313347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:05.313347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:05.313347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:05.313347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 38/77] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:05.314389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c93b1-d2fe-4330-a9e6-9bec551948c3 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:05.314389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c93b1-d2fe-4330-a9e6-9bec551948c3 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:05.314622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c93b1-d2fe-4330-a9e6-9bec551948c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:05.323952 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24c276-6097-4235-ac7e-dc3af294c304 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:05.330782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-c43c93b1-d2fe-4330-a9e6-9bec551948c3 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:05.331942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c43c93b1-d2fe-4330-a9e6-9bec551948c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:05.356593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5704a0c-3c42-4520-812e-0f0d364e9b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:05.357401 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5704a0c-3c42-4520-812e-0f0d364e9b5d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:05.357688 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5704a0c-3c42-4520-812e-0f0d364e9b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:05.357967 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5704a0c-3c42-4520-812e-0f0d364e9b5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:05.367692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5704a0c-3c42-4520-812e-0f0d364e9b5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-c5704a0c-3c42-4520-812e-0f0d364e9b5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:05.376292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:05.377155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:05.377973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:05.377973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:05.377973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:05.377973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:05.377973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:05.377973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:05.377973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:05.377973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:05.377973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:05.377973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:05.377973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:05.377973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:05.377973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 40/78] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:28:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:05.379147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5704a0c-3c42-4520-812e-0f0d364e9b5d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:05.397235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 39/79] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:05.398077 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c93b1-d2fe-4330-a9e6-9bec551948c3 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:05.475796 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5704a0c-3c42-4520-812e-0f0d364e9b5d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:05.494318 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c93b1-d2fe-4330-a9e6-9bec551948c3 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:05.507149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5a91f-e4a9-445c-834f-503b6166c1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:05.508014 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5a91f-e4a9-445c-834f-503b6166c1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:05.508296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5a91f-e4a9-445c-834f-503b6166c1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:05.508571 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5a91f-e4a9-445c-834f-503b6166c1c0 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:05.509797 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5a91f-e4a9-445c-834f-503b6166c1c0 None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:05.511277 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5a91f-e4a9-445c-834f-503b6166c1c0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:05.513736 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 41/80] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:05 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:05.514536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5a91f-e4a9-445c-834f-503b6166c1c0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:05.527021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a5774-4301-478e-8e3d-24eb43102261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:05.528463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a5774-4301-478e-8e3d-24eb43102261 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:05.528743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a5774-4301-478e-8e3d-24eb43102261 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:05.529015 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a5774-4301-478e-8e3d-24eb43102261 None admin] PATH_INFO: `/v3/users/8497965f53ce4709b6b853568b47ea71` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:05.530439 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a5774-4301-478e-8e3d-24eb43102261 None admin] RBAC: Authorizing `identity:get_user(user_id=8497965f53ce4709b6b853568b47ea71)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:05.531910 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a5774-4301-478e-8e3d-24eb43102261 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:05.533523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 40/81] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:05 2022] GET /identity/v3/users/8497965f53ce4709b6b853568b47ea71 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:05.534297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a5774-4301-478e-8e3d-24eb43102261 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:05.618586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5a91f-e4a9-445c-834f-503b6166c1c0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:05.627786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a5774-4301-478e-8e3d-24eb43102261 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:05.649589 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dee84-ad2d-468c-aced-5c9e91d85f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:05.650291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dee84-ad2d-468c-aced-5c9e91d85f7e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:05.650575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dee84-ad2d-468c-aced-5c9e91d85f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:05.650849 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dee84-ad2d-468c-aced-5c9e91d85f7e None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:05.651586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dee84-ad2d-468c-aced-5c9e91d85f7e None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:05.651895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dee84-ad2d-468c-aced-5c9e91d85f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:05.654052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dee84-ad2d-468c-aced-5c9e91d85f7e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:05.660766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748a3b6-3f7e-4b4c-a2f2-168e53e1caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:05.661422 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748a3b6-3f7e-4b4c-a2f2-168e53e1caca None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:05.661703 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748a3b6-3f7e-4b4c-a2f2-168e53e1caca None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:05.661976 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748a3b6-3f7e-4b4c-a2f2-168e53e1caca None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:05.662358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 42/82] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:05.663092 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dee84-ad2d-468c-aced-5c9e91d85f7e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:05.669513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748a3b6-3f7e-4b4c-a2f2-168e53e1caca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:05.669513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748a3b6-3f7e-4b4c-a2f2-168e53e1caca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:05.669513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748a3b6-3f7e-4b4c-a2f2-168e53e1caca None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:05.676482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 41/83] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:28:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:05.677277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748a3b6-3f7e-4b4c-a2f2-168e53e1caca None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:05.758879 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dee84-ad2d-468c-aced-5c9e91d85f7e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:05.775416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748a3b6-3f7e-4b4c-a2f2-168e53e1caca None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:05.791248 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af17fc3-d7e7-4a0a-937d-2b025cb0bef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:05.792043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af17fc3-d7e7-4a0a-937d-2b025cb0bef2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:05.792327 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af17fc3-d7e7-4a0a-937d-2b025cb0bef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:05.792614 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af17fc3-d7e7-4a0a-937d-2b025cb0bef2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:05.793782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af17fc3-d7e7-4a0a-937d-2b025cb0bef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:05.795274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af17fc3-d7e7-4a0a-937d-2b025cb0bef2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:05.796975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 43/84] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:28:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:05.801423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af17fc3-d7e7-4a0a-937d-2b025cb0bef2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:05.807657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab42d1-9b9a-4671-afa0-fbb3606d55f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:05.808319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab42d1-9b9a-4671-afa0-fbb3606d55f4 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:05.808600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab42d1-9b9a-4671-afa0-fbb3606d55f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:05.808876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab42d1-9b9a-4671-afa0-fbb3606d55f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:05.810440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab42d1-9b9a-4671-afa0-fbb3606d55f4 None admin] RBAC: Adding query filter params (role.id=8f649e044d134d799d7bbaf6e0715e34, scope.project.id=d19a556265e745c3a127579e6b3fed9c, user.id=d5392740d74041fc8ae879c1f5794f83) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:05.810749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab42d1-9b9a-4671-afa0-fbb3606d55f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:05.812168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab42d1-9b9a-4671-afa0-fbb3606d55f4 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:05.817376 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 42/85] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:05 2022] GET /identity/v3/role_assignments?user.id=d5392740d74041fc8ae879c1f5794f83&scope.project.id=d19a556265e745c3a127579e6b3fed9c&role.id=8f649e044d134d799d7bbaf6e0715e34 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:05.818137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab42d1-9b9a-4671-afa0-fbb3606d55f4 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:05.900405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af17fc3-d7e7-4a0a-937d-2b025cb0bef2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:05.924008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab42d1-9b9a-4671-afa0-fbb3606d55f4 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:05.935941 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b7521-e963-4025-9c3d-f9d4303d089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:05.936488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b7521-e963-4025-9c3d-f9d4303d089e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:05.936770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b7521-e963-4025-9c3d-f9d4303d089e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:05.937046 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b7521-e963-4025-9c3d-f9d4303d089e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:05.958831 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f473c0-896e-4f79-8fbe-197d0ba8b7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:05.959716 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f473c0-896e-4f79-8fbe-197d0ba8b7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:05.959998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f473c0-896e-4f79-8fbe-197d0ba8b7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:05.960274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f473c0-896e-4f79-8fbe-197d0ba8b7e3 None admin] PATH_INFO: `/v3/users/d5392740d74041fc8ae879c1f5794f83` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:05.961498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f473c0-896e-4f79-8fbe-197d0ba8b7e3 None admin] RBAC: Authorizing `identity:get_user(user_id=d5392740d74041fc8ae879c1f5794f83)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:05.962979 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f473c0-896e-4f79-8fbe-197d0ba8b7e3 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:05.964876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 43/86] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:05 2022] GET /identity/v3/users/d5392740d74041fc8ae879c1f5794f83 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:05.965944 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f473c0-896e-4f79-8fbe-197d0ba8b7e3 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:06.007138 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b7521-e963-4025-9c3d-f9d4303d089e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:06.008629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b7521-e963-4025-9c3d-f9d4303d089e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:06.065393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f473c0-896e-4f79-8fbe-197d0ba8b7e3 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:06.098475 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f6084-7fcf-4d61-ae3d-05da39a2108b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:06.099588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f6084-7fcf-4d61-ae3d-05da39a2108b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:06.099875 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f6084-7fcf-4d61-ae3d-05da39a2108b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:06.100148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f6084-7fcf-4d61-ae3d-05da39a2108b None admin] PATH_INFO: `/v3/users/d5392740d74041fc8ae879c1f5794f83` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:06.101350 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f6084-7fcf-4d61-ae3d-05da39a2108b None admin] RBAC: Authorizing `identity:get_user(user_id=d5392740d74041fc8ae879c1f5794f83)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:06.102831 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f6084-7fcf-4d61-ae3d-05da39a2108b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:06.109025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 44/87] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:05 2022] GET /identity/v3/users/d5392740d74041fc8ae879c1f5794f83 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:06.109025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f6084-7fcf-4d61-ae3d-05da39a2108b None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:06.109215 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 44/88] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:06.109215 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b7521-e963-4025-9c3d-f9d4303d089e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:06.205212 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b7521-e963-4025-9c3d-f9d4303d089e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:06.206689 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f6084-7fcf-4d61-ae3d-05da39a2108b None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:06.238350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6742fd7-70da-45cb-a35a-4d6ecf484844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:06.239003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6742fd7-70da-45cb-a35a-4d6ecf484844 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:06.239379 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6742fd7-70da-45cb-a35a-4d6ecf484844 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:06.239764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6742fd7-70da-45cb-a35a-4d6ecf484844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:06.240772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee1f02-7260-4fdd-b98d-f096d3f6e33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:06.241449 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee1f02-7260-4fdd-b98d-f096d3f6e33a None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:06.241738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee1f02-7260-4fdd-b98d-f096d3f6e33a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:06.242019 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee1f02-7260-4fdd-b98d-f096d3f6e33a None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:06.242756 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee1f02-7260-4fdd-b98d-f096d3f6e33a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:06.244253 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee1f02-7260-4fdd-b98d-f096d3f6e33a None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:06.270682 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 45/89] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:28:06 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:28:06.271407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee1f02-7260-4fdd-b98d-f096d3f6e33a None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:06.308551 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6742fd7-70da-45cb-a35a-4d6ecf484844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:06.310990 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6742fd7-70da-45cb-a35a-4d6ecf484844 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:06.380481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee1f02-7260-4fdd-b98d-f096d3f6e33a None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:06.415905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 45/90] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:06.419263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531c8ff-fe13-4df4-bca2-7833a0e24ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:06.420061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531c8ff-fe13-4df4-bca2-7833a0e24ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:06.420349 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531c8ff-fe13-4df4-bca2-7833a0e24ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:06.420627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531c8ff-fe13-4df4-bca2-7833a0e24ff2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:06.422323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6742fd7-70da-45cb-a35a-4d6ecf484844 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:06.502676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531c8ff-fe13-4df4-bca2-7833a0e24ff2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:06.504170 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531c8ff-fe13-4df4-bca2-7833a0e24ff2 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:06.529090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6742fd7-70da-45cb-a35a-4d6ecf484844 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:06.567681 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdee0a-ec9e-4ab7-ae7d-73c7a4a40e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:06.568552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdee0a-ec9e-4ab7-ae7d-73c7a4a40e0c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:06.568832 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdee0a-ec9e-4ab7-ae7d-73c7a4a40e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:06.569552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdee0a-ec9e-4ab7-ae7d-73c7a4a40e0c None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:06.571076 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdee0a-ec9e-4ab7-ae7d-73c7a4a40e0c None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:06.573005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdee0a-ec9e-4ab7-ae7d-73c7a4a40e0c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:06.575129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 46/91] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:06 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:06.575853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdee0a-ec9e-4ab7-ae7d-73c7a4a40e0c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:06.632746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 46/92] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:06.633440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531c8ff-fe13-4df4-bca2-7833a0e24ff2 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:06.681085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdee0a-ec9e-4ab7-ae7d-73c7a4a40e0c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:06.716442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee313c70-ef6e-47c0-a6b4-8b7525e6d2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:06.717642 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee313c70-ef6e-47c0-a6b4-8b7525e6d2ec None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:06.718114 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee313c70-ef6e-47c0-a6b4-8b7525e6d2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:06.718625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee313c70-ef6e-47c0-a6b4-8b7525e6d2ec None admin] PATH_INFO: `/v3/projects/7e653d5da8b34459a9bbe3530ffbda6a` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:06.720023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee313c70-ef6e-47c0-a6b4-8b7525e6d2ec None admin] RBAC: Authorizing `identity:get_project(project_id=7e653d5da8b34459a9bbe3530ffbda6a)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:06.721661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee313c70-ef6e-47c0-a6b4-8b7525e6d2ec None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:06.724349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 47/93] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:06 2022] GET /identity/v3/projects/7e653d5da8b34459a9bbe3530ffbda6a => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:06.725354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee313c70-ef6e-47c0-a6b4-8b7525e6d2ec None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:06.768085 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531c8ff-fe13-4df4-bca2-7833a0e24ff2 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:06.805018 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c528e0-a53a-4830-8504-119f9b8ff83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:06.805750 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c528e0-a53a-4830-8504-119f9b8ff83b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:06.806056 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c528e0-a53a-4830-8504-119f9b8ff83b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:06.806352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c528e0-a53a-4830-8504-119f9b8ff83b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:06.807517 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c528e0-a53a-4830-8504-119f9b8ff83b None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=d19a556265e745c3a127579e6b3fed9c, user.id=8497965f53ce4709b6b853568b47ea71) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:06.807517 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c528e0-a53a-4830-8504-119f9b8ff83b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:06.809590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c528e0-a53a-4830-8504-119f9b8ff83b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:06.817221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 47/94] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:06 2022] GET /identity/v3/role_assignments?user.id=8497965f53ce4709b6b853568b47ea71&scope.project.id=d19a556265e745c3a127579e6b3fed9c&role.id=70f81a43849a47f7bf393b354a46d048 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:06.818196 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c528e0-a53a-4830-8504-119f9b8ff83b None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:06.827027 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee313c70-ef6e-47c0-a6b4-8b7525e6d2ec None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:06.864394 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e02898-a355-449b-a6cc-524be35aaf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:06.865620 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e02898-a355-449b-a6cc-524be35aaf20 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:06.866120 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e02898-a355-449b-a6cc-524be35aaf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:06.866617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e02898-a355-449b-a6cc-524be35aaf20 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:06.868080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e02898-a355-449b-a6cc-524be35aaf20 None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:06.869739 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e02898-a355-449b-a6cc-524be35aaf20 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:06.872700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 48/95] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:06 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:06.878862 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e02898-a355-449b-a6cc-524be35aaf20 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:07.004907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e02898-a355-449b-a6cc-524be35aaf20 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:07.028677 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c528e0-a53a-4830-8504-119f9b8ff83b None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:07.042890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dd8a3-5107-4957-b4c2-83eb1eeb6fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:07.044456 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dd8a3-5107-4957-b4c2-83eb1eeb6fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:07.044951 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dd8a3-5107-4957-b4c2-83eb1eeb6fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:07.045419 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dd8a3-5107-4957-b4c2-83eb1eeb6fc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:07.046498 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340dd8a3-5107-4957-b4c2-83eb1eeb6fc5 None admin] RBAC: Adding query filter params (role.id=8b51e457da8145c6995241d379986c7c, scope.project.id=d19a556265e745c3a127579e6b3fed9c, user.id=d5392740d74041fc8ae879c1f5794f83) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:07.047014 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340dd8a3-5107-4957-b4c2-83eb1eeb6fc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:07.049326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340dd8a3-5107-4957-b4c2-83eb1eeb6fc5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:07.056312 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 49/96] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:06 2022] GET /identity/v3/role_assignments?user.id=d5392740d74041fc8ae879c1f5794f83&scope.project.id=d19a556265e745c3a127579e6b3fed9c&role.id=8b51e457da8145c6995241d379986c7c => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:07.089947 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010c791-4adc-4a73-a585-b839e6c0a9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:07.091056 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010c791-4adc-4a73-a585-b839e6c0a9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:07.091643 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010c791-4adc-4a73-a585-b839e6c0a9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:07.092127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010c791-4adc-4a73-a585-b839e6c0a9d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:07.093163 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010c791-4adc-4a73-a585-b839e6c0a9d6 None admin] RBAC: Adding query filter params (role.id=8f649e044d134d799d7bbaf6e0715e34, scope.project.id=7e653d5da8b34459a9bbe3530ffbda6a, user.id=d5392740d74041fc8ae879c1f5794f83) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:07.093665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010c791-4adc-4a73-a585-b839e6c0a9d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:07.095482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010c791-4adc-4a73-a585-b839e6c0a9d6 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:07.102946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 48/97] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:06 2022] GET /identity/v3/role_assignments?user.id=d5392740d74041fc8ae879c1f5794f83&scope.project.id=7e653d5da8b34459a9bbe3530ffbda6a&role.id=8f649e044d134d799d7bbaf6e0715e34 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:08.758830 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10329cf-4181-4b74-b8b0-f8ca6680b0f2 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:08.759868 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10329cf-4181-4b74-b8b0-f8ca6680b0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:08.760364 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10329cf-4181-4b74-b8b0-f8ca6680b0f2 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:08.761931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 50/98] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:08.767512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1031ec6-e93e-4eef-bd97-2198dcabfc5f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:08.768343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1031ec6-e93e-4eef-bd97-2198dcabfc5f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:08.768812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1031ec6-e93e-4eef-bd97-2198dcabfc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:08.789511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-e1031ec6-e93e-4eef-bd97-2198dcabfc5f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:08.791161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e1031ec6-e93e-4eef-bd97-2198dcabfc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:08.876683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 49/99] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:08.923920 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10329cf-4181-4b74-b8b0-f8ca6680b0f2 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:09.045869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10329cf-4181-4b74-b8b0-f8ca6680b0f2 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:09.088125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38087f36-174b-49ca-b7ad-82bdc3a5a12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:09.089314 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38087f36-174b-49ca-b7ad-82bdc3a5a12a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:09.089787 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38087f36-174b-49ca-b7ad-82bdc3a5a12a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:09.090820 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38087f36-174b-49ca-b7ad-82bdc3a5a12a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:09.107484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38087f36-174b-49ca-b7ad-82bdc3a5a12a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-38087f36-174b-49ca-b7ad-82bdc3a5a12a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:09.115440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:09.116285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:09.117028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:09.117028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:09.117028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:09.117028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:09.117028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:09.117028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:09.117028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:09.117028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:09.117028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:09.117028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:09.117028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:09.117028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:09.119364 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 51/100] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:09.126054 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1031ec6-e93e-4eef-bd97-2198dcabfc5f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:09.273460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1031ec6-e93e-4eef-bd97-2198dcabfc5f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:09.313732 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dece65a-7192-4243-bc77-7ce763b89e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:09.314859 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dece65a-7192-4243-bc77-7ce763b89e0f None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:09.315334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dece65a-7192-4243-bc77-7ce763b89e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:09.315829 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dece65a-7192-4243-bc77-7ce763b89e0f None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:09.316766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dece65a-7192-4243-bc77-7ce763b89e0f None admin] RBAC: Adding query filter params (name=member) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:09.317272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dece65a-7192-4243-bc77-7ce763b89e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:09.318858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dece65a-7192-4243-bc77-7ce763b89e0f None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:09.328331 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 50/101] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:09.334278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38087f36-174b-49ca-b7ad-82bdc3a5a12a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:09.440447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38087f36-174b-49ca-b7ad-82bdc3a5a12a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:09.477649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee228b-9146-484b-b296-c072b4a17c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:09.478995 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee228b-9146-484b-b296-c072b4a17c10 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:09.479470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee228b-9146-484b-b296-c072b4a17c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:09.479934 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee228b-9146-484b-b296-c072b4a17c10 None admin] PATH_INFO: `/v3/users/d5392740d74041fc8ae879c1f5794f83` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:09.486972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee228b-9146-484b-b296-c072b4a17c10 None admin] RBAC: Authorizing `identity:get_user(user_id=d5392740d74041fc8ae879c1f5794f83)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:09.488703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee228b-9146-484b-b296-c072b4a17c10 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:09.490629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 52/102] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:09 2022] GET /identity/v3/users/d5392740d74041fc8ae879c1f5794f83 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:09.496325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dece65a-7192-4243-bc77-7ce763b89e0f None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:09.606897 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dece65a-7192-4243-bc77-7ce763b89e0f None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:09.645676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c7f07-c92c-4fc9-a293-0430abd02114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:09.646618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c7f07-c92c-4fc9-a293-0430abd02114 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:09.646953 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c7f07-c92c-4fc9-a293-0430abd02114 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:09.647232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c7f07-c92c-4fc9-a293-0430abd02114 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:09.648432 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c7f07-c92c-4fc9-a293-0430abd02114 None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:09.649868 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c7f07-c92c-4fc9-a293-0430abd02114 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:09.651770 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 51/103] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:09 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:09.658604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee228b-9146-484b-b296-c072b4a17c10 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:09.768234 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee228b-9146-484b-b296-c072b4a17c10 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:09.805637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68026a05-2954-4119-beb1-3428fbe29f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:09.806562 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68026a05-2954-4119-beb1-3428fbe29f0b None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:09.806843 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68026a05-2954-4119-beb1-3428fbe29f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:09.807116 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68026a05-2954-4119-beb1-3428fbe29f0b None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c/users/d5392740d74041fc8ae879c1f5794f83/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:09.809755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68026a05-2954-4119-beb1-3428fbe29f0b None admin] RBAC: Authorizing `identity:create_grant(project_id=d19a556265e745c3a127579e6b3fed9c, user_id=d5392740d74041fc8ae879c1f5794f83, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:09.811221 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68026a05-2954-4119-beb1-3428fbe29f0b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:09.834649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 53/104] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:28:09 2022] PUT /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c/users/d5392740d74041fc8ae879c1f5794f83/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:10.113404 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477100b-8951-4095-9a8c-48731bdd5e30 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:10.113912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477100b-8951-4095-9a8c-48731bdd5e30 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:10.113984 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477100b-8951-4095-9a8c-48731bdd5e30 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:10.115350 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 52/105] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:10.120917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f5220-a49a-4eb5-b918-469d263de5ca None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:10.121216 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f5220-a49a-4eb5-b918-469d263de5ca None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:10.121562 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f5220-a49a-4eb5-b918-469d263de5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:10.143211 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-190f5220-a49a-4eb5-b918-469d263de5ca None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:10.144409 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-190f5220-a49a-4eb5-b918-469d263de5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:10.228251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 54/106] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:10.246480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dbfa5-f49e-4919-bf81-b299a9d3c004 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:10.247100 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dbfa5-f49e-4919-bf81-b299a9d3c004 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:10.247569 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dbfa5-f49e-4919-bf81-b299a9d3c004 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:10.249115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 53/107] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:10.255601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac7a7d-4bbc-4d75-93c9-e66152106235 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:10.255890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac7a7d-4bbc-4d75-93c9-e66152106235 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:10.256166 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac7a7d-4bbc-4d75-93c9-e66152106235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:10.265551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9caf08-cb9a-4f32-b219-a49821ad47f4 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:10.266125 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9caf08-cb9a-4f32-b219-a49821ad47f4 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:10.266625 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9caf08-cb9a-4f32-b219-a49821ad47f4 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:10.268207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 54/108] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:10.269110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9caf08-cb9a-4f32-b219-a49821ad47f4 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:10.275586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-46ac7a7d-4bbc-4d75-93c9-e66152106235 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:10.276760 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-46ac7a7d-4bbc-4d75-93c9-e66152106235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:10.392052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 55/109] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:10.393104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f88db1-0e2f-41ea-a9ff-e7ff9347f5d7 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:10.393395 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f88db1-0e2f-41ea-a9ff-e7ff9347f5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:10.393679 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f88db1-0e2f-41ea-a9ff-e7ff9347f5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:10.426383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-15f88db1-0e2f-41ea-a9ff-e7ff9347f5d7 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:10.427592 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-15f88db1-0e2f-41ea-a9ff-e7ff9347f5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:10.466643 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9caf08-cb9a-4f32-b219-a49821ad47f4 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:10.527148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999a900-b5d9-4e93-96dc-fe9057f3063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:10.528528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999a900-b5d9-4e93-96dc-fe9057f3063b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:10.528860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999a900-b5d9-4e93-96dc-fe9057f3063b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:10.529183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999a900-b5d9-4e93-96dc-fe9057f3063b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:10.537038 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 56/110] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:10.537997 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f88db1-0e2f-41ea-a9ff-e7ff9347f5d7 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:10.550426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999a900-b5d9-4e93-96dc-fe9057f3063b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-0999a900-b5d9-4e93-96dc-fe9057f3063b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:10.563522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:10.564446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:10.565197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:10.565197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:10.565197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:10.565197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:10.565197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:10.565197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:10.565197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:10.565197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:10.565197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:10.565197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:10.565197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:10.565197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:10.565197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 55/111] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:10.566328 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33250095-e584-4b59-8c20-068e0cfa33a6 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:10.566482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33250095-e584-4b59-8c20-068e0cfa33a6 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:10.569409 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33250095-e584-4b59-8c20-068e0cfa33a6 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:10.569409 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 56/112] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:10.569739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33250095-e584-4b59-8c20-068e0cfa33a6 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:10.655060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f88db1-0e2f-41ea-a9ff-e7ff9347f5d7 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:10.671843 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33250095-e584-4b59-8c20-068e0cfa33a6 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:10.689060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52661a-d045-40a3-bc7d-fe64b413a4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:10.689874 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52661a-d045-40a3-bc7d-fe64b413a4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:10.690158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52661a-d045-40a3-bc7d-fe64b413a4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:10.690462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52661a-d045-40a3-bc7d-fe64b413a4d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:10.700806 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52661a-d045-40a3-bc7d-fe64b413a4d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:10.704581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962b2af-3808-4292-9f51-2e14e510bec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:10.705358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962b2af-3808-4292-9f51-2e14e510bec8 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:10.705638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962b2af-3808-4292-9f51-2e14e510bec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:10.705910 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962b2af-3808-4292-9f51-2e14e510bec8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:10.707108 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962b2af-3808-4292-9f51-2e14e510bec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:10.708538 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962b2af-3808-4292-9f51-2e14e510bec8 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-0d52661a-d045-40a3-bc7d-fe64b413a4d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:10.708891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:10.709773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:10.716939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:10.716939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:10.716939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:10.716939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:10.716939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:10.716939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:10.716939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:10.716939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:10.716939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:10.716939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:10.716939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:10.716939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:10.716939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 57/113] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:28:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:10.717585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 57/114] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:28:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:10.717585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53e4d2-9eb5-46c0-9fdd-34e05918815f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:10.717585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53e4d2-9eb5-46c0-9fdd-34e05918815f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:10.717585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53e4d2-9eb5-46c0-9fdd-34e05918815f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:10.717816 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52661a-d045-40a3-bc7d-fe64b413a4d1 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:10.733255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-3a53e4d2-9eb5-46c0-9fdd-34e05918815f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:10.734459 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-3a53e4d2-9eb5-46c0-9fdd-34e05918815f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:10.801845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 58/115] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:10.815765 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e33f3-3640-4033-abf4-4564c79d556e None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:10.816070 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e33f3-3640-4033-abf4-4564c79d556e None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:10.816357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e33f3-3640-4033-abf4-4564c79d556e None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:10.816984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52661a-d045-40a3-bc7d-fe64b413a4d1 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:10.817791 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 59/116] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:10.818525 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e33f3-3640-4033-abf4-4564c79d556e None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:10.852863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031361a2-c8b9-40d8-9eb1-dff5bd2eaa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:10.853626 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031361a2-c8b9-40d8-9eb1-dff5bd2eaa67 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:10.854005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031361a2-c8b9-40d8-9eb1-dff5bd2eaa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:10.854392 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031361a2-c8b9-40d8-9eb1-dff5bd2eaa67 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:10.855145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031361a2-c8b9-40d8-9eb1-dff5bd2eaa67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:10.855454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031361a2-c8b9-40d8-9eb1-dff5bd2eaa67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:10.857497 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031361a2-c8b9-40d8-9eb1-dff5bd2eaa67 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:10.870258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 58/117] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:10.870258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031361a2-c8b9-40d8-9eb1-dff5bd2eaa67 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:10.926219 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e33f3-3640-4033-abf4-4564c79d556e None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:10.960356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6e167-6534-4b75-9025-ff64bad4b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:10.961027 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6e167-6534-4b75-9025-ff64bad4b99e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:10.961310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6e167-6534-4b75-9025-ff64bad4b99e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:10.961605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6e167-6534-4b75-9025-ff64bad4b99e None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:10.962367 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6e167-6534-4b75-9025-ff64bad4b99e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:10.962676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6e167-6534-4b75-9025-ff64bad4b99e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:10.964053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6e167-6534-4b75-9025-ff64bad4b99e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:10.971459 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031361a2-c8b9-40d8-9eb1-dff5bd2eaa67 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:10.977351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 60/118] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:28:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:10.977351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035f9a3-558e-40d0-9d00-00be7a5e1ad0 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:10.977351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035f9a3-558e-40d0-9d00-00be7a5e1ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:10.977351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035f9a3-558e-40d0-9d00-00be7a5e1ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:10.992066 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-c035f9a3-558e-40d0-9d00-00be7a5e1ad0 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:10.993238 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c035f9a3-558e-40d0-9d00-00be7a5e1ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:11.006886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5ecaa-ff68-43a2-9632-7edcdc50a11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:11.007555 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5ecaa-ff68-43a2-9632-7edcdc50a11f None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:11.007844 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5ecaa-ff68-43a2-9632-7edcdc50a11f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:11.008124 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5ecaa-ff68-43a2-9632-7edcdc50a11f None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:11.008848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5ecaa-ff68-43a2-9632-7edcdc50a11f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:11.010323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5ecaa-ff68-43a2-9632-7edcdc50a11f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:11.047495 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 59/119] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 5 15:28:10 2022] POST /identity/v3/projects => generated 302 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:28:11.047682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5ecaa-ff68-43a2-9632-7edcdc50a11f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:11.070292 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 61/120] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:11.071306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035f9a3-558e-40d0-9d00-00be7a5e1ad0 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:11.160222 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5ecaa-ff68-43a2-9632-7edcdc50a11f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:11.197640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc1d15-c213-4237-9ce1-a37fffeda630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:11.198890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc1d15-c213-4237-9ce1-a37fffeda630 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:11.199366 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc1d15-c213-4237-9ce1-a37fffeda630 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:11.199935 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc1d15-c213-4237-9ce1-a37fffeda630 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:11.200168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035f9a3-558e-40d0-9d00-00be7a5e1ad0 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:11.212181 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc1d15-c213-4237-9ce1-a37fffeda630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-5dfc1d15-c213-4237-9ce1-a37fffeda630 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:11.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:11.221944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:11.222711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:11.222711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:11.222711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:11.222711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:11.222711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:11.222711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:11.222711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:11.222711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:11.222711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:11.222711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:11.222711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:11.222711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:11.226423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 60/121] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:11.227523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc1d15-c213-4237-9ce1-a37fffeda630 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:11.237264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06273ddc-3886-452a-9b22-09b9dd63a247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:11.238143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06273ddc-3886-452a-9b22-09b9dd63a247 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:11.238457 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06273ddc-3886-452a-9b22-09b9dd63a247 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:11.238750 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06273ddc-3886-452a-9b22-09b9dd63a247 None admin] PATH_INFO: `/v3/users/3a6316ab02084e9db26ae944f430a0dd` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:11.254098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06273ddc-3886-452a-9b22-09b9dd63a247 None admin] RBAC: Authorizing `identity:get_user(user_id=3a6316ab02084e9db26ae944f430a0dd)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:11.255924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06273ddc-3886-452a-9b22-09b9dd63a247 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:11.257800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 62/122] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:11 2022] GET /identity/v3/users/3a6316ab02084e9db26ae944f430a0dd => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:11.258790 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06273ddc-3886-452a-9b22-09b9dd63a247 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:11.356851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc1d15-c213-4237-9ce1-a37fffeda630 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:11.373012 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06273ddc-3886-452a-9b22-09b9dd63a247 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:11.398876 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783669f-0811-49b5-be1d-adb6b9245733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:11.400088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783669f-0811-49b5-be1d-adb6b9245733 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:11.400380 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783669f-0811-49b5-be1d-adb6b9245733 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:11.400812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783669f-0811-49b5-be1d-adb6b9245733 None admin] PATH_INFO: `/v3/users/d5392740d74041fc8ae879c1f5794f83` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:11.402760 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783669f-0811-49b5-be1d-adb6b9245733 None admin] RBAC: Authorizing `identity:get_user(user_id=d5392740d74041fc8ae879c1f5794f83)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:11.404786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783669f-0811-49b5-be1d-adb6b9245733 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:11.406784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 61/123] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:11 2022] GET /identity/v3/users/d5392740d74041fc8ae879c1f5794f83 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:11.407653 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783669f-0811-49b5-be1d-adb6b9245733 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:11.418059 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9a6e6-48b9-4200-a187-db8af907a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:11.419703 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9a6e6-48b9-4200-a187-db8af907a1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:11.420220 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9a6e6-48b9-4200-a187-db8af907a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:11.420688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9a6e6-48b9-4200-a187-db8af907a1f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:11.432057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9a6e6-48b9-4200-a187-db8af907a1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-03f9a6e6-48b9-4200-a187-db8af907a1f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:11.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:11.440991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:11.441871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:11.441871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:11.441871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:11.441871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:11.441871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:11.441871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:11.441871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:11.441871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:11.441871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:11.441871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:11.441871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:11.441871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:11.444438 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 63/124] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:28:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:11.445532 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9a6e6-48b9-4200-a187-db8af907a1f5 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:11.520308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783669f-0811-49b5-be1d-adb6b9245733 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:11.549858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9a6e6-48b9-4200-a187-db8af907a1f5 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:11.554399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30771e-6d52-4e46-bd3a-cbe04731a186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:11.555074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30771e-6d52-4e46-bd3a-cbe04731a186 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:11.555358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30771e-6d52-4e46-bd3a-cbe04731a186 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:11.555634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30771e-6d52-4e46-bd3a-cbe04731a186 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:11.556380 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30771e-6d52-4e46-bd3a-cbe04731a186 None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:11.556685 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30771e-6d52-4e46-bd3a-cbe04731a186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:11.558061 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30771e-6d52-4e46-bd3a-cbe04731a186 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:11.571233 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 62/125] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:11.571233 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30771e-6d52-4e46-bd3a-cbe04731a186 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:11.592009 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d2a03-58aa-4247-a2c2-771336a37c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:11.592998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d2a03-58aa-4247-a2c2-771336a37c09 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:11.593481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d2a03-58aa-4247-a2c2-771336a37c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:11.593951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d2a03-58aa-4247-a2c2-771336a37c09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:11.664271 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d2a03-58aa-4247-a2c2-771336a37c09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:11.666071 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d2a03-58aa-4247-a2c2-771336a37c09 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:11.667023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30771e-6d52-4e46-bd3a-cbe04731a186 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:11.700665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1af161-4688-4e89-b015-77a4580b7760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:11.701974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1af161-4688-4e89-b015-77a4580b7760 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:11.701974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1af161-4688-4e89-b015-77a4580b7760 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:11.702185 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1af161-4688-4e89-b015-77a4580b7760 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:11.703267 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1af161-4688-4e89-b015-77a4580b7760 None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:11.704709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1af161-4688-4e89-b015-77a4580b7760 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:11.706432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 63/126] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:11 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:11.707541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1af161-4688-4e89-b015-77a4580b7760 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:11.771039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 64/127] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:11.772421 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d2a03-58aa-4247-a2c2-771336a37c09 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:11.817369 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1af161-4688-4e89-b015-77a4580b7760 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:11.851016 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8532533-7ee0-4031-89de-b9fc0432fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:11.851719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8532533-7ee0-4031-89de-b9fc0432fd4a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:11.852003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8532533-7ee0-4031-89de-b9fc0432fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:11.852279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8532533-7ee0-4031-89de-b9fc0432fd4a None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:11.853025 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8532533-7ee0-4031-89de-b9fc0432fd4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:11.853329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8532533-7ee0-4031-89de-b9fc0432fd4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:11.854759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8532533-7ee0-4031-89de-b9fc0432fd4a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:11.863766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 64/128] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:11.864686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8532533-7ee0-4031-89de-b9fc0432fd4a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:11.878706 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d2a03-58aa-4247-a2c2-771336a37c09 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:11.913672 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e076f89-8c5d-4224-8ab3-93745aa88b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:11.914941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e076f89-8c5d-4224-8ab3-93745aa88b93 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:11.915451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e076f89-8c5d-4224-8ab3-93745aa88b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:11.915930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e076f89-8c5d-4224-8ab3-93745aa88b93 None admin] PATH_INFO: `/v3/users/d5392740d74041fc8ae879c1f5794f83` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:11.917359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e076f89-8c5d-4224-8ab3-93745aa88b93 None admin] RBAC: Authorizing `identity:get_user(user_id=d5392740d74041fc8ae879c1f5794f83)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:11.919305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e076f89-8c5d-4224-8ab3-93745aa88b93 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:11.921253 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 65/129] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:11 2022] GET /identity/v3/users/d5392740d74041fc8ae879c1f5794f83 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:11.922378 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e076f89-8c5d-4224-8ab3-93745aa88b93 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:11.964005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8532533-7ee0-4031-89de-b9fc0432fd4a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:11.998485 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58395c-50cd-47a7-a267-b35c599711b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:11.999380 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58395c-50cd-47a7-a267-b35c599711b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:11.999658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58395c-50cd-47a7-a267-b35c599711b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:11.999929 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58395c-50cd-47a7-a267-b35c599711b2 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c/users/d5392740d74041fc8ae879c1f5794f83/roles/8b51e457da8145c6995241d379986c7c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:12.002593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58395c-50cd-47a7-a267-b35c599711b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d19a556265e745c3a127579e6b3fed9c, user_id=d5392740d74041fc8ae879c1f5794f83, role_id=8b51e457da8145c6995241d379986c7c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:12.004110 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58395c-50cd-47a7-a267-b35c599711b2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:12.022765 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 65/130] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:28:11 2022] PUT /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c/users/d5392740d74041fc8ae879c1f5794f83/roles/8b51e457da8145c6995241d379986c7c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:12.029037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58395c-50cd-47a7-a267-b35c599711b2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:12.031302 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e076f89-8c5d-4224-8ab3-93745aa88b93 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:12.069462 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab721ea-613d-458b-99f3-f62c03012906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:12.070793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab721ea-613d-458b-99f3-f62c03012906 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:12.071339 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab721ea-613d-458b-99f3-f62c03012906 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:12.071822 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab721ea-613d-458b-99f3-f62c03012906 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:12.073240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab721ea-613d-458b-99f3-f62c03012906 None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:12.075159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab721ea-613d-458b-99f3-f62c03012906 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:12.077879 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 66/131] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:11 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:12.079021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab721ea-613d-458b-99f3-f62c03012906 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:12.195909 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab721ea-613d-458b-99f3-f62c03012906 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:12.221795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58395c-50cd-47a7-a267-b35c599711b2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:12.275385 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafe774-a5ca-421b-a073-1aa96164db6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:12.278567 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafe774-a5ca-421b-a073-1aa96164db6d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:12.279538 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafe774-a5ca-421b-a073-1aa96164db6d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:12.280860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafe774-a5ca-421b-a073-1aa96164db6d None admin] PATH_INFO: `/v3/projects/7e653d5da8b34459a9bbe3530ffbda6a` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:12.283333 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafe774-a5ca-421b-a073-1aa96164db6d None admin] RBAC: Authorizing `identity:get_project(project_id=7e653d5da8b34459a9bbe3530ffbda6a)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:12.286536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafe774-a5ca-421b-a073-1aa96164db6d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:12.290592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 67/132] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:12 2022] GET /identity/v3/projects/7e653d5da8b34459a9bbe3530ffbda6a => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:12.293107 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafe774-a5ca-421b-a073-1aa96164db6d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:12.310886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3913d-90d5-4ff6-9342-e752bbec5ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:12.312312 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3913d-90d5-4ff6-9342-e752bbec5ece None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:12.312919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3913d-90d5-4ff6-9342-e752bbec5ece None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:12.313413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3913d-90d5-4ff6-9342-e752bbec5ece None admin] PATH_INFO: `/v3/users/8497965f53ce4709b6b853568b47ea71` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:12.315134 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3913d-90d5-4ff6-9342-e752bbec5ece None admin] RBAC: Authorizing `identity:get_user(user_id=8497965f53ce4709b6b853568b47ea71)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:12.317088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3913d-90d5-4ff6-9342-e752bbec5ece None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:12.322199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 66/133] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:12 2022] GET /identity/v3/users/8497965f53ce4709b6b853568b47ea71 => generated 247 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:12.326189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3913d-90d5-4ff6-9342-e752bbec5ece None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:12.430673 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafe774-a5ca-421b-a073-1aa96164db6d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:12.446667 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3913d-90d5-4ff6-9342-e752bbec5ece None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:12.477418 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148ce5a-f0cb-498e-9a8d-87532519d571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:12.478140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148ce5a-f0cb-498e-9a8d-87532519d571 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:12.478612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148ce5a-f0cb-498e-9a8d-87532519d571 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:12.478983 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148ce5a-f0cb-498e-9a8d-87532519d571 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:12.479863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148ce5a-f0cb-498e-9a8d-87532519d571 None admin] RBAC: Adding query filter params (role.id=a9790af349c74b43901af6f1113b6124, scope.project.id=d19a556265e745c3a127579e6b3fed9c, user.id=3a6316ab02084e9db26ae944f430a0dd) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:12.480202 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148ce5a-f0cb-498e-9a8d-87532519d571 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:12.482899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148ce5a-f0cb-498e-9a8d-87532519d571 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:12.489877 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 68/134] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:12 2022] GET /identity/v3/role_assignments?user.id=3a6316ab02084e9db26ae944f430a0dd&scope.project.id=d19a556265e745c3a127579e6b3fed9c&role.id=a9790af349c74b43901af6f1113b6124 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:12.490827 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18593043-4b6c-4a41-a466-57b4d800dcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:12.490973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148ce5a-f0cb-498e-9a8d-87532519d571 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:12.492254 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18593043-4b6c-4a41-a466-57b4d800dcbf None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:12.492786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18593043-4b6c-4a41-a466-57b4d800dcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:12.493480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18593043-4b6c-4a41-a466-57b4d800dcbf None admin] PATH_INFO: `/v3/projects/7e653d5da8b34459a9bbe3530ffbda6a/users/d5392740d74041fc8ae879c1f5794f83/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:12.497394 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18593043-4b6c-4a41-a466-57b4d800dcbf None admin] RBAC: Authorizing `identity:create_grant(project_id=7e653d5da8b34459a9bbe3530ffbda6a, user_id=d5392740d74041fc8ae879c1f5794f83, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:12.499324 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18593043-4b6c-4a41-a466-57b4d800dcbf None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:12.523524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 67/135] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:28:12 2022] PUT /identity/v3/projects/7e653d5da8b34459a9bbe3530ffbda6a/users/d5392740d74041fc8ae879c1f5794f83/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:12.525651 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4b146-2b5e-46a0-a914-3bf6a769cdf5 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:12.526104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4b146-2b5e-46a0-a914-3bf6a769cdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:12.526915 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4b146-2b5e-46a0-a914-3bf6a769cdf5 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:12.529507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 68/136] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:12.542036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0fd91-ba69-4382-a404-e65db2b1e972 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:12.542390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0fd91-ba69-4382-a404-e65db2b1e972 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:12.542651 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0fd91-ba69-4382-a404-e65db2b1e972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:12.586338 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-6fc0fd91-ba69-4382-a404-e65db2b1e972 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:12.588450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6fc0fd91-ba69-4382-a404-e65db2b1e972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:12.690258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148ce5a-f0cb-498e-9a8d-87532519d571 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:12.729899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8be388-b91f-4d64-951f-ed59ccce65b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:12.730885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8be388-b91f-4d64-951f-ed59ccce65b2 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:12.731166 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8be388-b91f-4d64-951f-ed59ccce65b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:12.731439 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8be388-b91f-4d64-951f-ed59ccce65b2 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:12.733055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8be388-b91f-4d64-951f-ed59ccce65b2 None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:12.734904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8be388-b91f-4d64-951f-ed59ccce65b2 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:12.737013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 69/137] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:12 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:12.743767 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8be388-b91f-4d64-951f-ed59ccce65b2 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:12.758890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 69/138] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:12.791636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0fd91-ba69-4382-a404-e65db2b1e972 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:12.887745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8be388-b91f-4d64-951f-ed59ccce65b2 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:12.930885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09cd8d-d14a-4ab9-b3d1-e794edb9d20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:12.931789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09cd8d-d14a-4ab9-b3d1-e794edb9d20c None admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:12.932084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09cd8d-d14a-4ab9-b3d1-e794edb9d20c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:12.932368 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09cd8d-d14a-4ab9-b3d1-e794edb9d20c None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c/users/8497965f53ce4709b6b853568b47ea71/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:12.939019 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09cd8d-d14a-4ab9-b3d1-e794edb9d20c None admin] RBAC: Authorizing `identity:create_grant(project_id=d19a556265e745c3a127579e6b3fed9c, user_id=8497965f53ce4709b6b853568b47ea71, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:12.940491 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09cd8d-d14a-4ab9-b3d1-e794edb9d20c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:12.942054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0fd91-ba69-4382-a404-e65db2b1e972 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:12.968766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 70/139] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:28:12 2022] PUT /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c/users/8497965f53ce4709b6b853568b47ea71/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:12.986317 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873ffa7-af3d-48b1-a75a-cc6584f35a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:12.987137 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873ffa7-af3d-48b1-a75a-cc6584f35a0d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:12.987420 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873ffa7-af3d-48b1-a75a-cc6584f35a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:12.987695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873ffa7-af3d-48b1-a75a-cc6584f35a0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:13.000438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873ffa7-af3d-48b1-a75a-cc6584f35a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9873ffa7-af3d-48b1-a75a-cc6584f35a0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:13.008413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:13.009362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:13.010805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:13.010805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:13.010805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:13.010805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:13.010805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:13.010805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:13.010805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:13.010805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:13.010805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:13.010805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:13.010805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:13.010805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:13.010805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 70/140] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:28:13.016901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09cd8d-d14a-4ab9-b3d1-e794edb9d20c None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:13.133505 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09cd8d-d14a-4ab9-b3d1-e794edb9d20c None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:13.174867 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9b0dd-a817-4c5a-b273-440623642322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:13.175606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9b0dd-a817-4c5a-b273-440623642322 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:13.175894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9b0dd-a817-4c5a-b273-440623642322 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:13.176178 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9b0dd-a817-4c5a-b273-440623642322 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:13.177012 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9b0dd-a817-4c5a-b273-440623642322 None admin] RBAC: Adding query filter params (name=member) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:13.177325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9b0dd-a817-4c5a-b273-440623642322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:13.178800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9b0dd-a817-4c5a-b273-440623642322 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:13.189241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 71/141] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:13.194791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873ffa7-af3d-48b1-a75a-cc6584f35a0d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:13.312548 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873ffa7-af3d-48b1-a75a-cc6584f35a0d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:13.353814 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e4678-6139-4069-815b-b5aa7cb64f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:13.354776 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e4678-6139-4069-815b-b5aa7cb64f1f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:13.355061 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e4678-6139-4069-815b-b5aa7cb64f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:13.355346 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e4678-6139-4069-815b-b5aa7cb64f1f None admin] PATH_INFO: `/v3/users/d5392740d74041fc8ae879c1f5794f83` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:13.356817 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e4678-6139-4069-815b-b5aa7cb64f1f None admin] RBAC: Authorizing `identity:get_user(user_id=d5392740d74041fc8ae879c1f5794f83)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:13.358360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e4678-6139-4069-815b-b5aa7cb64f1f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:13.360082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 71/142] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:13 2022] GET /identity/v3/users/d5392740d74041fc8ae879c1f5794f83 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:13.365663 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9b0dd-a817-4c5a-b273-440623642322 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:13.470209 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9b0dd-a817-4c5a-b273-440623642322 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:13.504543 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e596e3d-8f82-4b42-9f69-954f5d832d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:13.505200 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e596e3d-8f82-4b42-9f69-954f5d832d7f None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:13.505485 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e596e3d-8f82-4b42-9f69-954f5d832d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:13.505762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e596e3d-8f82-4b42-9f69-954f5d832d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:13.577226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e596e3d-8f82-4b42-9f69-954f5d832d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:13.578728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e596e3d-8f82-4b42-9f69-954f5d832d7f None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:13.678905 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 72/143] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:13.684601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e4678-6139-4069-815b-b5aa7cb64f1f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:13.790956 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e4678-6139-4069-815b-b5aa7cb64f1f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:13.824087 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e7379-99e3-4dc1-98ab-083628e15503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:13.825483 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e7379-99e3-4dc1-98ab-083628e15503 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:13.825767 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e7379-99e3-4dc1-98ab-083628e15503 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:13.826043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e7379-99e3-4dc1-98ab-083628e15503 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:13.827271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e7379-99e3-4dc1-98ab-083628e15503 None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:13.828719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e7379-99e3-4dc1-98ab-083628e15503 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:13.830438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 72/144] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:13 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:13.836403 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e596e3d-8f82-4b42-9f69-954f5d832d7f None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:13.943710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e596e3d-8f82-4b42-9f69-954f5d832d7f None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:13.978396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726c07b-79dd-4585-bcde-ce7fd23587c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:13.979057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726c07b-79dd-4585-bcde-ce7fd23587c9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:13.979342 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726c07b-79dd-4585-bcde-ce7fd23587c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:13.979617 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726c07b-79dd-4585-bcde-ce7fd23587c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:13.980443 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726c07b-79dd-4585-bcde-ce7fd23587c9 None admin] RBAC: Adding query filter params (role.id=8f649e044d134d799d7bbaf6e0715e34, scope.project.id=d19a556265e745c3a127579e6b3fed9c, user.id=d5392740d74041fc8ae879c1f5794f83) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:13.981282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726c07b-79dd-4585-bcde-ce7fd23587c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:13.982884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726c07b-79dd-4585-bcde-ce7fd23587c9 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:13.989231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 73/145] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:13 2022] GET /identity/v3/role_assignments?user.id=d5392740d74041fc8ae879c1f5794f83&scope.project.id=d19a556265e745c3a127579e6b3fed9c&role.id=8f649e044d134d799d7bbaf6e0715e34 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:14.116665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371638-4002-4b6c-9883-a9bc9b8121fd None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:14.117324 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371638-4002-4b6c-9883-a9bc9b8121fd None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:14.117324 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371638-4002-4b6c-9883-a9bc9b8121fd None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:14.118873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 73/146] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:14.125128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd66957-c805-4866-a849-02a8a525e7c1 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:14.125419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd66957-c805-4866-a849-02a8a525e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:14.125706 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd66957-c805-4866-a849-02a8a525e7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:14.142557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-3fd66957-c805-4866-a849-02a8a525e7c1 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:14.143770 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-3fd66957-c805-4866-a849-02a8a525e7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:14.217325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 74/147] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:14.257153 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0371638-4002-4b6c-9883-a9bc9b8121fd None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:14.366882 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0371638-4002-4b6c-9883-a9bc9b8121fd None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:14.401889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fba333-a183-4ddb-8eda-d5a5cca70fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:14.403234 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fba333-a183-4ddb-8eda-d5a5cca70fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:14.403521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fba333-a183-4ddb-8eda-d5a5cca70fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:14.403796 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fba333-a183-4ddb-8eda-d5a5cca70fe2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:14.404974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fba333-a183-4ddb-8eda-d5a5cca70fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:14.406461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fba333-a183-4ddb-8eda-d5a5cca70fe2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:14.408072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 74/148] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:28:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:14.413633 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd66957-c805-4866-a849-02a8a525e7c1 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:14.516580 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd66957-c805-4866-a849-02a8a525e7c1 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:14.550770 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e6b79-314c-4e5f-986e-14d7c858c039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:14.551461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e6b79-314c-4e5f-986e-14d7c858c039 None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:14.551747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e6b79-314c-4e5f-986e-14d7c858c039 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:14.552025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e6b79-314c-4e5f-986e-14d7c858c039 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:14.552748 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e6b79-314c-4e5f-986e-14d7c858c039 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:14.554216 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e6b79-314c-4e5f-986e-14d7c858c039 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:14.577477 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 75/149] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:28:14 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:28:15.271752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da14e3f-bc06-4dc9-ad1d-9e68d87c58bd None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:15.272286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da14e3f-bc06-4dc9-ad1d-9e68d87c58bd None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:15.272286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da14e3f-bc06-4dc9-ad1d-9e68d87c58bd None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:15.273687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 75/150] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:15.281739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4700c9-921a-4b4b-810c-3933739c0282 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:15.282036 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4700c9-921a-4b4b-810c-3933739c0282 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:15.282375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4700c9-921a-4b4b-810c-3933739c0282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:15.310768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-cc4700c9-921a-4b4b-810c-3933739c0282 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:15.312306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-cc4700c9-921a-4b4b-810c-3933739c0282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:15.412674 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 76/151] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:15.453652 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da14e3f-bc06-4dc9-ad1d-9e68d87c58bd None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:15.578858 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da14e3f-bc06-4dc9-ad1d-9e68d87c58bd None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:15.614485 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b463d7a-48cc-40c5-ab00-6b7cf9927035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:15.615658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b463d7a-48cc-40c5-ab00-6b7cf9927035 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:15.616139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b463d7a-48cc-40c5-ab00-6b7cf9927035 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:15.616615 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b463d7a-48cc-40c5-ab00-6b7cf9927035 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:15.628017 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b463d7a-48cc-40c5-ab00-6b7cf9927035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-6b463d7a-48cc-40c5-ab00-6b7cf9927035 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:15.636544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:15.637515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:15.638307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:15.638307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:15.638307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:15.638307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:15.638307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:15.638307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:15.638307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:15.638307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:15.638307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:15.638307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:15.638307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:15.638307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:15.640703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 76/152] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:28:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:15.646349 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4700c9-921a-4b4b-810c-3933739c0282 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:15.768291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4700c9-921a-4b4b-810c-3933739c0282 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:15.812031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cc9c6-1c9e-4a88-81f5-7c43dcc3dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:15.813137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cc9c6-1c9e-4a88-81f5-7c43dcc3dc44 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:15.813623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cc9c6-1c9e-4a88-81f5-7c43dcc3dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:15.814128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cc9c6-1c9e-4a88-81f5-7c43dcc3dc44 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:15.815132 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cc9c6-1c9e-4a88-81f5-7c43dcc3dc44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:15.815631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cc9c6-1c9e-4a88-81f5-7c43dcc3dc44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:15.817214 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cc9c6-1c9e-4a88-81f5-7c43dcc3dc44 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:15.830603 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 77/153] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:28:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:15.836074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b463d7a-48cc-40c5-ab00-6b7cf9927035 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:15.863255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6757-7ff6-41ff-bd83-e015f3ed7718 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:15.863876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6757-7ff6-41ff-bd83-e015f3ed7718 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:15.864359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6757-7ff6-41ff-bd83-e015f3ed7718 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:15.866284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 78/154] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:15.871869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e56f7d-5d09-42d1-8ee2-c5828460c2cf None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:15.872461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e56f7d-5d09-42d1-8ee2-c5828460c2cf None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:15.872949 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e56f7d-5d09-42d1-8ee2-c5828460c2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:15.898793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-89e56f7d-5d09-42d1-8ee2-c5828460c2cf None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:15.904709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-89e56f7d-5d09-42d1-8ee2-c5828460c2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:16.022628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b463d7a-48cc-40c5-ab00-6b7cf9927035 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:16.039334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 79/155] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:16.063770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c5159-1f6a-4fac-9b1c-e0749b861fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:16.065000 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c5159-1f6a-4fac-9b1c-e0749b861fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:16.065477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c5159-1f6a-4fac-9b1c-e0749b861fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:16.065964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c5159-1f6a-4fac-9b1c-e0749b861fc0 None admin] PATH_INFO: `/v3/users/d5392740d74041fc8ae879c1f5794f83` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:16.067473 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c5159-1f6a-4fac-9b1c-e0749b861fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=d5392740d74041fc8ae879c1f5794f83)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:16.069224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c5159-1f6a-4fac-9b1c-e0749b861fc0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:16.071169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 77/156] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:15 2022] GET /identity/v3/users/d5392740d74041fc8ae879c1f5794f83 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:16.077313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e56f7d-5d09-42d1-8ee2-c5828460c2cf None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:16.081714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c5159-1f6a-4fac-9b1c-e0749b861fc0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:16.251832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e56f7d-5d09-42d1-8ee2-c5828460c2cf None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:16.260280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c5159-1f6a-4fac-9b1c-e0749b861fc0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:16.298239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26ca9c-1857-4f0c-be9e-b1312fbb087a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:16.299266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26ca9c-1857-4f0c-be9e-b1312fbb087a None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:16.299740 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26ca9c-1857-4f0c-be9e-b1312fbb087a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:16.300200 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26ca9c-1857-4f0c-be9e-b1312fbb087a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:16.305151 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fb695-14f0-429e-af6c-4dabec5aadb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:16.305957 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fb695-14f0-429e-af6c-4dabec5aadb2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:16.306272 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fb695-14f0-429e-af6c-4dabec5aadb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:16.306560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fb695-14f0-429e-af6c-4dabec5aadb2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:16.328909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fb695-14f0-429e-af6c-4dabec5aadb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-678fb695-14f0-429e-af6c-4dabec5aadb2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:16.336692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:16.337533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:16.338311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:16.338311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:16.338311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:16.338311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:16.338311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:16.338311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:16.338311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:16.338311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:16.338311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:16.338311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:16.338311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:16.338311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:16.338311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 78/157] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:16.339402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0e7be-1134-4258-aa5d-5c2792cad803 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:16.339499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0e7be-1134-4258-aa5d-5c2792cad803 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:16.340397 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0e7be-1134-4258-aa5d-5c2792cad803 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:16.341860 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 79/158] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:16.345200 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0e7be-1134-4258-aa5d-5c2792cad803 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:16.382109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26ca9c-1857-4f0c-be9e-b1312fbb087a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:16.383961 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26ca9c-1857-4f0c-be9e-b1312fbb087a None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:16.453681 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0e7be-1134-4258-aa5d-5c2792cad803 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:16.487961 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21649a8-df26-4158-ab4c-89c16c253b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:16.488634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21649a8-df26-4158-ab4c-89c16c253b19 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:16.488929 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21649a8-df26-4158-ab4c-89c16c253b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:16.489245 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21649a8-df26-4158-ab4c-89c16c253b19 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:16.490040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21649a8-df26-4158-ab4c-89c16c253b19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:16.490444 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21649a8-df26-4158-ab4c-89c16c253b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:16.491907 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 80/159] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:28:16.492593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21649a8-df26-4158-ab4c-89c16c253b19 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:16.493660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55476c-7a33-4739-89c7-30614eb5a666 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:16.494143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55476c-7a33-4739-89c7-30614eb5a666 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:16.494680 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55476c-7a33-4739-89c7-30614eb5a666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:16.503304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 80/160] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:16.507434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29956df1-c1c1-460f-ada5-5ed3a1924528 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:16.507434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29956df1-c1c1-460f-ada5-5ed3a1924528 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:16.507434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29956df1-c1c1-460f-ada5-5ed3a1924528 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:16.508068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 81/161] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:16.510678 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29956df1-c1c1-460f-ada5-5ed3a1924528 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:16.523951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-bc55476c-7a33-4739-89c7-30614eb5a666 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:16.525377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bc55476c-7a33-4739-89c7-30614eb5a666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:16.593038 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 81/162] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:16.594394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55476c-7a33-4739-89c7-30614eb5a666 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:16.630934 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29956df1-c1c1-460f-ada5-5ed3a1924528 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:16.676003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ee011-63ce-42d1-9d3b-48f958bb0f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:16.676866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ee011-63ce-42d1-9d3b-48f958bb0f58 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:16.677142 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ee011-63ce-42d1-9d3b-48f958bb0f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:16.677414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ee011-63ce-42d1-9d3b-48f958bb0f58 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:16.678676 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ee011-63ce-42d1-9d3b-48f958bb0f58 None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:16.680179 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ee011-63ce-42d1-9d3b-48f958bb0f58 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:16.682133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 82/163] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:16 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:16.683232 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf58bbf-5e1c-437a-b255-ddbca56f4d30 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:16.683513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf58bbf-5e1c-437a-b255-ddbca56f4d30 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:16.683814 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf58bbf-5e1c-437a-b255-ddbca56f4d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:16.701052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55476c-7a33-4739-89c7-30614eb5a666 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:16.701553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-aaf58bbf-5e1c-437a-b255-ddbca56f4d30 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:16.702457 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-aaf58bbf-5e1c-437a-b255-ddbca56f4d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:16.736485 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a31cc5-cb05-48d8-99ee-8859c6a8abbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:16.737727 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31cc5-cb05-48d8-99ee-8859c6a8abbd None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:16.738253 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31cc5-cb05-48d8-99ee-8859c6a8abbd None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:16.738722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31cc5-cb05-48d8-99ee-8859c6a8abbd None admin] PATH_INFO: `/v3/users/3a6316ab02084e9db26ae944f430a0dd` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:16.740275 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a31cc5-cb05-48d8-99ee-8859c6a8abbd None admin] RBAC: Authorizing `identity:get_user(user_id=3a6316ab02084e9db26ae944f430a0dd)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:16.742022 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a31cc5-cb05-48d8-99ee-8859c6a8abbd None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:16.743978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 82/164] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:16 2022] GET /identity/v3/users/3a6316ab02084e9db26ae944f430a0dd => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:16.745041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a31cc5-cb05-48d8-99ee-8859c6a8abbd None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:16.771382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 83/165] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:16.772628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf58bbf-5e1c-437a-b255-ddbca56f4d30 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:16.870916 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a31cc5-cb05-48d8-99ee-8859c6a8abbd None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:16.885205 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf58bbf-5e1c-437a-b255-ddbca56f4d30 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:16.911339 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d0677-3090-4f04-b3ef-90a99feb86a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:16.912140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d0677-3090-4f04-b3ef-90a99feb86a5 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:16.912419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d0677-3090-4f04-b3ef-90a99feb86a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:16.912690 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d0677-3090-4f04-b3ef-90a99feb86a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:16.936557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d0677-3090-4f04-b3ef-90a99feb86a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-012d0677-3090-4f04-b3ef-90a99feb86a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:16.944235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:16.945126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:16.945902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:16.945902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:16.945902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:16.945902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:16.945902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:16.945902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:16.945902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:16.945902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:16.945902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:16.945902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:16.945902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:16.945902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:16.945902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 83/166] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:16.958078 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d0677-3090-4f04-b3ef-90a99feb86a5 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:16.960745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397fd4d-78e8-4378-aa51-bff9d8fbd9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:16.961399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397fd4d-78e8-4378-aa51-bff9d8fbd9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:16.961675 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397fd4d-78e8-4378-aa51-bff9d8fbd9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:16.961945 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397fd4d-78e8-4378-aa51-bff9d8fbd9f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:16.962802 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397fd4d-78e8-4378-aa51-bff9d8fbd9f3 None admin] RBAC: Adding query filter params (role.id=8b51e457da8145c6995241d379986c7c, scope.project.id=d19a556265e745c3a127579e6b3fed9c, user.id=d5392740d74041fc8ae879c1f5794f83) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:16.963108 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397fd4d-78e8-4378-aa51-bff9d8fbd9f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:16.964540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397fd4d-78e8-4378-aa51-bff9d8fbd9f3 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:16.981930 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 84/167] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:16 2022] GET /identity/v3/role_assignments?user.id=d5392740d74041fc8ae879c1f5794f83&scope.project.id=d19a556265e745c3a127579e6b3fed9c&role.id=8b51e457da8145c6995241d379986c7c => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:16.982790 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397fd4d-78e8-4378-aa51-bff9d8fbd9f3 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:17.097448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397fd4d-78e8-4378-aa51-bff9d8fbd9f3 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:17.142851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d24d1-684b-4721-85f5-bca16d17266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:17.144050 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d24d1-684b-4721-85f5-bca16d17266f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:17.144551 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d24d1-684b-4721-85f5-bca16d17266f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:17.145022 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d24d1-684b-4721-85f5-bca16d17266f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:17.167404 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d24d1-684b-4721-85f5-bca16d17266f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-5a4d24d1-684b-4721-85f5-bca16d17266f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:17.182622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:17.184227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:17.184991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:17.184991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:17.184991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:17.184991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:17.184991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:17.184991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:17.184991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:17.184991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:17.184991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:17.184991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:17.184991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:17.184991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:17.188145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 85/168] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:28:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:17.189552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d24d1-684b-4721-85f5-bca16d17266f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:17.230199 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d0677-3090-4f04-b3ef-90a99feb86a5 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:17.299945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739acdca-2874-427f-b99a-8c9bc1905a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:17.300828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739acdca-2874-427f-b99a-8c9bc1905a60 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:17.301255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739acdca-2874-427f-b99a-8c9bc1905a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:17.301506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739acdca-2874-427f-b99a-8c9bc1905a60 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:17.307018 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739acdca-2874-427f-b99a-8c9bc1905a60 None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:17.308507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739acdca-2874-427f-b99a-8c9bc1905a60 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:17.310921 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 84/169] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:16 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:17.311715 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739acdca-2874-427f-b99a-8c9bc1905a60 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:17.371026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d24d1-684b-4721-85f5-bca16d17266f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:17.429051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a78274-c93e-4713-974a-176918ee0bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:17.430055 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a78274-c93e-4713-974a-176918ee0bdb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:17.430564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a78274-c93e-4713-974a-176918ee0bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:17.431058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a78274-c93e-4713-974a-176918ee0bdb None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:17.432005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a78274-c93e-4713-974a-176918ee0bdb None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:17.432652 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a78274-c93e-4713-974a-176918ee0bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:17.435987 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a78274-c93e-4713-974a-176918ee0bdb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:17.451821 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 86/170] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:17.453068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a78274-c93e-4713-974a-176918ee0bdb None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:17.482930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739acdca-2874-427f-b99a-8c9bc1905a60 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:17.551805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c0e79-8f0c-4d16-a2f9-ad512bb777e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:17.552489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c0e79-8f0c-4d16-a2f9-ad512bb777e1 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:17.552778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c0e79-8f0c-4d16-a2f9-ad512bb777e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:17.553042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c0e79-8f0c-4d16-a2f9-ad512bb777e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:17.556935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c0e79-8f0c-4d16-a2f9-ad512bb777e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:17.557249 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c0e79-8f0c-4d16-a2f9-ad512bb777e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:17.559318 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c0e79-8f0c-4d16-a2f9-ad512bb777e1 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:17.577626 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 85/171] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:17.578531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c0e79-8f0c-4d16-a2f9-ad512bb777e1 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:17.651266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a78274-c93e-4713-974a-176918ee0bdb None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:17.715600 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377a4f9-4443-460d-8283-db409057331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:17.716410 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377a4f9-4443-460d-8283-db409057331e None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:17.716685 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377a4f9-4443-460d-8283-db409057331e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:17.716955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377a4f9-4443-460d-8283-db409057331e None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c/users/3a6316ab02084e9db26ae944f430a0dd/roles/a9790af349c74b43901af6f1113b6124` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:17.725575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377a4f9-4443-460d-8283-db409057331e None admin] RBAC: Authorizing `identity:create_grant(project_id=d19a556265e745c3a127579e6b3fed9c, user_id=3a6316ab02084e9db26ae944f430a0dd, role_id=a9790af349c74b43901af6f1113b6124)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:17.727063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377a4f9-4443-460d-8283-db409057331e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:17.754573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 87/172] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:28:17 2022] PUT /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c/users/3a6316ab02084e9db26ae944f430a0dd/roles/a9790af349c74b43901af6f1113b6124 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:17.755543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377a4f9-4443-460d-8283-db409057331e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:17.779619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c0e79-8f0c-4d16-a2f9-ad512bb777e1 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:17.835224 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca107e8-33c1-4b5e-90ce-112fc0904fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:17.836156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca107e8-33c1-4b5e-90ce-112fc0904fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:17.836439 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca107e8-33c1-4b5e-90ce-112fc0904fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:17.836708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca107e8-33c1-4b5e-90ce-112fc0904fd1 None admin] PATH_INFO: `/v3/users/d5392740d74041fc8ae879c1f5794f83` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:17.838046 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca107e8-33c1-4b5e-90ce-112fc0904fd1 None admin] RBAC: Authorizing `identity:get_user(user_id=d5392740d74041fc8ae879c1f5794f83)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:17.839564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca107e8-33c1-4b5e-90ce-112fc0904fd1 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:17.846824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 86/173] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:17 2022] GET /identity/v3/users/d5392740d74041fc8ae879c1f5794f83 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:17.853495 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca107e8-33c1-4b5e-90ce-112fc0904fd1 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:17.972254 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377a4f9-4443-460d-8283-db409057331e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:18.009844 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca107e8-33c1-4b5e-90ce-112fc0904fd1 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:18.045379 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d557b7f-0fe1-4a67-8c65-7eb74afdabaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:18.046036 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d557b7f-0fe1-4a67-8c65-7eb74afdabaf None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:18.046348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d557b7f-0fe1-4a67-8c65-7eb74afdabaf None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:18.046622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d557b7f-0fe1-4a67-8c65-7eb74afdabaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:18.052925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f777d-1d92-46d2-b16e-d477860f8f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:18.053818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f777d-1d92-46d2-b16e-d477860f8f27 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:18.054100 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f777d-1d92-46d2-b16e-d477860f8f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:18.054410 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f777d-1d92-46d2-b16e-d477860f8f27 None admin] PATH_INFO: `/v3/users/8497965f53ce4709b6b853568b47ea71` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:18.059481 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f777d-1d92-46d2-b16e-d477860f8f27 None admin] RBAC: Authorizing `identity:get_user(user_id=8497965f53ce4709b6b853568b47ea71)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:18.061069 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f777d-1d92-46d2-b16e-d477860f8f27 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:18.062877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 88/174] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:17 2022] GET /identity/v3/users/8497965f53ce4709b6b853568b47ea71 => generated 247 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:18.068434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f777d-1d92-46d2-b16e-d477860f8f27 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:18.119345 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d557b7f-0fe1-4a67-8c65-7eb74afdabaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:18.120834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d557b7f-0fe1-4a67-8c65-7eb74afdabaf None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:18.220652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 87/175] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:28:18.226686 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d557b7f-0fe1-4a67-8c65-7eb74afdabaf None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:18.243840 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f777d-1d92-46d2-b16e-d477860f8f27 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:18.281103 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de119b23-41c3-4acc-a449-3a73517accc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:18.281761 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de119b23-41c3-4acc-a449-3a73517accc5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:18.282040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de119b23-41c3-4acc-a449-3a73517accc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:18.282345 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de119b23-41c3-4acc-a449-3a73517accc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:18.326772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d557b7f-0fe1-4a67-8c65-7eb74afdabaf None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:18.404158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de119b23-41c3-4acc-a449-3a73517accc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:18.405788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de119b23-41c3-4acc-a449-3a73517accc5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:18.418430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd7bc3-7c4a-4925-9710-d066b785b6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:18.419352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd7bc3-7c4a-4925-9710-d066b785b6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:18.419640 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd7bc3-7c4a-4925-9710-d066b785b6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:18.419908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd7bc3-7c4a-4925-9710-d066b785b6c3 None admin] PATH_INFO: `/v3/projects/7e653d5da8b34459a9bbe3530ffbda6a` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:18.421099 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd7bc3-7c4a-4925-9710-d066b785b6c3 None admin] RBAC: Authorizing `identity:get_project(project_id=7e653d5da8b34459a9bbe3530ffbda6a)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:18.430660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd7bc3-7c4a-4925-9710-d066b785b6c3 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:18.432459 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 88/176] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:18 2022] GET /identity/v3/projects/7e653d5da8b34459a9bbe3530ffbda6a => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:18.433705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62902df-f54f-49ed-a3ce-200879f1980d None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:18.433987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62902df-f54f-49ed-a3ce-200879f1980d None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:18.434286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62902df-f54f-49ed-a3ce-200879f1980d None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:18.435511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 89/177] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:18.441104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62902df-f54f-49ed-a3ce-200879f1980d None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:18.516777 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 89/178] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:18.522325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc5cc1-8a70-4623-a402-2e7d1ec832fa None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:18.522325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc5cc1-8a70-4623-a402-2e7d1ec832fa None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:18.522325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc5cc1-8a70-4623-a402-2e7d1ec832fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:18.553245 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-fefc5cc1-8a70-4623-a402-2e7d1ec832fa None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:18.554456 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-fefc5cc1-8a70-4623-a402-2e7d1ec832fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:18.645740 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62902df-f54f-49ed-a3ce-200879f1980d None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:18.684957 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 90/179] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:18.685910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc5cc1-8a70-4623-a402-2e7d1ec832fa None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:18.687295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bdd5e-c083-4e6f-ab12-12e3cd2431e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:18.688366 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bdd5e-c083-4e6f-ab12-12e3cd2431e7 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:18.688848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bdd5e-c083-4e6f-ab12-12e3cd2431e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:18.689313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bdd5e-c083-4e6f-ab12-12e3cd2431e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:18.690443 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bdd5e-c083-4e6f-ab12-12e3cd2431e7 None admin] RBAC: Adding query filter params (role.id=8f649e044d134d799d7bbaf6e0715e34, scope.project.id=7e653d5da8b34459a9bbe3530ffbda6a, user.id=d5392740d74041fc8ae879c1f5794f83) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:18.690970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bdd5e-c083-4e6f-ab12-12e3cd2431e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:18.692755 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bdd5e-c083-4e6f-ab12-12e3cd2431e7 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:18.701181 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 90/180] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:18 2022] GET /identity/v3/role_assignments?user.id=d5392740d74041fc8ae879c1f5794f83&scope.project.id=7e653d5da8b34459a9bbe3530ffbda6a&role.id=8f649e044d134d799d7bbaf6e0715e34 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:18.723551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bdd5e-c083-4e6f-ab12-12e3cd2431e7 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:18.816128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc5cc1-8a70-4623-a402-2e7d1ec832fa None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:18.862888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdbc73-b16a-46bd-a5a0-aae18d881d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:18.863761 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdbc73-b16a-46bd-a5a0-aae18d881d64 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:18.864039 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdbc73-b16a-46bd-a5a0-aae18d881d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:18.864309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdbc73-b16a-46bd-a5a0-aae18d881d64 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:18.865540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdbc73-b16a-46bd-a5a0-aae18d881d64 None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:18.867000 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdbc73-b16a-46bd-a5a0-aae18d881d64 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:18.871593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 91/181] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:18 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:18.876284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdbc73-b16a-46bd-a5a0-aae18d881d64 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:18.916661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bdd5e-c083-4e6f-ab12-12e3cd2431e7 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:18.977347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492bd6f-58f7-43c2-bbc5-533e660a0566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:18.978702 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492bd6f-58f7-43c2-bbc5-533e660a0566 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:18.979188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492bd6f-58f7-43c2-bbc5-533e660a0566 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:18.979662 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492bd6f-58f7-43c2-bbc5-533e660a0566 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:19.001613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492bd6f-58f7-43c2-bbc5-533e660a0566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-d492bd6f-58f7-43c2-bbc5-533e660a0566 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:19.010812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:19.012414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:19.013398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:19.013398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:19.013398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:19.013398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:19.013398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:19.013398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:19.013398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:19.013398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:19.013398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:19.013398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:19.013398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:19.013398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:19.021149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 91/182] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:28:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:28:19.027571 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492bd6f-58f7-43c2-bbc5-533e660a0566 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:19.115851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdbc73-b16a-46bd-a5a0-aae18d881d64 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:19.157025 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1e064-cc82-4014-a302-a41c9fdfebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:19.157681 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1e064-cc82-4014-a302-a41c9fdfebf6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:19.158019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1e064-cc82-4014-a302-a41c9fdfebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:19.158332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1e064-cc82-4014-a302-a41c9fdfebf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:19.159351 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1e064-cc82-4014-a302-a41c9fdfebf6 None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=d19a556265e745c3a127579e6b3fed9c, user.id=8497965f53ce4709b6b853568b47ea71) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:19.159695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1e064-cc82-4014-a302-a41c9fdfebf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:19.161169 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492bd6f-58f7-43c2-bbc5-533e660a0566 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:19.168000 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1e064-cc82-4014-a302-a41c9fdfebf6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:19.175189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 92/183] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:18 2022] GET /identity/v3/role_assignments?user.id=8497965f53ce4709b6b853568b47ea71&scope.project.id=d19a556265e745c3a127579e6b3fed9c&role.id=70f81a43849a47f7bf393b354a46d048 => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:19.199811 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28715268-8168-4396-a47a-e35b5376da5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:19.201031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28715268-8168-4396-a47a-e35b5376da5b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:19.201492 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28715268-8168-4396-a47a-e35b5376da5b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:19.201938 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28715268-8168-4396-a47a-e35b5376da5b None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:19.202918 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28715268-8168-4396-a47a-e35b5376da5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:19.203434 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28715268-8168-4396-a47a-e35b5376da5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:19.205113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28715268-8168-4396-a47a-e35b5376da5b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:19.215532 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 92/184] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:19.221186 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1e064-cc82-4014-a302-a41c9fdfebf6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:19.309771 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4904b9-0c10-4307-a9b8-72c8722db9e9 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:19.310423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4904b9-0c10-4307-a9b8-72c8722db9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:19.310886 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4904b9-0c10-4307-a9b8-72c8722db9e9 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:19.312516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 93/185] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:19.321849 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26c129-4064-4bb7-8c4a-346c95539814 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:19.323493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26c129-4064-4bb7-8c4a-346c95539814 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:19.324006 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26c129-4064-4bb7-8c4a-346c95539814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:19.355608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-6e26c129-4064-4bb7-8c4a-346c95539814 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:19.357503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6e26c129-4064-4bb7-8c4a-346c95539814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:19.368889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1e064-cc82-4014-a302-a41c9fdfebf6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:19.406522 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6c36b-317b-404a-b853-9019612d15a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:19.408300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6c36b-317b-404a-b853-9019612d15a5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:19.408781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6c36b-317b-404a-b853-9019612d15a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:19.409471 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6c36b-317b-404a-b853-9019612d15a5 None admin] PATH_INFO: `/v3/users/cf89f0b35e2448deb2afef62a331cf75` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:19.432086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6c36b-317b-404a-b853-9019612d15a5 None admin] RBAC: Authorizing `identity:get_user(user_id=cf89f0b35e2448deb2afef62a331cf75)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:19.434062 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6c36b-317b-404a-b853-9019612d15a5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:19.437321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 93/186] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:19 2022] GET /identity/v3/users/cf89f0b35e2448deb2afef62a331cf75 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:19.442399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6c36b-317b-404a-b853-9019612d15a5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:19.451225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 94/187] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:19.477387 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26c129-4064-4bb7-8c4a-346c95539814 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:19.547999 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6c36b-317b-404a-b853-9019612d15a5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:19.589191 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b08d0-a1c9-414a-bbd4-7017b58f7a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:19.590431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b08d0-a1c9-414a-bbd4-7017b58f7a58 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:19.590738 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b08d0-a1c9-414a-bbd4-7017b58f7a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:19.591004 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b08d0-a1c9-414a-bbd4-7017b58f7a58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:19.600626 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26c129-4064-4bb7-8c4a-346c95539814 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:19.641500 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648d314-7e62-4d20-80f4-822b2f0b357d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:19.642341 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d314-7e62-4d20-80f4-822b2f0b357d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:19.642625 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d314-7e62-4d20-80f4-822b2f0b357d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:19.642899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d314-7e62-4d20-80f4-822b2f0b357d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:19.644045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648d314-7e62-4d20-80f4-822b2f0b357d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:19.645885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648d314-7e62-4d20-80f4-822b2f0b357d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:19.647808 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 95/188] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:28:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:19.648855 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e592d4-3ec3-43dd-8d0e-baaaabecc9f0 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:19.649135 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e592d4-3ec3-43dd-8d0e-baaaabecc9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:19.649408 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e592d4-3ec3-43dd-8d0e-baaaabecc9f0 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:19.650647 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 96/189] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:19.654645 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e592d4-3ec3-43dd-8d0e-baaaabecc9f0 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:19.675178 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b08d0-a1c9-414a-bbd4-7017b58f7a58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:19.676638 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b08d0-a1c9-414a-bbd4-7017b58f7a58 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:19.753185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e592d4-3ec3-43dd-8d0e-baaaabecc9f0 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:19.772314 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 94/190] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:19.773736 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb7160-8dc6-4eb8-91d7-8410b73953d6 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:19.774101 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb7160-8dc6-4eb8-91d7-8410b73953d6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:19.774493 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb7160-8dc6-4eb8-91d7-8410b73953d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:19.791393 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-89bb7160-8dc6-4eb8-91d7-8410b73953d6 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:19.792197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c5f84-2bbe-48b2-a0ef-3efb2ecd6016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:19.792575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-89bb7160-8dc6-4eb8-91d7-8410b73953d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:19.793329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c5f84-2bbe-48b2-a0ef-3efb2ecd6016 None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:19.793811 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c5f84-2bbe-48b2-a0ef-3efb2ecd6016 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:19.794305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c5f84-2bbe-48b2-a0ef-3efb2ecd6016 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:19.795037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c5f84-2bbe-48b2-a0ef-3efb2ecd6016 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:19.796471 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c5f84-2bbe-48b2-a0ef-3efb2ecd6016 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:19.820044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 97/191] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:28:19 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:28:19.831242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c5f84-2bbe-48b2-a0ef-3efb2ecd6016 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:19.879165 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 95/192] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:19.903938 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb7160-8dc6-4eb8-91d7-8410b73953d6 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:19.960662 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c5f84-2bbe-48b2-a0ef-3efb2ecd6016 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:20.008241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b49014-cfe3-4797-853d-7347d6b5dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:20.009308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b49014-cfe3-4797-853d-7347d6b5dd73 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:20.009588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b49014-cfe3-4797-853d-7347d6b5dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:20.010208 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b49014-cfe3-4797-853d-7347d6b5dd73 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:20.012284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b49014-cfe3-4797-853d-7347d6b5dd73 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:20.014471 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b49014-cfe3-4797-853d-7347d6b5dd73 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:20.016555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 98/193] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:19 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:20.017371 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb7160-8dc6-4eb8-91d7-8410b73953d6 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:20.024371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b49014-cfe3-4797-853d-7347d6b5dd73 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:20.061989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3be918-6ea8-4c7b-b9ce-ccb46e5d6983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:20.062832 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3be918-6ea8-4c7b-b9ce-ccb46e5d6983 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:20.063109 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3be918-6ea8-4c7b-b9ce-ccb46e5d6983 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:20.063390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3be918-6ea8-4c7b-b9ce-ccb46e5d6983 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:20.076880 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3be918-6ea8-4c7b-b9ce-ccb46e5d6983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-6c3be918-6ea8-4c7b-b9ce-ccb46e5d6983 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:20.084908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:20.085811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:20.086617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:20.086617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:20.086617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:20.086617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:20.086617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:20.086617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:20.086617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:20.086617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:20.086617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:20.086617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:20.086617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:20.086617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:20.091575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 96/194] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:28:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:20.092595 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3be918-6ea8-4c7b-b9ce-ccb46e5d6983 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:20.155436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b49014-cfe3-4797-853d-7347d6b5dd73 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:20.205722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667c013-9480-4a58-8b93-cf3ae701d65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:20.206708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667c013-9480-4a58-8b93-cf3ae701d65b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:20.207228 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667c013-9480-4a58-8b93-cf3ae701d65b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:20.207677 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667c013-9480-4a58-8b93-cf3ae701d65b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:20.208662 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667c013-9480-4a58-8b93-cf3ae701d65b None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1, user.id=cf89f0b35e2448deb2afef62a331cf75) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:20.209133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667c013-9480-4a58-8b93-cf3ae701d65b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:20.210879 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667c013-9480-4a58-8b93-cf3ae701d65b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:20.218809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 99/195] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:20 2022] GET /identity/v3/role_assignments?user.id=cf89f0b35e2448deb2afef62a331cf75&scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1&role.id=70f81a43849a47f7bf393b354a46d048 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:20.222678 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3be918-6ea8-4c7b-b9ce-ccb46e5d6983 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:20.263367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9d1df-c7b7-4e5a-a573-f4509e360abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:20.264321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9d1df-c7b7-4e5a-a573-f4509e360abf None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:20.264784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9d1df-c7b7-4e5a-a573-f4509e360abf None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:20.265205 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9d1df-c7b7-4e5a-a573-f4509e360abf None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:20.266269 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9d1df-c7b7-4e5a-a573-f4509e360abf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:20.266731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9d1df-c7b7-4e5a-a573-f4509e360abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:20.268298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9d1df-c7b7-4e5a-a573-f4509e360abf None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:20.278859 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 97/196] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:28:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:20.284711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667c013-9480-4a58-8b93-cf3ae701d65b None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:20.396572 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667c013-9480-4a58-8b93-cf3ae701d65b None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:20.432493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15b1f4-8d40-432e-ba7f-dc4bcabaca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:20.433292 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15b1f4-8d40-432e-ba7f-dc4bcabaca53 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:20.433600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15b1f4-8d40-432e-ba7f-dc4bcabaca53 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:20.433877 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15b1f4-8d40-432e-ba7f-dc4bcabaca53 None admin] PATH_INFO: `/v3/users/cf89f0b35e2448deb2afef62a331cf75` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:20.435379 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15b1f4-8d40-432e-ba7f-dc4bcabaca53 None admin] RBAC: Authorizing `identity:get_user(user_id=cf89f0b35e2448deb2afef62a331cf75)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:20.436902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15b1f4-8d40-432e-ba7f-dc4bcabaca53 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:20.438982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 100/197] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:20 2022] GET /identity/v3/users/cf89f0b35e2448deb2afef62a331cf75 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:20.444754 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9d1df-c7b7-4e5a-a573-f4509e360abf None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:20.550632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9d1df-c7b7-4e5a-a573-f4509e360abf None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:20.584046 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd225d-e64c-4407-9ddb-6dfeea9a3600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:20.584690 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd225d-e64c-4407-9ddb-6dfeea9a3600 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:20.584970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd225d-e64c-4407-9ddb-6dfeea9a3600 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:20.585246 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd225d-e64c-4407-9ddb-6dfeea9a3600 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:20.652401 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd225d-e64c-4407-9ddb-6dfeea9a3600 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:20.654407 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd225d-e64c-4407-9ddb-6dfeea9a3600 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:20.751483 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 98/198] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:20.756973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15b1f4-8d40-432e-ba7f-dc4bcabaca53 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:20.768759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94609ede-68c1-43a4-ae23-ab52a13de669 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:20.769065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94609ede-68c1-43a4-ae23-ab52a13de669 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:20.769314 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94609ede-68c1-43a4-ae23-ab52a13de669 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:20.775440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 99/199] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:20.776584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76067887-9d63-4dd2-8709-6b36b2c4b1eb None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:20.776864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76067887-9d63-4dd2-8709-6b36b2c4b1eb None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:20.777138 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76067887-9d63-4dd2-8709-6b36b2c4b1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:20.815785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-76067887-9d63-4dd2-8709-6b36b2c4b1eb None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:20.816966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-76067887-9d63-4dd2-8709-6b36b2c4b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:20.898190 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 100/200] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:20.923472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15b1f4-8d40-432e-ba7f-dc4bcabaca53 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:20.936488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76067887-9d63-4dd2-8709-6b36b2c4b1eb None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:20.974775 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aaa74d-34fe-4628-ab7c-9a70db784bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:20.975787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aaa74d-34fe-4628-ab7c-9a70db784bdf None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:20.976375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aaa74d-34fe-4628-ab7c-9a70db784bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:20.976655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aaa74d-34fe-4628-ab7c-9a70db784bdf None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:20.978025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aaa74d-34fe-4628-ab7c-9a70db784bdf None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:20.979504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aaa74d-34fe-4628-ab7c-9a70db784bdf None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:20.981661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 101/201] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:20 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:20.989741 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aaa74d-34fe-4628-ab7c-9a70db784bdf None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:21.100772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aaa74d-34fe-4628-ab7c-9a70db784bdf None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:21.132313 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76067887-9d63-4dd2-8709-6b36b2c4b1eb None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:21.143684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039ac91-891e-4ad9-a273-d55135e21d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:21.144343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039ac91-891e-4ad9-a273-d55135e21d2b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:21.144631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039ac91-891e-4ad9-a273-d55135e21d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:21.144897 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039ac91-891e-4ad9-a273-d55135e21d2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:21.145732 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039ac91-891e-4ad9-a273-d55135e21d2b None admin] RBAC: Adding query filter params (role.id=8b51e457da8145c6995241d379986c7c, scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1, user.id=cf89f0b35e2448deb2afef62a331cf75) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:21.146042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039ac91-891e-4ad9-a273-d55135e21d2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:21.147513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039ac91-891e-4ad9-a273-d55135e21d2b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:21.155057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 102/202] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:20 2022] GET /identity/v3/role_assignments?user.id=cf89f0b35e2448deb2afef62a331cf75&scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1&role.id=8b51e457da8145c6995241d379986c7c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:21.206689 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721f0d9-fb7d-4717-8e56-888dfd54180d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:21.207809 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721f0d9-fb7d-4717-8e56-888dfd54180d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:21.208235 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721f0d9-fb7d-4717-8e56-888dfd54180d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:21.208654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721f0d9-fb7d-4717-8e56-888dfd54180d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:21.227848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721f0d9-fb7d-4717-8e56-888dfd54180d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d721f0d9-fb7d-4717-8e56-888dfd54180d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:21.238706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:21.239851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:21.240822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:21.240822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:21.240822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:21.240822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:21.240822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:21.240822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:21.240822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:21.240822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:21.240822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:21.240822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:21.240822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:21.240822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:21.242987 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 101/203] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:28:21.249667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039ac91-891e-4ad9-a273-d55135e21d2b None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:21.393643 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039ac91-891e-4ad9-a273-d55135e21d2b None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:21.428052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f97cce-16db-4559-bf60-62dcdf233cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:21.428722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f97cce-16db-4559-bf60-62dcdf233cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:21.428997 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f97cce-16db-4559-bf60-62dcdf233cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:21.429268 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f97cce-16db-4559-bf60-62dcdf233cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:21.430013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f97cce-16db-4559-bf60-62dcdf233cc6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:21.430342 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f97cce-16db-4559-bf60-62dcdf233cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:21.431704 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f97cce-16db-4559-bf60-62dcdf233cc6 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:21.445008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 103/204] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:21.451326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721f0d9-fb7d-4717-8e56-888dfd54180d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:21.609824 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721f0d9-fb7d-4717-8e56-888dfd54180d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:21.655156 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff00a79-c72c-4488-b77d-b3ad131fa61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:21.655952 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff00a79-c72c-4488-b77d-b3ad131fa61b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:21.656229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff00a79-c72c-4488-b77d-b3ad131fa61b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:21.656503 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff00a79-c72c-4488-b77d-b3ad131fa61b None admin] PATH_INFO: `/v3/users/3a6316ab02084e9db26ae944f430a0dd` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:21.661539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff00a79-c72c-4488-b77d-b3ad131fa61b None admin] RBAC: Authorizing `identity:get_user(user_id=3a6316ab02084e9db26ae944f430a0dd)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:21.663030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff00a79-c72c-4488-b77d-b3ad131fa61b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:21.664692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 102/205] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:21 2022] GET /identity/v3/users/3a6316ab02084e9db26ae944f430a0dd => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:21.671606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f97cce-16db-4559-bf60-62dcdf233cc6 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:21.787191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f97cce-16db-4559-bf60-62dcdf233cc6 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:21.825824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115cb19-b42f-4bad-8ea3-7ca408604a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:21.826503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115cb19-b42f-4bad-8ea3-7ca408604a4f None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:21.826783 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115cb19-b42f-4bad-8ea3-7ca408604a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:21.827057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115cb19-b42f-4bad-8ea3-7ca408604a4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:21.911729 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115cb19-b42f-4bad-8ea3-7ca408604a4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:21.913115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115cb19-b42f-4bad-8ea3-7ca408604a4f None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:22.046511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 104/206] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:22.052155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff00a79-c72c-4488-b77d-b3ad131fa61b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:22.189849 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff00a79-c72c-4488-b77d-b3ad131fa61b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:22.236912 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4aed16-f9a9-4925-a80c-8968dd300bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:22.237779 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4aed16-f9a9-4925-a80c-8968dd300bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:22.238053 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4aed16-f9a9-4925-a80c-8968dd300bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:22.238354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4aed16-f9a9-4925-a80c-8968dd300bf6 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:22.239559 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4aed16-f9a9-4925-a80c-8968dd300bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:22.241120 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4aed16-f9a9-4925-a80c-8968dd300bf6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:22.243201 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 103/207] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:22 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:22.249345 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115cb19-b42f-4bad-8ea3-7ca408604a4f None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:22.390128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115cb19-b42f-4bad-8ea3-7ca408604a4f None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:22.438240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6373c4-0e20-4f60-929f-b907643da38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:22.438954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6373c4-0e20-4f60-929f-b907643da38b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:22.439238 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6373c4-0e20-4f60-929f-b907643da38b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:22.439509 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6373c4-0e20-4f60-929f-b907643da38b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:22.440387 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6373c4-0e20-4f60-929f-b907643da38b None admin] RBAC: Adding query filter params (role.id=a9790af349c74b43901af6f1113b6124, scope.project.id=d19a556265e745c3a127579e6b3fed9c, user.id=3a6316ab02084e9db26ae944f430a0dd) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:22.440638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6373c4-0e20-4f60-929f-b907643da38b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:22.442080 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6373c4-0e20-4f60-929f-b907643da38b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:22.451190 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 105/208] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:22 2022] GET /identity/v3/role_assignments?user.id=3a6316ab02084e9db26ae944f430a0dd&scope.project.id=d19a556265e745c3a127579e6b3fed9c&role.id=a9790af349c74b43901af6f1113b6124 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:22.967565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b07f5-1e88-4a4b-928b-fe6943276f1b None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:22.968070 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b07f5-1e88-4a4b-928b-fe6943276f1b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:22.968143 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b07f5-1e88-4a4b-928b-fe6943276f1b None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:22.969586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 104/209] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:22.975821 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6448180-ef4b-4124-8544-a46e01412600 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:22.976109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6448180-ef4b-4124-8544-a46e01412600 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:22.976386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6448180-ef4b-4124-8544-a46e01412600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:22.994970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-e6448180-ef4b-4124-8544-a46e01412600 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:22.996734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e6448180-ef4b-4124-8544-a46e01412600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:23.014400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d26884-7eff-4637-8740-7ca08bda8411 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:23.014694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d26884-7eff-4637-8740-7ca08bda8411 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:23.014946 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d26884-7eff-4637-8740-7ca08bda8411 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:23.016584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 105/210] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:23.021489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63805c8-8abf-4617-b734-1b6798f0c023 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:23.021770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63805c8-8abf-4617-b734-1b6798f0c023 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:23.022044 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63805c8-8abf-4617-b734-1b6798f0c023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:23.048111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b63805c8-8abf-4617-b734-1b6798f0c023 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:23.049295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b63805c8-8abf-4617-b734-1b6798f0c023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:23.074869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 106/211] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:23.076867 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468095a6-fb0f-4fed-a215-50817b54e6fe None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:23.077154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468095a6-fb0f-4fed-a215-50817b54e6fe None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:23.077425 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468095a6-fb0f-4fed-a215-50817b54e6fe None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:23.078953 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 107/212] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:23.088693 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fff434-2338-4229-b4a3-d585e9b8fe4f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:23.088972 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fff434-2338-4229-b4a3-d585e9b8fe4f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:23.089244 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fff434-2338-4229-b4a3-d585e9b8fe4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:23.107315 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-11fff434-2338-4229-b4a3-d585e9b8fe4f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:23.108483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-11fff434-2338-4229-b4a3-d585e9b8fe4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:23.123730 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 106/213] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:23.124573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63805c8-8abf-4617-b734-1b6798f0c023 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:23.177793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 108/214] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:23.178833 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fff434-2338-4229-b4a3-d585e9b8fe4f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:23.242361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63805c8-8abf-4617-b734-1b6798f0c023 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:23.278341 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fff434-2338-4229-b4a3-d585e9b8fe4f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:23.282636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dd355-13bd-4e56-be25-3e8a69d5a57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:23.283431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dd355-13bd-4e56-be25-3e8a69d5a57f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:23.283710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dd355-13bd-4e56-be25-3e8a69d5a57f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:23.283978 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dd355-13bd-4e56-be25-3e8a69d5a57f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:23.296833 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dd355-13bd-4e56-be25-3e8a69d5a57f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-753dd355-13bd-4e56-be25-3e8a69d5a57f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:23.307804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:23.315727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:23.316532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:23.316532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:23.316532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:23.316532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:23.316532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:23.316532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:23.316532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:23.316532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:23.316532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:23.316532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:23.316532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:23.316532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:23.316532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 107/215] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:23.316532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dd355-13bd-4e56-be25-3e8a69d5a57f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:23.317225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d27e89-2ab0-41cd-975a-5d32fb946d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:23.317225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d27e89-2ab0-41cd-975a-5d32fb946d93 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:23.317225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d27e89-2ab0-41cd-975a-5d32fb946d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:23.317225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d27e89-2ab0-41cd-975a-5d32fb946d93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:23.317474 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d27e89-2ab0-41cd-975a-5d32fb946d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:23.317474 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d27e89-2ab0-41cd-975a-5d32fb946d93 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:23.317474 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 109/216] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:28:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:23.318086 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d27e89-2ab0-41cd-975a-5d32fb946d93 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:23.417260 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dd355-13bd-4e56-be25-3e8a69d5a57f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:23.427920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d27e89-2ab0-41cd-975a-5d32fb946d93 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:23.453024 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f43849-5874-4092-92fa-a4933540414b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:23.453843 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f43849-5874-4092-92fa-a4933540414b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:23.454121 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f43849-5874-4092-92fa-a4933540414b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:23.454434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f43849-5874-4092-92fa-a4933540414b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:23.466450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f43849-5874-4092-92fa-a4933540414b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:23.470745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a4732-a48c-4152-9f9b-76c3cf7b9d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:23.471424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a4732-a48c-4152-9f9b-76c3cf7b9d1b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:23.471705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a4732-a48c-4152-9f9b-76c3cf7b9d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:23.471975 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a4732-a48c-4152-9f9b-76c3cf7b9d1b None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:23.472721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a4732-a48c-4152-9f9b-76c3cf7b9d1b None admin] RBAC: Adding query filter params (name=member) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:23.473026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a4732-a48c-4152-9f9b-76c3cf7b9d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-e7f43849-5874-4092-92fa-a4933540414b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:23.474421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:23.475241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:23.476009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:23.476009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:23.476009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:23.476009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:23.476009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:23.476009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:23.476009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:23.476009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:23.476009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:23.476009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:23.476009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:23.476009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:23.476578 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a4732-a48c-4152-9f9b-76c3cf7b9d1b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:23.476642 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 108/217] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:28:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:23.476642 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f43849-5874-4092-92fa-a4933540414b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:23.492917 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 110/218] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:23.492917 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a4732-a48c-4152-9f9b-76c3cf7b9d1b None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:23.591167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f43849-5874-4092-92fa-a4933540414b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:23.598155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a4732-a48c-4152-9f9b-76c3cf7b9d1b None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:23.626496 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ad9f6-3ea7-4a8d-80bd-495e5b9c681c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:23.627162 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ad9f6-3ea7-4a8d-80bd-495e5b9c681c None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:23.627438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ad9f6-3ea7-4a8d-80bd-495e5b9c681c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:23.627709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ad9f6-3ea7-4a8d-80bd-495e5b9c681c None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:23.628416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ad9f6-3ea7-4a8d-80bd-495e5b9c681c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:23.629884 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ad9f6-3ea7-4a8d-80bd-495e5b9c681c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:23.633315 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3db1d0-2389-42d7-91a7-7c3647bdfd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:23.633979 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3db1d0-2389-42d7-91a7-7c3647bdfd77 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:23.634290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3db1d0-2389-42d7-91a7-7c3647bdfd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:23.634569 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3db1d0-2389-42d7-91a7-7c3647bdfd77 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:23.635314 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3db1d0-2389-42d7-91a7-7c3647bdfd77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:23.635620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3db1d0-2389-42d7-91a7-7c3647bdfd77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:23.637799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3db1d0-2389-42d7-91a7-7c3647bdfd77 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:23.646633 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 111/219] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:23.647423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3db1d0-2389-42d7-91a7-7c3647bdfd77 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:23.664791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 109/220] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:28:23 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:28:23.664791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382a2c2-a1d1-43f3-ba7f-e891eb0c0c24 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:23.664791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382a2c2-a1d1-43f3-ba7f-e891eb0c0c24 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:23.664791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382a2c2-a1d1-43f3-ba7f-e891eb0c0c24 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:23.664791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 110/221] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:23.664791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382a2c2-a1d1-43f3-ba7f-e891eb0c0c24 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:23.759530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3db1d0-2389-42d7-91a7-7c3647bdfd77 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:23.773480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382a2c2-a1d1-43f3-ba7f-e891eb0c0c24 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:23.794703 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a223a5-7bb3-45ec-92c6-485cf5d5e4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:23.795605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a223a5-7bb3-45ec-92c6-485cf5d5e4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:23.795886 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a223a5-7bb3-45ec-92c6-485cf5d5e4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:23.796158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a223a5-7bb3-45ec-92c6-485cf5d5e4e4 None admin] PATH_INFO: `/v3/users/164b2b5d3e2c441286df7026d440d113` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:23.811488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fecebc-0b5d-4278-870f-51e2b792f55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:23.811722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a223a5-7bb3-45ec-92c6-485cf5d5e4e4 None admin] RBAC: Authorizing `identity:get_user(user_id=164b2b5d3e2c441286df7026d440d113)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:23.812371 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fecebc-0b5d-4278-870f-51e2b792f55a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:23.812647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fecebc-0b5d-4278-870f-51e2b792f55a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:23.812915 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fecebc-0b5d-4278-870f-51e2b792f55a None admin] PATH_INFO: `/v3/users/cf89f0b35e2448deb2afef62a331cf75` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:23.813103 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a223a5-7bb3-45ec-92c6-485cf5d5e4e4 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:23.814179 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fecebc-0b5d-4278-870f-51e2b792f55a None admin] RBAC: Authorizing `identity:get_user(user_id=cf89f0b35e2448deb2afef62a331cf75)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:23.815650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fecebc-0b5d-4278-870f-51e2b792f55a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:23.817407 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 111/222] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:23 2022] GET /identity/v3/users/cf89f0b35e2448deb2afef62a331cf75 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:23.818647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9b007-f746-445d-a9b5-e998ee128c37 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:23.818930 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9b007-f746-445d-a9b5-e998ee128c37 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:23.819425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9b007-f746-445d-a9b5-e998ee128c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:23.819738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 112/223] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:23 2022] GET /identity/v3/users/164b2b5d3e2c441286df7026d440d113 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:23.820657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a223a5-7bb3-45ec-92c6-485cf5d5e4e4 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:23.842641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-48c9b007-f746-445d-a9b5-e998ee128c37 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:23.843821 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-48c9b007-f746-445d-a9b5-e998ee128c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:23.920565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 112/224] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:23.920565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9b007-f746-445d-a9b5-e998ee128c37 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:23.934187 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a223a5-7bb3-45ec-92c6-485cf5d5e4e4 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:23.972705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e36827-efe3-401e-9f3e-2d838e94beeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:23.973376 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e36827-efe3-401e-9f3e-2d838e94beeb None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:23.973639 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e36827-efe3-401e-9f3e-2d838e94beeb None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:23.974236 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e36827-efe3-401e-9f3e-2d838e94beeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:24.031243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9b007-f746-445d-a9b5-e998ee128c37 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:24.051955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e36827-efe3-401e-9f3e-2d838e94beeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:24.053768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e36827-efe3-401e-9f3e-2d838e94beeb None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:24.074301 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6faf97-fe8a-4951-8cf1-7ad5e49c366a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:24.075168 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6faf97-fe8a-4951-8cf1-7ad5e49c366a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:24.075449 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6faf97-fe8a-4951-8cf1-7ad5e49c366a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:24.075721 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6faf97-fe8a-4951-8cf1-7ad5e49c366a None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:24.077522 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6faf97-fe8a-4951-8cf1-7ad5e49c366a None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:24.079273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6faf97-fe8a-4951-8cf1-7ad5e49c366a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:24.081583 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 113/225] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:23 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:24.082535 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6faf97-fe8a-4951-8cf1-7ad5e49c366a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:24.168782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 113/226] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:24.169494 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e36827-efe3-401e-9f3e-2d838e94beeb None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:24.192316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6faf97-fe8a-4951-8cf1-7ad5e49c366a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:24.227672 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b9294-79c8-445b-8192-869da624f05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:24.228857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b9294-79c8-445b-8192-869da624f05d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:24.229336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b9294-79c8-445b-8192-869da624f05d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:24.229802 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b9294-79c8-445b-8192-869da624f05d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:24.241007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b9294-79c8-445b-8192-869da624f05d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-371b9294-79c8-445b-8192-869da624f05d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:24.249788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:24.250706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:24.251490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:24.251490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:24.251490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:24.251490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:24.251490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:24.251490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:24.251490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:24.251490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:24.251490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:24.251490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:24.251490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:24.251490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:24.253939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 114/227] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:28:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:24.259594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b9294-79c8-445b-8192-869da624f05d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:24.270587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e36827-efe3-401e-9f3e-2d838e94beeb None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:24.304905 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1453d-98d2-4687-a33c-4d2011dccc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:24.306295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1453d-98d2-4687-a33c-4d2011dccc20 None admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:24.306588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1453d-98d2-4687-a33c-4d2011dccc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:24.306865 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1453d-98d2-4687-a33c-4d2011dccc20 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1/users/cf89f0b35e2448deb2afef62a331cf75/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:24.309127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1453d-98d2-4687-a33c-4d2011dccc20 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9d3917487e44e1a84cc0b98cfb33cb1, user_id=cf89f0b35e2448deb2afef62a331cf75, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:24.311417 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1453d-98d2-4687-a33c-4d2011dccc20 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:24.330378 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 114/228] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:28:24 2022] PUT /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1/users/cf89f0b35e2448deb2afef62a331cf75/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:24.331270 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1453d-98d2-4687-a33c-4d2011dccc20 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:24.372075 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b9294-79c8-445b-8192-869da624f05d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:24.408637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca4331-9a21-480c-adbc-58084bd35491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:24.410233 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca4331-9a21-480c-adbc-58084bd35491 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:24.410895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca4331-9a21-480c-adbc-58084bd35491 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:24.411431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca4331-9a21-480c-adbc-58084bd35491 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:24.413620 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca4331-9a21-480c-adbc-58084bd35491 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:24.415183 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca4331-9a21-480c-adbc-58084bd35491 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:24.417236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 115/229] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:24 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:24.427249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca4331-9a21-480c-adbc-58084bd35491 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:24.461927 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1453d-98d2-4687-a33c-4d2011dccc20 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:24.500820 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3419bf7-df21-40e3-ad1e-e6c7d18cc561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:24.501910 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3419bf7-df21-40e3-ad1e-e6c7d18cc561 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:24.502430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3419bf7-df21-40e3-ad1e-e6c7d18cc561 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:24.502908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3419bf7-df21-40e3-ad1e-e6c7d18cc561 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:24.503908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3419bf7-df21-40e3-ad1e-e6c7d18cc561 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:24.504421 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3419bf7-df21-40e3-ad1e-e6c7d18cc561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:24.506158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3419bf7-df21-40e3-ad1e-e6c7d18cc561 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:24.517284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 115/230] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:28:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:24.524045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3419bf7-df21-40e3-ad1e-e6c7d18cc561 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:24.619385 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca4331-9a21-480c-adbc-58084bd35491 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:24.632251 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3419bf7-df21-40e3-ad1e-e6c7d18cc561 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:24.656063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5880b-58be-4ba6-af56-41663005f42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:24.656723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5880b-58be-4ba6-af56-41663005f42b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:24.657003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5880b-58be-4ba6-af56-41663005f42b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:24.657276 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5880b-58be-4ba6-af56-41663005f42b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:24.658098 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5880b-58be-4ba6-af56-41663005f42b None admin] RBAC: Adding query filter params (role.id=8f649e044d134d799d7bbaf6e0715e34, scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1, user.id=164b2b5d3e2c441286df7026d440d113) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:24.658834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5880b-58be-4ba6-af56-41663005f42b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:24.660279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5880b-58be-4ba6-af56-41663005f42b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:24.666325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 116/231] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:24 2022] GET /identity/v3/role_assignments?user.id=164b2b5d3e2c441286df7026d440d113&scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1&role.id=8f649e044d134d799d7bbaf6e0715e34 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:24.669722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f97a7-e4b1-4761-bfd6-714e63bd3ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:24.674282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f97a7-e4b1-4761-bfd6-714e63bd3ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:24.674282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f97a7-e4b1-4761-bfd6-714e63bd3ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:24.674282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f97a7-e4b1-4761-bfd6-714e63bd3ba5 None admin] PATH_INFO: `/v3/users/cf89f0b35e2448deb2afef62a331cf75` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:24.675530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f97a7-e4b1-4761-bfd6-714e63bd3ba5 None admin] RBAC: Authorizing `identity:get_user(user_id=cf89f0b35e2448deb2afef62a331cf75)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:24.677247 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f97a7-e4b1-4761-bfd6-714e63bd3ba5 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:24.679705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 116/232] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:24 2022] GET /identity/v3/users/cf89f0b35e2448deb2afef62a331cf75 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:24.686052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5880b-58be-4ba6-af56-41663005f42b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:24.802430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5880b-58be-4ba6-af56-41663005f42b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:24.851917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eaf68-96c6-49fb-9a5a-5cd7bba90850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:24.852805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eaf68-96c6-49fb-9a5a-5cd7bba90850 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:24.853089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eaf68-96c6-49fb-9a5a-5cd7bba90850 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:24.853358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eaf68-96c6-49fb-9a5a-5cd7bba90850 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:24.854643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928eaf68-96c6-49fb-9a5a-5cd7bba90850 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:24.857136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928eaf68-96c6-49fb-9a5a-5cd7bba90850 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:24.859295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 117/233] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:24 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:24.866218 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f97a7-e4b1-4761-bfd6-714e63bd3ba5 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:25.014707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f97a7-e4b1-4761-bfd6-714e63bd3ba5 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:25.061293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c2485-eda0-495f-882a-0404a840aaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:25.062209 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c2485-eda0-495f-882a-0404a840aaa0 None admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:25.062499 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c2485-eda0-495f-882a-0404a840aaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:25.062776 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c2485-eda0-495f-882a-0404a840aaa0 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1/users/cf89f0b35e2448deb2afef62a331cf75/roles/8b51e457da8145c6995241d379986c7c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:25.068039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c2485-eda0-495f-882a-0404a840aaa0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9d3917487e44e1a84cc0b98cfb33cb1, user_id=cf89f0b35e2448deb2afef62a331cf75, role_id=8b51e457da8145c6995241d379986c7c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:25.069489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c2485-eda0-495f-882a-0404a840aaa0 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:25.094406 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 117/234] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:28:24 2022] PUT /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1/users/cf89f0b35e2448deb2afef62a331cf75/roles/8b51e457da8145c6995241d379986c7c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:26.665719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41226995-672c-4f88-a25b-cb21cd469edc None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:26.666248 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41226995-672c-4f88-a25b-cb21cd469edc None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:26.666326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41226995-672c-4f88-a25b-cb21cd469edc None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:26.668417 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 118/235] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:26.673976 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349037c7-eedb-4e0e-b887-bf95f39da524 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:26.674431 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349037c7-eedb-4e0e-b887-bf95f39da524 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:26.674608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349037c7-eedb-4e0e-b887-bf95f39da524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:26.694754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-349037c7-eedb-4e0e-b887-bf95f39da524 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:26.697009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3e1e8-ffb2-4e2d-a849-b9a8b1e6a23b None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:26.697293 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3e1e8-ffb2-4e2d-a849-b9a8b1e6a23b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:26.697570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3e1e8-ffb2-4e2d-a849-b9a8b1e6a23b None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:26.699730 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 119/236] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:26.699864 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-349037c7-eedb-4e0e-b887-bf95f39da524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:26.705337 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb7574-8d4f-4938-84c6-5a426d2c4dff None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:26.705633 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb7574-8d4f-4938-84c6-5a426d2c4dff None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:26.705884 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb7574-8d4f-4938-84c6-5a426d2c4dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:26.732539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-57bb7574-8d4f-4938-84c6-5a426d2c4dff None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:26.733712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-57bb7574-8d4f-4938-84c6-5a426d2c4dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:26.822239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 118/237] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:26.848282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 120/238] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:26.859701 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349037c7-eedb-4e0e-b887-bf95f39da524 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:26.884852 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb7574-8d4f-4938-84c6-5a426d2c4dff None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:26.965082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349037c7-eedb-4e0e-b887-bf95f39da524 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:26.997141 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791710f-fb87-4be2-a1fb-05a8c92aa46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:26.997653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791710f-fb87-4be2-a1fb-05a8c92aa46d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:26.997940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791710f-fb87-4be2-a1fb-05a8c92aa46d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:26.998239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791710f-fb87-4be2-a1fb-05a8c92aa46d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:27.013494 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791710f-fb87-4be2-a1fb-05a8c92aa46d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-6791710f-fb87-4be2-a1fb-05a8c92aa46d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:27.021573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:27.022573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:27.023374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:27.023374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:27.023374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:27.023374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:27.023374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:27.023374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:27.023374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:27.023374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:27.023374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:27.023374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:27.023374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:27.023374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:27.024467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 119/239] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:27.034764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791710f-fb87-4be2-a1fb-05a8c92aa46d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:27.091800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb7574-8d4f-4938-84c6-5a426d2c4dff None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:27.138657 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983877cf-e723-43ce-8ac4-7a85acf00885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:27.139465 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983877cf-e723-43ce-8ac4-7a85acf00885 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:27.139744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983877cf-e723-43ce-8ac4-7a85acf00885 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:27.140021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983877cf-e723-43ce-8ac4-7a85acf00885 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:27.141199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983877cf-e723-43ce-8ac4-7a85acf00885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:27.142693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983877cf-e723-43ce-8ac4-7a85acf00885 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:27.145085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 121/240] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:28:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:27.150097 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983877cf-e723-43ce-8ac4-7a85acf00885 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:27.215828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791710f-fb87-4be2-a1fb-05a8c92aa46d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:27.257663 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92eda2-0562-470f-9699-cd42f14206cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:27.258911 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92eda2-0562-470f-9699-cd42f14206cf None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:27.259195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92eda2-0562-470f-9699-cd42f14206cf None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:27.259472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92eda2-0562-470f-9699-cd42f14206cf None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:27.260222 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92eda2-0562-470f-9699-cd42f14206cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:27.260529 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92eda2-0562-470f-9699-cd42f14206cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:27.262705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92eda2-0562-470f-9699-cd42f14206cf None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:27.271440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 120/241] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:27.272635 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a8067-a19e-40a5-9c6d-571fd03ce744 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:27.272977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a8067-a19e-40a5-9c6d-571fd03ce744 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:27.273188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a8067-a19e-40a5-9c6d-571fd03ce744 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:27.278645 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 121/242] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:27.278645 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a8067-a19e-40a5-9c6d-571fd03ce744 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:27.302367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983877cf-e723-43ce-8ac4-7a85acf00885 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:27.336597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a718b72-5901-4c9c-9de4-1fa7df902ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:27.337267 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a718b72-5901-4c9c-9de4-1fa7df902ae9 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:27.337551 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a718b72-5901-4c9c-9de4-1fa7df902ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:27.337829 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a718b72-5901-4c9c-9de4-1fa7df902ae9 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:27.338569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a718b72-5901-4c9c-9de4-1fa7df902ae9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:27.340042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a718b72-5901-4c9c-9de4-1fa7df902ae9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:27.361789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 122/243] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:28:27 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:28:27.363434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba832b0-fa4f-44c9-b602-c3d1d1c812f1 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:27.363904 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba832b0-fa4f-44c9-b602-c3d1d1c812f1 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:27.364381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba832b0-fa4f-44c9-b602-c3d1d1c812f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:27.387861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-3ba832b0-fa4f-44c9-b602-c3d1d1c812f1 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:27.389614 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3ba832b0-fa4f-44c9-b602-c3d1d1c812f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:27.401952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a8067-a19e-40a5-9c6d-571fd03ce744 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:27.443551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac52e46-7092-41d9-9036-cf89c269020a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:27.444845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac52e46-7092-41d9-9036-cf89c269020a None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:27.445353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac52e46-7092-41d9-9036-cf89c269020a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:27.445809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac52e46-7092-41d9-9036-cf89c269020a None admin] PATH_INFO: `/v3/users/3a8a80d916504b2b8f032148ecb477ff` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:27.462734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac52e46-7092-41d9-9036-cf89c269020a None admin] RBAC: Authorizing `identity:get_user(user_id=3a8a80d916504b2b8f032148ecb477ff)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:27.464926 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac52e46-7092-41d9-9036-cf89c269020a None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:27.467334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 122/244] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:27 2022] GET /identity/v3/users/3a8a80d916504b2b8f032148ecb477ff => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:27.469024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869d110-3569-4c8c-a350-04afcc3bf2f7 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:27.469558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869d110-3569-4c8c-a350-04afcc3bf2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:27.469664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 123/245] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:27.470095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869d110-3569-4c8c-a350-04afcc3bf2f7 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:27.476262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 123/246] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:27.477138 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba832b0-fa4f-44c9-b602-c3d1d1c812f1 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:27.478057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bc48b-f4d6-4d21-9901-3f600cc1b54f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:27.478541 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bc48b-f4d6-4d21-9901-3f600cc1b54f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:27.479008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bc48b-f4d6-4d21-9901-3f600cc1b54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:27.515376 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-bf1bc48b-f4d6-4d21-9901-3f600cc1b54f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:27.516915 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bf1bc48b-f4d6-4d21-9901-3f600cc1b54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:27.584675 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba832b0-fa4f-44c9-b602-c3d1d1c812f1 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:27.593137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 124/247] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:27.594304 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bc48b-f4d6-4d21-9901-3f600cc1b54f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:27.635281 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9153b83-3493-4718-a0f9-1a6898aa2b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:27.636242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9153b83-3493-4718-a0f9-1a6898aa2b84 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:27.636585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9153b83-3493-4718-a0f9-1a6898aa2b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:27.636859 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9153b83-3493-4718-a0f9-1a6898aa2b84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:27.708480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bc48b-f4d6-4d21-9901-3f600cc1b54f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:27.712785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9153b83-3493-4718-a0f9-1a6898aa2b84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:27.715021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9153b83-3493-4718-a0f9-1a6898aa2b84 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:27.753133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542af558-05b9-4da8-8cae-252aab1ab43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:27.753945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542af558-05b9-4da8-8cae-252aab1ab43e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:27.754261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542af558-05b9-4da8-8cae-252aab1ab43e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:27.754547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542af558-05b9-4da8-8cae-252aab1ab43e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:27.767522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542af558-05b9-4da8-8cae-252aab1ab43e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-542af558-05b9-4da8-8cae-252aab1ab43e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:27.775620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:27.776524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:27.778004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:27.778004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:27.778004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:27.778004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:27.778004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:27.778004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:27.778004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:27.778004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:27.778004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:27.778004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:27.778004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:27.778004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:27.780091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 125/248] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:27.781035 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542af558-05b9-4da8-8cae-252aab1ab43e None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:27.840508 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 124/249] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:27.841173 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9153b83-3493-4718-a0f9-1a6898aa2b84 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:27.910835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542af558-05b9-4da8-8cae-252aab1ab43e None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:27.942765 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9153b83-3493-4718-a0f9-1a6898aa2b84 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:27.947609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f71fc3-4bf3-4289-bcaa-5b5af4351c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:27.948577 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f71fc3-4bf3-4289-bcaa-5b5af4351c3e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:27.949050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f71fc3-4bf3-4289-bcaa-5b5af4351c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:27.950041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f71fc3-4bf3-4289-bcaa-5b5af4351c3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:27.961019 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f71fc3-4bf3-4289-bcaa-5b5af4351c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-f4f71fc3-4bf3-4289-bcaa-5b5af4351c3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:27.972242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:27.973195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:27.973195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:27.973195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:27.973195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:27.973195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:27.973195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:27.973195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:27.973195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:27.973195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:27.973195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:27.973195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:27.973195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:27.975427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 126/250] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:28:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:27.976353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f71fc3-4bf3-4289-bcaa-5b5af4351c3e None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:27.983057 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b71ab-be51-43bc-9b33-9f811d886fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:27.983740 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b71ab-be51-43bc-9b33-9f811d886fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:27.984023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b71ab-be51-43bc-9b33-9f811d886fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:27.984300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b71ab-be51-43bc-9b33-9f811d886fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:27.985057 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b71ab-be51-43bc-9b33-9f811d886fe8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:27.985363 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b71ab-be51-43bc-9b33-9f811d886fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:27.986796 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b71ab-be51-43bc-9b33-9f811d886fe8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:27.995407 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 125/251] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:27.997119 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b71ab-be51-43bc-9b33-9f811d886fe8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:28.084290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f71fc3-4bf3-4289-bcaa-5b5af4351c3e None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:28.096634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b71ab-be51-43bc-9b33-9f811d886fe8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:28.120148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde374d-c4af-48ec-9346-1c8ff92c2716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:28.121879 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde374d-c4af-48ec-9346-1c8ff92c2716 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:28.122402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde374d-c4af-48ec-9346-1c8ff92c2716 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:28.122859 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde374d-c4af-48ec-9346-1c8ff92c2716 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:28.124257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde374d-c4af-48ec-9346-1c8ff92c2716 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:28.125892 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde374d-c4af-48ec-9346-1c8ff92c2716 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:28.127816 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 127/252] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:27 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:28.128570 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde374d-c4af-48ec-9346-1c8ff92c2716 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:28.130104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f74718-dbf0-424b-935c-00e9f8fa914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:28.131018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f74718-dbf0-424b-935c-00e9f8fa914e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:28.131474 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f74718-dbf0-424b-935c-00e9f8fa914e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:28.131921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f74718-dbf0-424b-935c-00e9f8fa914e None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:28.132837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f74718-dbf0-424b-935c-00e9f8fa914e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:28.133325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f74718-dbf0-424b-935c-00e9f8fa914e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:28.135147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f74718-dbf0-424b-935c-00e9f8fa914e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:28.144808 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 126/253] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:28.151063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b5d19-3f6c-4626-8f42-c083053c9660 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:28.151542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b5d19-3f6c-4626-8f42-c083053c9660 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:28.152136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b5d19-3f6c-4626-8f42-c083053c9660 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:28.153740 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 127/254] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:28.154656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b5d19-3f6c-4626-8f42-c083053c9660 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:28.238763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde374d-c4af-48ec-9346-1c8ff92c2716 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:28.257494 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b5d19-3f6c-4626-8f42-c083053c9660 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:28.273102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be93a0a-ac7b-4725-a304-f00b2149588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:28.273974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be93a0a-ac7b-4725-a304-f00b2149588b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:28.274352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be93a0a-ac7b-4725-a304-f00b2149588b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:28.274710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be93a0a-ac7b-4725-a304-f00b2149588b None admin] PATH_INFO: `/v3/users/164b2b5d3e2c441286df7026d440d113` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:28.275825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be93a0a-ac7b-4725-a304-f00b2149588b None admin] RBAC: Authorizing `identity:get_user(user_id=164b2b5d3e2c441286df7026d440d113)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:28.277925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be93a0a-ac7b-4725-a304-f00b2149588b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:28.279994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 128/255] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:28 2022] GET /identity/v3/users/164b2b5d3e2c441286df7026d440d113 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:28.280861 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be93a0a-ac7b-4725-a304-f00b2149588b None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:28.293934 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3697b45-9451-4a68-b2ce-23bcf0ec156d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:28.295152 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3697b45-9451-4a68-b2ce-23bcf0ec156d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:28.295633 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3697b45-9451-4a68-b2ce-23bcf0ec156d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:28.296080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3697b45-9451-4a68-b2ce-23bcf0ec156d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:28.297580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3697b45-9451-4a68-b2ce-23bcf0ec156d None admin] RBAC: Adding query filter params (role.id=a9790af349c74b43901af6f1113b6124, scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1, user.id=3a8a80d916504b2b8f032148ecb477ff) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:28.298235 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3697b45-9451-4a68-b2ce-23bcf0ec156d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:28.300120 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3697b45-9451-4a68-b2ce-23bcf0ec156d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:28.307974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 128/256] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:28 2022] GET /identity/v3/role_assignments?user.id=3a8a80d916504b2b8f032148ecb477ff&scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1&role.id=a9790af349c74b43901af6f1113b6124 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:28.309698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0aa3-b5b1-4223-82ec-23531f8218d6 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:28.310148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0aa3-b5b1-4223-82ec-23531f8218d6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:28.310605 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0aa3-b5b1-4223-82ec-23531f8218d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:28.329731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e5ba0aa3-b5b1-4223-82ec-23531f8218d6 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:28.331332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e5ba0aa3-b5b1-4223-82ec-23531f8218d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:28.409837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 129/257] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:28.411263 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0aa3-b5b1-4223-82ec-23531f8218d6 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:28.487054 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be93a0a-ac7b-4725-a304-f00b2149588b None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:28.541573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0aa3-b5b1-4223-82ec-23531f8218d6 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:28.554106 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fa114-b943-4c29-b39e-ce6e653cc17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:28.555121 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fa114-b943-4c29-b39e-ce6e653cc17c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:28.555405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fa114-b943-4c29-b39e-ce6e653cc17c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:28.555684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fa114-b943-4c29-b39e-ce6e653cc17c None admin] PATH_INFO: `/v3/users/cf89f0b35e2448deb2afef62a331cf75` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:28.563398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fa114-b943-4c29-b39e-ce6e653cc17c None admin] RBAC: Authorizing `identity:get_user(user_id=cf89f0b35e2448deb2afef62a331cf75)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:28.564632 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fa114-b943-4c29-b39e-ce6e653cc17c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:28.566524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 129/258] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:28 2022] GET /identity/v3/users/cf89f0b35e2448deb2afef62a331cf75 => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:28.567509 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fa114-b943-4c29-b39e-ce6e653cc17c None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:28.585246 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23120c4c-a46c-4991-9b2d-423e89483da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:28.586560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23120c4c-a46c-4991-9b2d-423e89483da2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:28.587041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23120c4c-a46c-4991-9b2d-423e89483da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:28.587506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23120c4c-a46c-4991-9b2d-423e89483da2 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:28.588933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23120c4c-a46c-4991-9b2d-423e89483da2 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:28.591785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23120c4c-a46c-4991-9b2d-423e89483da2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:28.594936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 130/259] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:28 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:28.596316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23120c4c-a46c-4991-9b2d-423e89483da2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:28.701616 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23120c4c-a46c-4991-9b2d-423e89483da2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:28.707464 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fa114-b943-4c29-b39e-ce6e653cc17c None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:28.743358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d933aa-2d02-48bc-bb28-148a3bce6f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:28.744705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d933aa-2d02-48bc-bb28-148a3bce6f54 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:28.745194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d933aa-2d02-48bc-bb28-148a3bce6f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:28.745787 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d933aa-2d02-48bc-bb28-148a3bce6f54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:28.782903 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beae51-3379-44b2-bfcd-87fe5f471a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:28.783686 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beae51-3379-44b2-bfcd-87fe5f471a88 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:28.783972 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beae51-3379-44b2-bfcd-87fe5f471a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:28.784242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beae51-3379-44b2-bfcd-87fe5f471a88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:28.818445 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d933aa-2d02-48bc-bb28-148a3bce6f54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:28.819074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0beae51-3379-44b2-bfcd-87fe5f471a88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:28.820475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d933aa-2d02-48bc-bb28-148a3bce6f54 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-c0beae51-3379-44b2-bfcd-87fe5f471a88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:28.836050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:28.836963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:28.837747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:28.837747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:28.837747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:28.837747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:28.837747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:28.837747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:28.837747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:28.837747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:28.837747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:28.837747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:28.837747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:28.837747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:28.837747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 130/260] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:28:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:28.838407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beae51-3379-44b2-bfcd-87fe5f471a88 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:28.946561 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 131/261] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:28.947494 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d933aa-2d02-48bc-bb28-148a3bce6f54 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:29.001262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beae51-3379-44b2-bfcd-87fe5f471a88 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:29.036413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a261f0f-305c-4a6f-87b1-3c732e7bfca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:29.037233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a261f0f-305c-4a6f-87b1-3c732e7bfca1 None admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:29.037516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a261f0f-305c-4a6f-87b1-3c732e7bfca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:29.037794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a261f0f-305c-4a6f-87b1-3c732e7bfca1 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1/users/164b2b5d3e2c441286df7026d440d113/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:29.039870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a261f0f-305c-4a6f-87b1-3c732e7bfca1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9d3917487e44e1a84cc0b98cfb33cb1, user_id=164b2b5d3e2c441286df7026d440d113, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:29.041343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a261f0f-305c-4a6f-87b1-3c732e7bfca1 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:29.071008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 131/262] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:28:28 2022] PUT /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1/users/164b2b5d3e2c441286df7026d440d113/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:29.071192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d933aa-2d02-48bc-bb28-148a3bce6f54 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:29.071677 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a261f0f-305c-4a6f-87b1-3c732e7bfca1 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:29.108344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaba7c-5977-40a2-a5f5-9df775a30b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:29.109021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaba7c-5977-40a2-a5f5-9df775a30b44 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:29.109297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaba7c-5977-40a2-a5f5-9df775a30b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:29.109569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaba7c-5977-40a2-a5f5-9df775a30b44 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:29.110350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaaba7c-5977-40a2-a5f5-9df775a30b44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:29.110644 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaaba7c-5977-40a2-a5f5-9df775a30b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:29.112028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaaba7c-5977-40a2-a5f5-9df775a30b44 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:29.125655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 132/263] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:28:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:29.126959 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaba7c-5977-40a2-a5f5-9df775a30b44 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:29.326428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaba7c-5977-40a2-a5f5-9df775a30b44 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:29.340978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a261f0f-305c-4a6f-87b1-3c732e7bfca1 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:29.388571 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26cb81-fd6a-4c49-bfb2-c4ca0afabff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:29.389450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26cb81-fd6a-4c49-bfb2-c4ca0afabff8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:29.389734 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26cb81-fd6a-4c49-bfb2-c4ca0afabff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:29.390003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26cb81-fd6a-4c49-bfb2-c4ca0afabff8 None admin] PATH_INFO: `/v3/users/cf89f0b35e2448deb2afef62a331cf75` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:29.391695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26cb81-fd6a-4c49-bfb2-c4ca0afabff8 None admin] RBAC: Authorizing `identity:get_user(user_id=cf89f0b35e2448deb2afef62a331cf75)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:29.393136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26cb81-fd6a-4c49-bfb2-c4ca0afabff8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:29.399900 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 133/264] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:29 2022] GET /identity/v3/users/cf89f0b35e2448deb2afef62a331cf75 => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:29.401670 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26cb81-fd6a-4c49-bfb2-c4ca0afabff8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:29.406950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4c03c-7d54-4b0f-99a8-765644349964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:29.407815 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4c03c-7d54-4b0f-99a8-765644349964 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:29.408091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4c03c-7d54-4b0f-99a8-765644349964 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:29.408358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4c03c-7d54-4b0f-99a8-765644349964 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:29.410205 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4c03c-7d54-4b0f-99a8-765644349964 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:29.411668 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4c03c-7d54-4b0f-99a8-765644349964 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:29.413356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 132/265] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:29 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:29.427284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4c03c-7d54-4b0f-99a8-765644349964 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:29.565766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4c03c-7d54-4b0f-99a8-765644349964 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:29.604771 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26cb81-fd6a-4c49-bfb2-c4ca0afabff8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:29.642278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4211308-4593-4bb8-ae2f-61615dda07e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:29.643045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4211308-4593-4bb8-ae2f-61615dda07e9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:29.643335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4211308-4593-4bb8-ae2f-61615dda07e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:29.643608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4211308-4593-4bb8-ae2f-61615dda07e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:29.644018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291d8f-0b8b-4465-95ee-cd8c25ac38a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:29.644457 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4211308-4593-4bb8-ae2f-61615dda07e9 None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1, user.id=cf89f0b35e2448deb2afef62a331cf75) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:29.644771 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4211308-4593-4bb8-ae2f-61615dda07e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:29.645115 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291d8f-0b8b-4465-95ee-cd8c25ac38a1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:29.645525 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291d8f-0b8b-4465-95ee-cd8c25ac38a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:29.645930 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291d8f-0b8b-4465-95ee-cd8c25ac38a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:29.646244 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4211308-4593-4bb8-ae2f-61615dda07e9 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:29.664365 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 133/266] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:29 2022] GET /identity/v3/role_assignments?user.id=cf89f0b35e2448deb2afef62a331cf75&scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1&role.id=70f81a43849a47f7bf393b354a46d048 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:29.727747 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6291d8f-0b8b-4465-95ee-cd8c25ac38a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:29.729513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6291d8f-0b8b-4465-95ee-cd8c25ac38a1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:29.837803 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 134/267] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:29.840529 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4211308-4593-4bb8-ae2f-61615dda07e9 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:29.947413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4211308-4593-4bb8-ae2f-61615dda07e9 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:29.984330 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415c94e-73d0-48d4-9128-7694a2f8d520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:29.985464 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415c94e-73d0-48d4-9128-7694a2f8d520 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:29.985894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415c94e-73d0-48d4-9128-7694a2f8d520 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:29.986333 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415c94e-73d0-48d4-9128-7694a2f8d520 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:29.987657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415c94e-73d0-48d4-9128-7694a2f8d520 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:29.989296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415c94e-73d0-48d4-9128-7694a2f8d520 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:29.996288 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 134/268] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:29 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:29.998447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291d8f-0b8b-4465-95ee-cd8c25ac38a1 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:30.151392 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291d8f-0b8b-4465-95ee-cd8c25ac38a1 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:30.192238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686577d-f417-47e2-a386-f63b86bcd848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:30.192905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686577d-f417-47e2-a386-f63b86bcd848 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:30.193190 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686577d-f417-47e2-a386-f63b86bcd848 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:30.193467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686577d-f417-47e2-a386-f63b86bcd848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:30.194329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686577d-f417-47e2-a386-f63b86bcd848 None admin] RBAC: Adding query filter params (role.id=8b51e457da8145c6995241d379986c7c, scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1, user.id=cf89f0b35e2448deb2afef62a331cf75) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:30.194642 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686577d-f417-47e2-a386-f63b86bcd848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:30.196092 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686577d-f417-47e2-a386-f63b86bcd848 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:30.203628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 135/269] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:29 2022] GET /identity/v3/role_assignments?user.id=cf89f0b35e2448deb2afef62a331cf75&scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1&role.id=8b51e457da8145c6995241d379986c7c => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:30.626300 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c28414-307d-4eeb-bb6b-eebfeedb1b23 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:30.626665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c28414-307d-4eeb-bb6b-eebfeedb1b23 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:30.626853 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c28414-307d-4eeb-bb6b-eebfeedb1b23 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:30.628470 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 135/270] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:30.633966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21934369-ea92-44bf-b052-eb5dc67f926f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:30.634271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21934369-ea92-44bf-b052-eb5dc67f926f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:30.634546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21934369-ea92-44bf-b052-eb5dc67f926f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:30.653873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-21934369-ea92-44bf-b052-eb5dc67f926f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:30.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-21934369-ea92-44bf-b052-eb5dc67f926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:30.721201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1cf4e-84a2-40b9-aa12-12ed7ccb1fc7 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:30.721201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1cf4e-84a2-40b9-aa12-12ed7ccb1fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:30.721201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1cf4e-84a2-40b9-aa12-12ed7ccb1fc7 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:30.722741 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 136/271] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:30.728571 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 136/272] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:30.731323 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22835fc2-218c-4af7-833d-bfa9402ace4c None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:30.731601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22835fc2-218c-4af7-833d-bfa9402ace4c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:30.731871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22835fc2-218c-4af7-833d-bfa9402ace4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:30.754580 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-22835fc2-218c-4af7-833d-bfa9402ace4c None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:30.755737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-22835fc2-218c-4af7-833d-bfa9402ace4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:30.765655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21934369-ea92-44bf-b052-eb5dc67f926f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:30.827591 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 137/273] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:30.852483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22835fc2-218c-4af7-833d-bfa9402ace4c None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:30.876220 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21934369-ea92-44bf-b052-eb5dc67f926f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:30.910352 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720651f0-e877-46fb-bfb2-66d16025d893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:30.911372 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720651f0-e877-46fb-bfb2-66d16025d893 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:30.911791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720651f0-e877-46fb-bfb2-66d16025d893 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:30.912230 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720651f0-e877-46fb-bfb2-66d16025d893 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:30.922657 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720651f0-e877-46fb-bfb2-66d16025d893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-720651f0-e877-46fb-bfb2-66d16025d893 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:30.930469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:30.931510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:30.932464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:30.932464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:30.932464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:30.932464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:30.932464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:30.932464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:30.932464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:30.932464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:30.932464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:30.932464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:30.932464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:30.932464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:30.934614 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 137/274] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:28:30.943575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720651f0-e877-46fb-bfb2-66d16025d893 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:30.957440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22835fc2-218c-4af7-833d-bfa9402ace4c None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:30.999774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6ea86-2f51-4590-abf5-0e1f00cdd740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:31.000967 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6ea86-2f51-4590-abf5-0e1f00cdd740 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:31.001391 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6ea86-2f51-4590-abf5-0e1f00cdd740 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:31.002100 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6ea86-2f51-4590-abf5-0e1f00cdd740 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:31.003430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6ea86-2f51-4590-abf5-0e1f00cdd740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:31.005476 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6ea86-2f51-4590-abf5-0e1f00cdd740 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:31.008305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 138/275] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:28:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:31.013547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6ea86-2f51-4590-abf5-0e1f00cdd740 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:31.060066 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720651f0-e877-46fb-bfb2-66d16025d893 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:31.095151 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0909301-f277-4140-85cd-b80790dad0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:31.096093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0909301-f277-4140-85cd-b80790dad0cc None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:31.096517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0909301-f277-4140-85cd-b80790dad0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:31.096987 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0909301-f277-4140-85cd-b80790dad0cc None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:31.097958 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0909301-f277-4140-85cd-b80790dad0cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:31.098465 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0909301-f277-4140-85cd-b80790dad0cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:31.100284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0909301-f277-4140-85cd-b80790dad0cc None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:31.109605 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 138/276] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:31.115066 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0909301-f277-4140-85cd-b80790dad0cc None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:31.125772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6ea86-2f51-4590-abf5-0e1f00cdd740 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:31.168640 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a62988-1077-410a-a9b3-995ed6a38616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:31.169765 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a62988-1077-410a-a9b3-995ed6a38616 None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:31.170159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a62988-1077-410a-a9b3-995ed6a38616 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:31.170518 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a62988-1077-410a-a9b3-995ed6a38616 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:31.171358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a62988-1077-410a-a9b3-995ed6a38616 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:31.173647 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a62988-1077-410a-a9b3-995ed6a38616 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:31.200348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 139/277] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:28:31 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:28:31.235373 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0909301-f277-4140-85cd-b80790dad0cc None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:31.236264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c40e5-3965-46dc-a161-c760479d6ec3 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:31.236720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c40e5-3965-46dc-a161-c760479d6ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:31.237136 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c40e5-3965-46dc-a161-c760479d6ec3 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:31.239030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 140/278] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:28:31.245048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f13e7a-5658-44da-a1f9-5e3c4b09cb8e None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:31.245828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f13e7a-5658-44da-a1f9-5e3c4b09cb8e None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:31.246464 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f13e7a-5658-44da-a1f9-5e3c4b09cb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:31.267178 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-69f13e7a-5658-44da-a1f9-5e3c4b09cb8e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:31.268390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-69f13e7a-5658-44da-a1f9-5e3c4b09cb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:31.285271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7663d-ed06-45b2-9865-0900b99a599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:31.286900 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7663d-ed06-45b2-9865-0900b99a599b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:31.287386 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7663d-ed06-45b2-9865-0900b99a599b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:31.288019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7663d-ed06-45b2-9865-0900b99a599b None admin] PATH_INFO: `/v3/users/7695ef1c8c4d48949c2adc974fd185a2` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:31.308001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7663d-ed06-45b2-9865-0900b99a599b None admin] RBAC: Authorizing `identity:get_user(user_id=7695ef1c8c4d48949c2adc974fd185a2)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:31.311348 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7663d-ed06-45b2-9865-0900b99a599b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:31.313129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 139/279] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:31 2022] GET /identity/v3/users/7695ef1c8c4d48949c2adc974fd185a2 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:31.319210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7663d-ed06-45b2-9865-0900b99a599b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:31.347060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 141/280] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:31.370142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f13e7a-5658-44da-a1f9-5e3c4b09cb8e None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:31.446378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7663d-ed06-45b2-9865-0900b99a599b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:31.484653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f13e7a-5658-44da-a1f9-5e3c4b09cb8e None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:31.487818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd4b84-6a97-4e60-a195-e2a8f4b244e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:31.488481 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd4b84-6a97-4e60-a195-e2a8f4b244e4 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:31.488761 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd4b84-6a97-4e60-a195-e2a8f4b244e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:31.489037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd4b84-6a97-4e60-a195-e2a8f4b244e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:31.489868 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd4b84-6a97-4e60-a195-e2a8f4b244e4 None admin] RBAC: Adding query filter params (role.id=8f649e044d134d799d7bbaf6e0715e34, user.id=7695ef1c8c4d48949c2adc974fd185a2, scope.system=all) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:31.490196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd4b84-6a97-4e60-a195-e2a8f4b244e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:31.491709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd4b84-6a97-4e60-a195-e2a8f4b244e4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:31.498487 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 140/281] 10.222.0.58 () {56 vars in 1308 bytes} [Thu May 5 15:28:31 2022] GET /identity/v3/role_assignments?user.id=7695ef1c8c4d48949c2adc974fd185a2&scope.system=all&role.id=8f649e044d134d799d7bbaf6e0715e34 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:31.531825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc97e2-129b-4e57-b091-a2faee4e239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:31.532675 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc97e2-129b-4e57-b091-a2faee4e239a None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:31.532960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc97e2-129b-4e57-b091-a2faee4e239a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:31.533236 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc97e2-129b-4e57-b091-a2faee4e239a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:31.547586 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc97e2-129b-4e57-b091-a2faee4e239a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-1ffc97e2-129b-4e57-b091-a2faee4e239a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:31.555619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:31.556564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:31.557344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:31.557344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:31.557344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:31.557344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:31.557344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:31.557344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:31.557344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:31.557344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:31.557344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:31.557344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:31.557344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:31.557344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:31.557344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 142/282] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:28:31.566342 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd4b84-6a97-4e60-a195-e2a8f4b244e4 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:31.689225 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd4b84-6a97-4e60-a195-e2a8f4b244e4 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:31.730444 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ed7af-6655-4dd4-90ea-dd63eb9ff7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:31.731374 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ed7af-6655-4dd4-90ea-dd63eb9ff7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:31.731660 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ed7af-6655-4dd4-90ea-dd63eb9ff7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:31.731942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ed7af-6655-4dd4-90ea-dd63eb9ff7c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:31.732725 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ed7af-6655-4dd4-90ea-dd63eb9ff7c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:31.733037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ed7af-6655-4dd4-90ea-dd63eb9ff7c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:31.734515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ed7af-6655-4dd4-90ea-dd63eb9ff7c6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:31.744346 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 141/283] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:31.750487 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc97e2-129b-4e57-b091-a2faee4e239a None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:31.855993 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc97e2-129b-4e57-b091-a2faee4e239a None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:31.891974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d500960-9476-4634-84bf-0729e1124dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:31.892853 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d500960-9476-4634-84bf-0729e1124dfb None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:31.893140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d500960-9476-4634-84bf-0729e1124dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:31.893587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d500960-9476-4634-84bf-0729e1124dfb None admin] PATH_INFO: `/v3/users/3a8a80d916504b2b8f032148ecb477ff` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:31.894829 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d500960-9476-4634-84bf-0729e1124dfb None admin] RBAC: Authorizing `identity:get_user(user_id=3a8a80d916504b2b8f032148ecb477ff)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:31.896281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d500960-9476-4634-84bf-0729e1124dfb None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:31.898224 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 143/284] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:31 2022] GET /identity/v3/users/3a8a80d916504b2b8f032148ecb477ff => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:31.904371 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ed7af-6655-4dd4-90ea-dd63eb9ff7c6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:31.922037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8ea94-abf9-4f30-ab53-6ec49b56cefb None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:31.922369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8ea94-abf9-4f30-ab53-6ec49b56cefb None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:31.922621 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8ea94-abf9-4f30-ab53-6ec49b56cefb None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:31.924246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 144/285] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:31.929195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db259120-6b62-4e3a-a688-92d5e483510c None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:31.929501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db259120-6b62-4e3a-a688-92d5e483510c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:31.929745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db259120-6b62-4e3a-a688-92d5e483510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:31.946605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-db259120-6b62-4e3a-a688-92d5e483510c None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:31.947761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-db259120-6b62-4e3a-a688-92d5e483510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:32.016650 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 145/286] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:32.024566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ed7af-6655-4dd4-90ea-dd63eb9ff7c6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:32.048993 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db259120-6b62-4e3a-a688-92d5e483510c None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:32.059162 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257185c5-f6cc-4d9e-8716-a7221c75d830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:32.060028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257185c5-f6cc-4d9e-8716-a7221c75d830 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:32.060305 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257185c5-f6cc-4d9e-8716-a7221c75d830 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:32.060577 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257185c5-f6cc-4d9e-8716-a7221c75d830 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:32.061773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257185c5-f6cc-4d9e-8716-a7221c75d830 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:32.063244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257185c5-f6cc-4d9e-8716-a7221c75d830 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:32.065095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 142/287] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:31 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:32.076178 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257185c5-f6cc-4d9e-8716-a7221c75d830 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:32.243899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db259120-6b62-4e3a-a688-92d5e483510c None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:32.261989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257185c5-f6cc-4d9e-8716-a7221c75d830 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:32.310746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885caaf-3cb3-481a-a9b5-9d7dd66a5b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:32.311542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885caaf-3cb3-481a-a9b5-9d7dd66a5b21 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:32.311818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885caaf-3cb3-481a-a9b5-9d7dd66a5b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:32.312091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885caaf-3cb3-481a-a9b5-9d7dd66a5b21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:32.329818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885caaf-3cb3-481a-a9b5-9d7dd66a5b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-e885caaf-3cb3-481a-a9b5-9d7dd66a5b21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:32.337384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:32.339837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:32.341737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:32.341737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:32.341737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:32.341737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:32.341737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:32.341737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:32.341737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:32.341737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:32.341737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:32.341737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:32.341737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:32.341737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:32.343229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b1b44-6516-4b0e-b7de-2048e6418679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:32.343229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b1b44-6516-4b0e-b7de-2048e6418679 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:32.343229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b1b44-6516-4b0e-b7de-2048e6418679 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:32.343229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b1b44-6516-4b0e-b7de-2048e6418679 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1/users/3a8a80d916504b2b8f032148ecb477ff/roles/a9790af349c74b43901af6f1113b6124` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:32.343785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b1b44-6516-4b0e-b7de-2048e6418679 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9d3917487e44e1a84cc0b98cfb33cb1, user_id=3a8a80d916504b2b8f032148ecb477ff, role_id=a9790af349c74b43901af6f1113b6124)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:32.350254 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b1b44-6516-4b0e-b7de-2048e6418679 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:32.350457 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 146/288] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:28:32.354942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885caaf-3cb3-481a-a9b5-9d7dd66a5b21 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:32.373290 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 143/289] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:28:32 2022] PUT /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1/users/3a8a80d916504b2b8f032148ecb477ff/roles/a9790af349c74b43901af6f1113b6124 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:32.476312 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885caaf-3cb3-481a-a9b5-9d7dd66a5b21 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:32.525599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88500a07-16a0-4b0b-9ff0-cf8c11fc4f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:32.526310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88500a07-16a0-4b0b-9ff0-cf8c11fc4f42 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:32.526595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88500a07-16a0-4b0b-9ff0-cf8c11fc4f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:32.526928 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88500a07-16a0-4b0b-9ff0-cf8c11fc4f42 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:32.528441 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88500a07-16a0-4b0b-9ff0-cf8c11fc4f42 None admin] RBAC: Adding query filter params (name=member) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:32.528763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88500a07-16a0-4b0b-9ff0-cf8c11fc4f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:32.530201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88500a07-16a0-4b0b-9ff0-cf8c11fc4f42 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:32.546589 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 147/290] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:32.547309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b1b44-6516-4b0e-b7de-2048e6418679 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:32.670986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b1b44-6516-4b0e-b7de-2048e6418679 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:32.704819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa81e7-2d33-49c0-85c5-461d10727d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:32.705699 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa81e7-2d33-49c0-85c5-461d10727d65 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:32.705976 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa81e7-2d33-49c0-85c5-461d10727d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:32.706268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa81e7-2d33-49c0-85c5-461d10727d65 None admin] PATH_INFO: `/v3/users/164b2b5d3e2c441286df7026d440d113` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:32.707454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa81e7-2d33-49c0-85c5-461d10727d65 None admin] RBAC: Authorizing `identity:get_user(user_id=164b2b5d3e2c441286df7026d440d113)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:32.708897 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa81e7-2d33-49c0-85c5-461d10727d65 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:32.712279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 144/291] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:32 2022] GET /identity/v3/users/164b2b5d3e2c441286df7026d440d113 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:32.718415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88500a07-16a0-4b0b-9ff0-cf8c11fc4f42 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:32.871147 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88500a07-16a0-4b0b-9ff0-cf8c11fc4f42 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:32.920522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf7a85-156e-4512-bc21-96dce32f7b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:32.921294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf7a85-156e-4512-bc21-96dce32f7b0e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:32.921490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf7a85-156e-4512-bc21-96dce32f7b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:32.921767 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf7a85-156e-4512-bc21-96dce32f7b0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:33.017376 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf7a85-156e-4512-bc21-96dce32f7b0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:33.018847 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf7a85-156e-4512-bc21-96dce32f7b0e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:33.137438 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 148/292] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:33.142664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa81e7-2d33-49c0-85c5-461d10727d65 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:33.258722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa81e7-2d33-49c0-85c5-461d10727d65 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:33.291763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783fd82-7989-4908-b5dd-c29310f38cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:33.293394 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783fd82-7989-4908-b5dd-c29310f38cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:33.293674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783fd82-7989-4908-b5dd-c29310f38cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:33.293948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783fd82-7989-4908-b5dd-c29310f38cc6 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:33.295181 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783fd82-7989-4908-b5dd-c29310f38cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:33.296637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783fd82-7989-4908-b5dd-c29310f38cc6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:33.298382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 145/293] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:33 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:33.304506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf7a85-156e-4512-bc21-96dce32f7b0e None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:33.501577 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf7a85-156e-4512-bc21-96dce32f7b0e None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:33.552977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d1d65-a200-41d4-a3fc-f808dff230a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:33.553631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d1d65-a200-41d4-a3fc-f808dff230a9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:33.553912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d1d65-a200-41d4-a3fc-f808dff230a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:33.554201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d1d65-a200-41d4-a3fc-f808dff230a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:33.555031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d1d65-a200-41d4-a3fc-f808dff230a9 None admin] RBAC: Adding query filter params (role.id=8f649e044d134d799d7bbaf6e0715e34, scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1, user.id=164b2b5d3e2c441286df7026d440d113) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:33.555407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d1d65-a200-41d4-a3fc-f808dff230a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:33.556907 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d1d65-a200-41d4-a3fc-f808dff230a9 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:33.567185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 149/294] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:33 2022] GET /identity/v3/role_assignments?user.id=164b2b5d3e2c441286df7026d440d113&scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1&role.id=8f649e044d134d799d7bbaf6e0715e34 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:34.146479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af5231-4dfd-403e-a31c-2edf18cb4d20 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:34.147043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af5231-4dfd-403e-a31c-2edf18cb4d20 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:34.147043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af5231-4dfd-403e-a31c-2edf18cb4d20 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:34.148375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 146/295] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:34.154782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b805da-aaac-4ec3-8bd1-da38dc49d0ce None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:34.155734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b805da-aaac-4ec3-8bd1-da38dc49d0ce None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:34.156206 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b805da-aaac-4ec3-8bd1-da38dc49d0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:34.173219 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28da28-94a6-467e-bec6-5847ea658126 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:34.173868 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28da28-94a6-467e-bec6-5847ea658126 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:34.174405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28da28-94a6-467e-bec6-5847ea658126 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:34.176033 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 147/296] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:34.183687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-a7b805da-aaac-4ec3-8bd1-da38dc49d0ce None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:34.184594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86277b02-432c-40c4-bc59-37beb1d6f61a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:34.185007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-a7b805da-aaac-4ec3-8bd1-da38dc49d0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:34.185300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86277b02-432c-40c4-bc59-37beb1d6f61a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:34.185763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86277b02-432c-40c4-bc59-37beb1d6f61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:34.206722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-86277b02-432c-40c4-bc59-37beb1d6f61a None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:34.208668 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-86277b02-432c-40c4-bc59-37beb1d6f61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:34.267929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 150/297] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:34.287937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 148/298] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:34.293026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b805da-aaac-4ec3-8bd1-da38dc49d0ce None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:34.315458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86277b02-432c-40c4-bc59-37beb1d6f61a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:34.400562 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b805da-aaac-4ec3-8bd1-da38dc49d0ce None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:34.423786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86277b02-432c-40c4-bc59-37beb1d6f61a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:34.435228 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f8345-e253-4e21-a439-f561120e6bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:34.436017 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f8345-e253-4e21-a439-f561120e6bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:34.436293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f8345-e253-4e21-a439-f561120e6bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:34.436568 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f8345-e253-4e21-a439-f561120e6bd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:34.446920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f8345-e253-4e21-a439-f561120e6bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-0f6f8345-e253-4e21-a439-f561120e6bd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:34.455498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:34.456359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:34.457143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:34.457143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:34.457143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:34.457143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:34.457143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:34.457143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:34.457143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:34.457143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:34.457143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:34.457143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:34.457143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:34.457143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:34.457143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 151/299] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:34.459092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fd4d3-5cb3-4425-83c7-aa83263e6dc1 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:34.459293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fd4d3-5cb3-4425-83c7-aa83263e6dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:34.459573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fd4d3-5cb3-4425-83c7-aa83263e6dc1 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:34.460807 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 152/300] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:34.465543 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fd4d3-5cb3-4425-83c7-aa83263e6dc1 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:34.466798 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454119b2-e053-485a-b056-92e03ba6a2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:34.468024 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454119b2-e053-485a-b056-92e03ba6a2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:34.468309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454119b2-e053-485a-b056-92e03ba6a2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:34.468582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454119b2-e053-485a-b056-92e03ba6a2d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:34.469783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454119b2-e053-485a-b056-92e03ba6a2d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:34.471279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454119b2-e053-485a-b056-92e03ba6a2d3 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:34.473088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 149/301] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:28:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:34.474377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9173504-5b8c-4af5-8b58-e3bb3877b9cf None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:34.474664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9173504-5b8c-4af5-8b58-e3bb3877b9cf None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:34.474941 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9173504-5b8c-4af5-8b58-e3bb3877b9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:34.493460 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d9173504-5b8c-4af5-8b58-e3bb3877b9cf None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:34.494669 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d9173504-5b8c-4af5-8b58-e3bb3877b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:34.567085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 150/302] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:34.567913 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9173504-5b8c-4af5-8b58-e3bb3877b9cf None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:34.579744 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fd4d3-5cb3-4425-83c7-aa83263e6dc1 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:34.615556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c5928-8f13-4727-aa94-0607bfef4394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:34.616482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c5928-8f13-4727-aa94-0607bfef4394 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:34.616910 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c5928-8f13-4727-aa94-0607bfef4394 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:34.617183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c5928-8f13-4727-aa94-0607bfef4394 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:34.617922 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c5928-8f13-4727-aa94-0607bfef4394 None admin] RBAC: Adding query filter params (name=member) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:34.618263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c5928-8f13-4727-aa94-0607bfef4394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:34.619635 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c5928-8f13-4727-aa94-0607bfef4394 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:34.628437 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 153/303] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:34.629481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c5928-8f13-4727-aa94-0607bfef4394 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:34.674679 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9173504-5b8c-4af5-8b58-e3bb3877b9cf None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:34.709326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ea96f-74cf-4fa5-aad4-0e2bf4cdad4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:34.709990 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ea96f-74cf-4fa5-aad4-0e2bf4cdad4a None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:34.710306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ea96f-74cf-4fa5-aad4-0e2bf4cdad4a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:34.710584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ea96f-74cf-4fa5-aad4-0e2bf4cdad4a None admin] PATH_INFO: `/v3/groups` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:34.711265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ea96f-74cf-4fa5-aad4-0e2bf4cdad4a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:34.712694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ea96f-74cf-4fa5-aad4-0e2bf4cdad4a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:34.728512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 151/304] 10.222.0.58 () {60 vars in 1134 bytes} [Thu May 5 15:28:34 2022] POST /identity/v3/groups => generated 229 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:28:34.728826 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c5928-8f13-4727-aa94-0607bfef4394 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:34.729148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ea96f-74cf-4fa5-aad4-0e2bf4cdad4a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:34.772317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59c5d5-db3d-455e-8cbb-6b2a54e04a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:34.773455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59c5d5-db3d-455e-8cbb-6b2a54e04a41 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:34.773880 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59c5d5-db3d-455e-8cbb-6b2a54e04a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:34.774339 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59c5d5-db3d-455e-8cbb-6b2a54e04a41 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:34.786971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59c5d5-db3d-455e-8cbb-6b2a54e04a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-4e59c5d5-db3d-455e-8cbb-6b2a54e04a41 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:34.795512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:34.796670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:34.797607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:34.797607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:34.797607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:34.797607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:34.797607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:34.797607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:34.797607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:34.797607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:34.797607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:34.797607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:34.797607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:34.797607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:34.799946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 154/305] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:34.806011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59c5d5-db3d-455e-8cbb-6b2a54e04a41 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:34.860760 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ea96f-74cf-4fa5-aad4-0e2bf4cdad4a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:34.902365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519aa56-6322-4fe1-8808-81124f466962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:34.903628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519aa56-6322-4fe1-8808-81124f466962 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:34.903902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519aa56-6322-4fe1-8808-81124f466962 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:34.904176 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519aa56-6322-4fe1-8808-81124f466962 None admin] PATH_INFO: `/v3/users/7695ef1c8c4d48949c2adc974fd185a2` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:34.905870 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519aa56-6322-4fe1-8808-81124f466962 None admin] RBAC: Authorizing `identity:get_user(user_id=7695ef1c8c4d48949c2adc974fd185a2)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:34.907706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519aa56-6322-4fe1-8808-81124f466962 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:34.914356 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 152/306] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:34 2022] GET /identity/v3/users/7695ef1c8c4d48949c2adc974fd185a2 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:34.916779 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519aa56-6322-4fe1-8808-81124f466962 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:34.975733 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59c5d5-db3d-455e-8cbb-6b2a54e04a41 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:35.016360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290dc0a-4631-44da-bdbc-7d3aa9974493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:35.017373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290dc0a-4631-44da-bdbc-7d3aa9974493 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:35.017873 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290dc0a-4631-44da-bdbc-7d3aa9974493 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:35.018369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290dc0a-4631-44da-bdbc-7d3aa9974493 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:35.019326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290dc0a-4631-44da-bdbc-7d3aa9974493 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:35.019825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290dc0a-4631-44da-bdbc-7d3aa9974493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:35.021386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290dc0a-4631-44da-bdbc-7d3aa9974493 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:35.030336 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 155/307] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:35.035796 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290dc0a-4631-44da-bdbc-7d3aa9974493 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:35.040517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519aa56-6322-4fe1-8808-81124f466962 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:35.083247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974f844-b4f3-4722-8a17-c14f813433d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:35.084599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974f844-b4f3-4722-8a17-c14f813433d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:35.084887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974f844-b4f3-4722-8a17-c14f813433d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:35.085163 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974f844-b4f3-4722-8a17-c14f813433d6 None admin] PATH_INFO: `/v3/system/users/7695ef1c8c4d48949c2adc974fd185a2/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:35.087236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974f844-b4f3-4722-8a17-c14f813433d6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7695ef1c8c4d48949c2adc974fd185a2, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:35.089781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974f844-b4f3-4722-8a17-c14f813433d6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:35.103041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 153/308] 10.222.0.58 () {58 vars in 1334 bytes} [Thu May 5 15:28:34 2022] PUT /identity/v3/system/users/7695ef1c8c4d48949c2adc974fd185a2/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:35.153754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290dc0a-4631-44da-bdbc-7d3aa9974493 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:35.192542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc01b3f-928a-4697-b234-c9f2fce7c170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:35.193432 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc01b3f-928a-4697-b234-c9f2fce7c170 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:35.193712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc01b3f-928a-4697-b234-c9f2fce7c170 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:35.193981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc01b3f-928a-4697-b234-c9f2fce7c170 None admin] PATH_INFO: `/v3/users/1fd8bb1c3c7e4a358ba488f810d87a2f` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:35.209239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc01b3f-928a-4697-b234-c9f2fce7c170 None admin] RBAC: Authorizing `identity:get_user(user_id=1fd8bb1c3c7e4a358ba488f810d87a2f)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:35.210748 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc01b3f-928a-4697-b234-c9f2fce7c170 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:35.212806 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 156/309] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:35 2022] GET /identity/v3/users/1fd8bb1c3c7e4a358ba488f810d87a2f => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:35.223418 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974f844-b4f3-4722-8a17-c14f813433d6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:35.275359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3cce1-99a8-4a58-864d-f2946c8e1b38 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:35.275553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3cce1-99a8-4a58-864d-f2946c8e1b38 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:35.275821 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3cce1-99a8-4a58-864d-f2946c8e1b38 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:35.278775 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 157/310] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:28:35.283814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc124c42-3573-4107-ad1b-c5481d7c3b37 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:35.284098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc124c42-3573-4107-ad1b-c5481d7c3b37 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:35.284373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc124c42-3573-4107-ad1b-c5481d7c3b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:35.307409 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-fc124c42-3573-4107-ad1b-c5481d7c3b37 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:35.309369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-fc124c42-3573-4107-ad1b-c5481d7c3b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:35.335765 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974f844-b4f3-4722-8a17-c14f813433d6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:35.375503 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa0f20-ec42-4b8f-8290-202d76317f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:35.376180 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0f20-ec42-4b8f-8290-202d76317f83 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:35.376458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0f20-ec42-4b8f-8290-202d76317f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:35.376730 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa0f20-ec42-4b8f-8290-202d76317f83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:35.377554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa0f20-ec42-4b8f-8290-202d76317f83 None admin] RBAC: Adding query filter params (role.id=a9790af349c74b43901af6f1113b6124, user.id=1fd8bb1c3c7e4a358ba488f810d87a2f, scope.system=all) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:35.377863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa0f20-ec42-4b8f-8290-202d76317f83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:35.379331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa0f20-ec42-4b8f-8290-202d76317f83 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:35.384415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 154/311] 10.222.0.58 () {56 vars in 1308 bytes} [Thu May 5 15:28:35 2022] GET /identity/v3/role_assignments?user.id=1fd8bb1c3c7e4a358ba488f810d87a2f&scope.system=all&role.id=a9790af349c74b43901af6f1113b6124 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:35.395161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 158/312] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:35.418871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa0f20-ec42-4b8f-8290-202d76317f83 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:35.527549 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa0f20-ec42-4b8f-8290-202d76317f83 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:35.563731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48478f7f-d6f3-4c23-9e37-ee3608b20cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:35.564534 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48478f7f-d6f3-4c23-9e37-ee3608b20cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:35.564814 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48478f7f-d6f3-4c23-9e37-ee3608b20cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:35.565081 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48478f7f-d6f3-4c23-9e37-ee3608b20cc5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:35.577349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48478f7f-d6f3-4c23-9e37-ee3608b20cc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-48478f7f-d6f3-4c23-9e37-ee3608b20cc5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:35.585238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:35.586130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:35.586964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:35.586964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:35.586964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:35.586964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:35.586964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:35.586964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:35.586964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:35.586964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:35.586964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:35.586964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:35.586964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:35.586964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:35.586964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 155/313] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:35.592708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc124c42-3573-4107-ad1b-c5481d7c3b37 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:35.692110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc124c42-3573-4107-ad1b-c5481d7c3b37 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:35.729517 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdeb66-2d55-4c3d-8add-2c9f67abbd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:35.730789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdeb66-2d55-4c3d-8add-2c9f67abbd3a None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:35.731065 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdeb66-2d55-4c3d-8add-2c9f67abbd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:35.731334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdeb66-2d55-4c3d-8add-2c9f67abbd3a None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:35.732066 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdeb66-2d55-4c3d-8add-2c9f67abbd3a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:35.732368 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdeb66-2d55-4c3d-8add-2c9f67abbd3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:35.733719 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdeb66-2d55-4c3d-8add-2c9f67abbd3a None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:35.741938 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 159/314] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:35.747652 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48478f7f-d6f3-4c23-9e37-ee3608b20cc5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:35.847361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48478f7f-d6f3-4c23-9e37-ee3608b20cc5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:35.881245 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b53e14-2edc-4ae6-beff-848175e08ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:35.882114 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b53e14-2edc-4ae6-beff-848175e08ccd None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:35.882436 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b53e14-2edc-4ae6-beff-848175e08ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:35.882707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b53e14-2edc-4ae6-beff-848175e08ccd None admin] PATH_INFO: `/v3/users/3a8a80d916504b2b8f032148ecb477ff` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:35.883918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b53e14-2edc-4ae6-beff-848175e08ccd None admin] RBAC: Authorizing `identity:get_user(user_id=3a8a80d916504b2b8f032148ecb477ff)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:35.885337 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b53e14-2edc-4ae6-beff-848175e08ccd None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:35.892419 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 156/315] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:35 2022] GET /identity/v3/users/3a8a80d916504b2b8f032148ecb477ff => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:35.893804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdeb66-2d55-4c3d-8add-2c9f67abbd3a None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:35.995026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdeb66-2d55-4c3d-8add-2c9f67abbd3a None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:36.028904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c070dd-beae-4c75-871e-2ba9e88f8d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:36.029552 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c070dd-beae-4c75-871e-2ba9e88f8d1e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:36.029831 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c070dd-beae-4c75-871e-2ba9e88f8d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:36.030103 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c070dd-beae-4c75-871e-2ba9e88f8d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:36.095493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c070dd-beae-4c75-871e-2ba9e88f8d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:36.096938 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c070dd-beae-4c75-871e-2ba9e88f8d1e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:36.199443 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 160/316] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:36.200941 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b53e14-2edc-4ae6-beff-848175e08ccd None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:36.304402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b53e14-2edc-4ae6-beff-848175e08ccd None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:36.341406 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696871c-a737-4939-8706-7f24c64b3375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:36.342298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696871c-a737-4939-8706-7f24c64b3375 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:36.342580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696871c-a737-4939-8706-7f24c64b3375 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:36.342852 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696871c-a737-4939-8706-7f24c64b3375 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:36.344068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696871c-a737-4939-8706-7f24c64b3375 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:36.345493 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696871c-a737-4939-8706-7f24c64b3375 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:36.347573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 157/317] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:36 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:36.355991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c070dd-beae-4c75-871e-2ba9e88f8d1e None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:36.458060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c070dd-beae-4c75-871e-2ba9e88f8d1e None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:36.493196 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8e091-5f3f-4068-8fb5-7d53eabd0c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:36.493853 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8e091-5f3f-4068-8fb5-7d53eabd0c53 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:36.494128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8e091-5f3f-4068-8fb5-7d53eabd0c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:36.494425 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8e091-5f3f-4068-8fb5-7d53eabd0c53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:36.495246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8e091-5f3f-4068-8fb5-7d53eabd0c53 None admin] RBAC: Adding query filter params (role.id=a9790af349c74b43901af6f1113b6124, scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1, user.id=3a8a80d916504b2b8f032148ecb477ff) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:36.495581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8e091-5f3f-4068-8fb5-7d53eabd0c53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:36.497003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8e091-5f3f-4068-8fb5-7d53eabd0c53 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:36.502846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 161/318] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:28:36 2022] GET /identity/v3/role_assignments?user.id=3a8a80d916504b2b8f032148ecb477ff&scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1&role.id=a9790af349c74b43901af6f1113b6124 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:37.120912 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992c733-7d89-4f81-b4ca-1758b027d34f None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:37.121290 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992c733-7d89-4f81-b4ca-1758b027d34f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:37.121495 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992c733-7d89-4f81-b4ca-1758b027d34f None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:37.122985 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 158/319] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:37.127995 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37c492-acdf-474c-8a25-be07e5fee9ae None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:37.128287 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37c492-acdf-474c-8a25-be07e5fee9ae None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:37.128556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37c492-acdf-474c-8a25-be07e5fee9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:37.145361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-ec37c492-acdf-474c-8a25-be07e5fee9ae None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:37.146541 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-ec37c492-acdf-474c-8a25-be07e5fee9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:37.210445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 162/320] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:37.233723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992c733-7d89-4f81-b4ca-1758b027d34f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:37.334597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992c733-7d89-4f81-b4ca-1758b027d34f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:37.367259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e8c5f-c6da-420f-9273-ab8aba63ffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:37.368045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e8c5f-c6da-420f-9273-ab8aba63ffe4 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:37.368325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e8c5f-c6da-420f-9273-ab8aba63ffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:37.368594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e8c5f-c6da-420f-9273-ab8aba63ffe4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:37.369728 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e8c5f-c6da-420f-9273-ab8aba63ffe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:37.371963 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e8c5f-c6da-420f-9273-ab8aba63ffe4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:37.373681 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 159/321] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:28:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:37.379230 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37c492-acdf-474c-8a25-be07e5fee9ae None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:37.456668 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b408620-e0d6-4488-94c2-bfd184f459cb None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:37.456856 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b408620-e0d6-4488-94c2-bfd184f459cb None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:37.457139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b408620-e0d6-4488-94c2-bfd184f459cb None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:37.458546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 160/322] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:28:37.463269 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59f699-cff7-4b0c-931a-0de5076b67e9 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:37.463559 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59f699-cff7-4b0c-931a-0de5076b67e9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:37.463835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59f699-cff7-4b0c-931a-0de5076b67e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:37.474239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37c492-acdf-474c-8a25-be07e5fee9ae None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:37.480305 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4f59f699-cff7-4b0c-931a-0de5076b67e9 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:37.481496 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4f59f699-cff7-4b0c-931a-0de5076b67e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:37.512601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40a2c9-1cb3-4ac4-a14d-88ab9551d2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:37.513286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40a2c9-1cb3-4ac4-a14d-88ab9551d2a0 None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:37.513566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40a2c9-1cb3-4ac4-a14d-88ab9551d2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:37.513842 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40a2c9-1cb3-4ac4-a14d-88ab9551d2a0 None admin] PATH_INFO: `/v3/groups` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:37.514606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40a2c9-1cb3-4ac4-a14d-88ab9551d2a0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:37.516083 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40a2c9-1cb3-4ac4-a14d-88ab9551d2a0 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:37.532719 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 163/323] 10.222.0.58 () {60 vars in 1134 bytes} [Thu May 5 15:28:37 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:28:37.554547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 161/324] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:37.579554 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40a2c9-1cb3-4ac4-a14d-88ab9551d2a0 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:37.684411 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40a2c9-1cb3-4ac4-a14d-88ab9551d2a0 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:37.720860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a35dd-6d31-40f3-81a4-77f1043a2e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:37.721669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a35dd-6d31-40f3-81a4-77f1043a2e50 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:37.721944 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a35dd-6d31-40f3-81a4-77f1043a2e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:37.723353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a35dd-6d31-40f3-81a4-77f1043a2e50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:37.733524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a35dd-6d31-40f3-81a4-77f1043a2e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-793a35dd-6d31-40f3-81a4-77f1043a2e50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:37.741192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:37.742082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:37.742951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:37.742951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:37.742951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:37.742951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:37.742951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:37.742951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:37.742951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:37.742951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:37.742951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:37.742951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:37.742951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:37.742951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:37.742951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 164/325] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:37.744405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309b101-6d48-424d-9680-08311dcf7dac None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:37.744690 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309b101-6d48-424d-9680-08311dcf7dac None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:37.744961 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309b101-6d48-424d-9680-08311dcf7dac None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:37.747134 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 162/326] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:37.750020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a35dd-6d31-40f3-81a4-77f1043a2e50 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:37.752445 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf56345-9117-4511-bef3-ae45ffbabdc5 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:37.752726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf56345-9117-4511-bef3-ae45ffbabdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:37.752995 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf56345-9117-4511-bef3-ae45ffbabdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:37.773439 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-5cf56345-9117-4511-bef3-ae45ffbabdc5 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:37.774731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5cf56345-9117-4511-bef3-ae45ffbabdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:37.849900 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a35dd-6d31-40f3-81a4-77f1043a2e50 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:37.850982 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 163/327] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:37.875066 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf56345-9117-4511-bef3-ae45ffbabdc5 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:37.885503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14754a8d-5084-42ce-9f6d-a8f022125efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:37.886896 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14754a8d-5084-42ce-9f6d-a8f022125efe None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:37.887359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14754a8d-5084-42ce-9f6d-a8f022125efe None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:37.887801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14754a8d-5084-42ce-9f6d-a8f022125efe None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:37.888713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14754a8d-5084-42ce-9f6d-a8f022125efe None admin] RBAC: Adding query filter params (name=member) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:37.889206 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14754a8d-5084-42ce-9f6d-a8f022125efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:37.890781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14754a8d-5084-42ce-9f6d-a8f022125efe None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:37.900115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 165/328] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:37.906198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14754a8d-5084-42ce-9f6d-a8f022125efe None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:37.975523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf56345-9117-4511-bef3-ae45ffbabdc5 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:38.009464 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14754a8d-5084-42ce-9f6d-a8f022125efe None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:38.011828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a99b9-d94c-4902-a853-6c19dacd28fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:38.012627 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a99b9-d94c-4902-a853-6c19dacd28fe None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:38.012902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a99b9-d94c-4902-a853-6c19dacd28fe None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:38.013170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a99b9-d94c-4902-a853-6c19dacd28fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:38.024436 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a99b9-d94c-4902-a853-6c19dacd28fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-dd5a99b9-d94c-4902-a853-6c19dacd28fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:38.032194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:38.033074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:38.033846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:38.033846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:38.033846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:38.033846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:38.033846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:38.033846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:38.033846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:38.033846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:38.033846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:38.033846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:38.033846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:38.033846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:38.038320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 164/329] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:28:38.039571 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a99b9-d94c-4902-a853-6c19dacd28fe None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:38.046375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8f529-dedf-4a50-8020-3c7d9fea2f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:38.047255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8f529-dedf-4a50-8020-3c7d9fea2f87 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:38.047553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8f529-dedf-4a50-8020-3c7d9fea2f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:38.047800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8f529-dedf-4a50-8020-3c7d9fea2f87 None admin] PATH_INFO: `/v3/users/7695ef1c8c4d48949c2adc974fd185a2` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:38.049022 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8f529-dedf-4a50-8020-3c7d9fea2f87 None admin] RBAC: Authorizing `identity:get_user(user_id=7695ef1c8c4d48949c2adc974fd185a2)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:38.050506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8f529-dedf-4a50-8020-3c7d9fea2f87 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:38.052144 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 166/330] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:37 2022] GET /identity/v3/users/7695ef1c8c4d48949c2adc974fd185a2 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:38.058227 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8f529-dedf-4a50-8020-3c7d9fea2f87 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:38.140974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a99b9-d94c-4902-a853-6c19dacd28fe None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:38.165246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8f529-dedf-4a50-8020-3c7d9fea2f87 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:38.174381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c3eb1-2ca8-4ff8-85a9-4ceb96733856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:38.175051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c3eb1-2ca8-4ff8-85a9-4ceb96733856 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:38.175332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c3eb1-2ca8-4ff8-85a9-4ceb96733856 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:38.175601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c3eb1-2ca8-4ff8-85a9-4ceb96733856 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:38.176345 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c3eb1-2ca8-4ff8-85a9-4ceb96733856 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:38.176647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c3eb1-2ca8-4ff8-85a9-4ceb96733856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:38.178026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c3eb1-2ca8-4ff8-85a9-4ceb96733856 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:38.193088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 165/331] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:38.194577 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c3eb1-2ca8-4ff8-85a9-4ceb96733856 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:38.202082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff4dd2-d8e0-4750-a805-2e74df9324b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:38.202780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff4dd2-d8e0-4750-a805-2e74df9324b0 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:38.203064 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff4dd2-d8e0-4750-a805-2e74df9324b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:38.203345 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff4dd2-d8e0-4750-a805-2e74df9324b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:38.204179 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff4dd2-d8e0-4750-a805-2e74df9324b0 None admin] RBAC: Adding query filter params (role.id=8f649e044d134d799d7bbaf6e0715e34, user.id=7695ef1c8c4d48949c2adc974fd185a2, scope.system=all) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:38.204492 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff4dd2-d8e0-4750-a805-2e74df9324b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:38.205941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff4dd2-d8e0-4750-a805-2e74df9324b0 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:38.219419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 167/332] 10.222.0.58 () {56 vars in 1308 bytes} [Thu May 5 15:28:38 2022] GET /identity/v3/role_assignments?user.id=7695ef1c8c4d48949c2adc974fd185a2&scope.system=all&role.id=8f649e044d134d799d7bbaf6e0715e34 => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:38.307655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c3eb1-2ca8-4ff8-85a9-4ceb96733856 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:38.346963 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de132ac-f39b-4d05-8893-8bf9f29e06eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:38.347868 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de132ac-f39b-4d05-8893-8bf9f29e06eb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:38.348152 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de132ac-f39b-4d05-8893-8bf9f29e06eb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:38.348427 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de132ac-f39b-4d05-8893-8bf9f29e06eb None admin] PATH_INFO: `/v3/users/1fd8bb1c3c7e4a358ba488f810d87a2f` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:38.349964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de132ac-f39b-4d05-8893-8bf9f29e06eb None admin] RBAC: Authorizing `identity:get_user(user_id=1fd8bb1c3c7e4a358ba488f810d87a2f)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:38.351515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de132ac-f39b-4d05-8893-8bf9f29e06eb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:38.353817 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 166/333] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:38 2022] GET /identity/v3/users/1fd8bb1c3c7e4a358ba488f810d87a2f => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:38.360257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff4dd2-d8e0-4750-a805-2e74df9324b0 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:38.474958 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff4dd2-d8e0-4750-a805-2e74df9324b0 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:38.512459 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63a902-147a-48a5-be2d-1004a39c023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:38.513339 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63a902-147a-48a5-be2d-1004a39c023e None admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:38.513622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63a902-147a-48a5-be2d-1004a39c023e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:38.513899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63a902-147a-48a5-be2d-1004a39c023e None admin] PATH_INFO: `/v3/system/users/1fd8bb1c3c7e4a358ba488f810d87a2f/roles/a9790af349c74b43901af6f1113b6124` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:38.518988 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63a902-147a-48a5-be2d-1004a39c023e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1fd8bb1c3c7e4a358ba488f810d87a2f, role_id=a9790af349c74b43901af6f1113b6124)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:38.520388 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63a902-147a-48a5-be2d-1004a39c023e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:38.539431 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 168/334] 10.222.0.58 () {58 vars in 1334 bytes} [Thu May 5 15:28:38 2022] PUT /identity/v3/system/users/1fd8bb1c3c7e4a358ba488f810d87a2f/roles/a9790af349c74b43901af6f1113b6124 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:40.216086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f83410-fdb2-436f-98db-f8d61d6a8333 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:40.217105 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f83410-fdb2-436f-98db-f8d61d6a8333 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:40.217589 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f83410-fdb2-436f-98db-f8d61d6a8333 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:40.219448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 167/335] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:40.225819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a52dc1-a8ab-4ff7-9091-7b4e2b1e67c0 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:40.226720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a52dc1-a8ab-4ff7-9091-7b4e2b1e67c0 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:40.227193 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a52dc1-a8ab-4ff7-9091-7b4e2b1e67c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:40.251159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-12a52dc1-a8ab-4ff7-9091-7b4e2b1e67c0 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:40.252710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-12a52dc1-a8ab-4ff7-9091-7b4e2b1e67c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:40.341101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 169/336] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:40.385659 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f83410-fdb2-436f-98db-f8d61d6a8333 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:40.489994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f83410-fdb2-436f-98db-f8d61d6a8333 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:40.535911 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85462664-04d9-420d-b21e-8d11b0d925e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:40.537087 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85462664-04d9-420d-b21e-8d11b0d925e9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:40.537569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85462664-04d9-420d-b21e-8d11b0d925e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:40.538031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85462664-04d9-420d-b21e-8d11b0d925e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:40.553741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85462664-04d9-420d-b21e-8d11b0d925e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-85462664-04d9-420d-b21e-8d11b0d925e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:40.562389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:40.563280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:40.564049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:40.564049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:40.564049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:40.564049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:40.564049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:40.564049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:40.564049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:40.564049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:40.564049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:40.564049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:40.564049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:40.564049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:40.566480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 168/337] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:40.572330 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a52dc1-a8ab-4ff7-9091-7b4e2b1e67c0 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:40.686017 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a52dc1-a8ab-4ff7-9091-7b4e2b1e67c0 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:40.725889 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000d9ce-8651-499f-8d25-f547f13ca13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:40.726963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000d9ce-8651-499f-8d25-f547f13ca13c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:40.727442 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000d9ce-8651-499f-8d25-f547f13ca13c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:40.727909 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000d9ce-8651-499f-8d25-f547f13ca13c None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:40.728849 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000d9ce-8651-499f-8d25-f547f13ca13c None admin] RBAC: Adding query filter params (name=member) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:40.729348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000d9ce-8651-499f-8d25-f547f13ca13c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:40.731680 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000d9ce-8651-499f-8d25-f547f13ca13c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:40.741099 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 170/338] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:40.746516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85462664-04d9-420d-b21e-8d11b0d925e9 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:40.767173 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8f09-a549-468d-99aa-95b0ce7d012b None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:40.767774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8f09-a549-468d-99aa-95b0ce7d012b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:40.768243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8f09-a549-468d-99aa-95b0ce7d012b None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:40.770057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 171/339] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:40.785363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ef21f-09ec-43cc-b275-f15b25658e5f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:40.785646 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ef21f-09ec-43cc-b275-f15b25658e5f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:40.786221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ef21f-09ec-43cc-b275-f15b25658e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:40.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-996ef21f-09ec-43cc-b275-f15b25658e5f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:40.821093 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-996ef21f-09ec-43cc-b275-f15b25658e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:40.928350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85462664-04d9-420d-b21e-8d11b0d925e9 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:40.965146 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 172/340] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:40.997378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f99c1f-20c4-428a-911a-703914b6712f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:40.997948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f99c1f-20c4-428a-911a-703914b6712f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:40.998248 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f99c1f-20c4-428a-911a-703914b6712f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:40.998523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f99c1f-20c4-428a-911a-703914b6712f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:41.007949 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ef21f-09ec-43cc-b275-f15b25658e5f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:41.127971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f99c1f-20c4-428a-911a-703914b6712f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:41.129659 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f99c1f-20c4-428a-911a-703914b6712f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:41.232412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ef21f-09ec-43cc-b275-f15b25658e5f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:41.238673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 169/341] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:41.245804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64988b12-2ce6-4998-915c-c250ec04536f None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:41.246294 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64988b12-2ce6-4998-915c-c250ec04536f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:41.246823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64988b12-2ce6-4998-915c-c250ec04536f None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:41.248409 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 170/342] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:41.249670 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64988b12-2ce6-4998-915c-c250ec04536f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:41.299761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057eac8f-39b9-4055-9026-e0204701b084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:41.300774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eac8f-39b9-4055-9026-e0204701b084 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:41.301130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eac8f-39b9-4055-9026-e0204701b084 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:41.301480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eac8f-39b9-4055-9026-e0204701b084 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:41.331256 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057eac8f-39b9-4055-9026-e0204701b084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-057eac8f-39b9-4055-9026-e0204701b084 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:41.341109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:41.342003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:41.342832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:41.342832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:41.342832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:41.342832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:41.342832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:41.342832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:41.342832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:41.342832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:41.342832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:41.342832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:41.342832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:41.342832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:41.346746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 173/343] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:28:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:28:41.348153 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced7a8f-4e62-478c-9c97-42f5fcda3b05 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:41.348515 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced7a8f-4e62-478c-9c97-42f5fcda3b05 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:41.349117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced7a8f-4e62-478c-9c97-42f5fcda3b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:41.364088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64988b12-2ce6-4998-915c-c250ec04536f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:41.384284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-7ced7a8f-4e62-478c-9c97-42f5fcda3b05 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:41.385863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7ced7a8f-4e62-478c-9c97-42f5fcda3b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:41.408745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b89fbf-4a25-4eb0-b845-23a0468f0d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:41.409614 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b89fbf-4a25-4eb0-b845-23a0468f0d72 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:41.409908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b89fbf-4a25-4eb0-b845-23a0468f0d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:41.410182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b89fbf-4a25-4eb0-b845-23a0468f0d72 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:41.414887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b89fbf-4a25-4eb0-b845-23a0468f0d72 None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:41.416354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b89fbf-4a25-4eb0-b845-23a0468f0d72 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:41.419026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 171/344] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:41 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:41.422606 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b89fbf-4a25-4eb0-b845-23a0468f0d72 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:41.503749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 174/345] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:41.505245 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced7a8f-4e62-478c-9c97-42f5fcda3b05 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:41.591556 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b89fbf-4a25-4eb0-b845-23a0468f0d72 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:41.649482 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d58d05-d1ea-4791-afee-a1ada71ebd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:41.650158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d58d05-d1ea-4791-afee-a1ada71ebd9e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:41.651150 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d58d05-d1ea-4791-afee-a1ada71ebd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:41.651150 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d58d05-d1ea-4791-afee-a1ada71ebd9e None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:41.651737 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d58d05-d1ea-4791-afee-a1ada71ebd9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:41.652091 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d58d05-d1ea-4791-afee-a1ada71ebd9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:41.653466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d58d05-d1ea-4791-afee-a1ada71ebd9e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:41.666039 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 172/346] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:28:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:41.667927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d58d05-d1ea-4791-afee-a1ada71ebd9e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:41.704028 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced7a8f-4e62-478c-9c97-42f5fcda3b05 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:41.750968 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ad27a-ab1d-41c9-84e7-4dab901e0545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:41.752130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ad27a-ab1d-41c9-84e7-4dab901e0545 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:41.752602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ad27a-ab1d-41c9-84e7-4dab901e0545 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:41.753040 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ad27a-ab1d-41c9-84e7-4dab901e0545 None admin] PATH_INFO: `/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:41.759543 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ad27a-ab1d-41c9-84e7-4dab901e0545 None admin] RBAC: Authorizing `identity:get_group(group_id=2fc8514ec6ca4fd48bf6e23fcf094219)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:41.761917 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ad27a-ab1d-41c9-84e7-4dab901e0545 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:41.763813 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 175/347] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 5 15:28:41 2022] GET /identity/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:41.769488 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ad27a-ab1d-41c9-84e7-4dab901e0545 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:41.787375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d58d05-d1ea-4791-afee-a1ada71ebd9e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:41.828358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a294f-376d-47ea-8097-98ab87b7d4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:41.829229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a294f-376d-47ea-8097-98ab87b7d4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:41.829509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a294f-376d-47ea-8097-98ab87b7d4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:41.829784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a294f-376d-47ea-8097-98ab87b7d4b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:41.851569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a294f-376d-47ea-8097-98ab87b7d4b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-3e1a294f-376d-47ea-8097-98ab87b7d4b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:41.867780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:41.868705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:41.869502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:41.869502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:41.869502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:41.869502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:41.869502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:41.869502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:41.869502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:41.869502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:41.869502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:41.869502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:41.869502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:41.869502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:41.872144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 173/348] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:41.874061 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a294f-376d-47ea-8097-98ab87b7d4b0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:41.908978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ad27a-ab1d-41c9-84e7-4dab901e0545 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:41.947001 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d75a61-f3c9-4cf4-95b0-f1ffec4b7a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:41.947525 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d75a61-f3c9-4cf4-95b0-f1ffec4b7a04 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:41.947807 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d75a61-f3c9-4cf4-95b0-f1ffec4b7a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:41.948082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d75a61-f3c9-4cf4-95b0-f1ffec4b7a04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:41.982100 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a294f-376d-47ea-8097-98ab87b7d4b0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:42.018119 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee95b83-e2dd-4258-be2f-60194a0d52f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:42.019020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee95b83-e2dd-4258-be2f-60194a0d52f8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:42.019440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee95b83-e2dd-4258-be2f-60194a0d52f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:42.019852 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee95b83-e2dd-4258-be2f-60194a0d52f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:42.020818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee95b83-e2dd-4258-be2f-60194a0d52f8 None admin] RBAC: Adding query filter params (group.id=2fc8514ec6ca4fd48bf6e23fcf094219, role.id=8f649e044d134d799d7bbaf6e0715e34, scope.project.id=d19a556265e745c3a127579e6b3fed9c) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:42.020951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d75a61-f3c9-4cf4-95b0-f1ffec4b7a04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:42.021387 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee95b83-e2dd-4258-be2f-60194a0d52f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:42.022346 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d75a61-f3c9-4cf4-95b0-f1ffec4b7a04 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:42.023128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee95b83-e2dd-4258-be2f-60194a0d52f8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:42.029990 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 174/349] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 5 15:28:41 2022] GET /identity/v3/role_assignments?group.id=2fc8514ec6ca4fd48bf6e23fcf094219&scope.project.id=d19a556265e745c3a127579e6b3fed9c&role.id=8f649e044d134d799d7bbaf6e0715e34 => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:42.035263 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee95b83-e2dd-4258-be2f-60194a0d52f8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:42.132819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 176/350] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:42.132819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd395f7-41af-447d-b98e-1aa5edd229b2 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:42.132819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd395f7-41af-447d-b98e-1aa5edd229b2 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:42.132819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd395f7-41af-447d-b98e-1aa5edd229b2 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:42.132819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 177/351] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:42.138108 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd395f7-41af-447d-b98e-1aa5edd229b2 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:42.190634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee95b83-e2dd-4258-be2f-60194a0d52f8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:42.275735 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca40e4-9cc6-4673-ac1a-f18fccd16e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:42.276336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca40e4-9cc6-4673-ac1a-f18fccd16e38 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:42.276716 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca40e4-9cc6-4673-ac1a-f18fccd16e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:42.276956 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca40e4-9cc6-4673-ac1a-f18fccd16e38 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:42.277711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca40e4-9cc6-4673-ac1a-f18fccd16e38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:42.278015 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca40e4-9cc6-4673-ac1a-f18fccd16e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:42.279459 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca40e4-9cc6-4673-ac1a-f18fccd16e38 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:42.296761 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 175/352] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:42.298092 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c2c02-2b03-45cd-8dbc-0f1f5b6a52fc None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:42.298408 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c2c02-2b03-45cd-8dbc-0f1f5b6a52fc None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:42.298684 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c2c02-2b03-45cd-8dbc-0f1f5b6a52fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:42.299708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd395f7-41af-447d-b98e-1aa5edd229b2 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:42.331965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-7e5c2c02-2b03-45cd-8dbc-0f1f5b6a52fc None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:42.333503 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7e5c2c02-2b03-45cd-8dbc-0f1f5b6a52fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:42.340745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e63b72-3727-4867-930c-6a39a12f7371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:42.341605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e63b72-3727-4867-930c-6a39a12f7371 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:42.341935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e63b72-3727-4867-930c-6a39a12f7371 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:42.346188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e63b72-3727-4867-930c-6a39a12f7371 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:42.347176 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e63b72-3727-4867-930c-6a39a12f7371 None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:42.348694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e63b72-3727-4867-930c-6a39a12f7371 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:42.351336 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 178/353] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:42 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:42.352325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e63b72-3727-4867-930c-6a39a12f7371 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:42.436051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 176/354] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:42.442388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c2c02-2b03-45cd-8dbc-0f1f5b6a52fc None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:42.477199 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e63b72-3727-4867-930c-6a39a12f7371 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:42.523460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abd321-e28a-4bb2-bb0c-a8ea8a44c217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:42.524089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abd321-e28a-4bb2-bb0c-a8ea8a44c217 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:42.524373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abd321-e28a-4bb2-bb0c-a8ea8a44c217 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:42.524648 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abd321-e28a-4bb2-bb0c-a8ea8a44c217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:42.560880 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c2c02-2b03-45cd-8dbc-0f1f5b6a52fc None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:42.594905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe959d17-71d0-45ca-9f3d-4f5d44d7c4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:42.596155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe959d17-71d0-45ca-9f3d-4f5d44d7c4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:42.596657 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe959d17-71d0-45ca-9f3d-4f5d44d7c4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:42.597019 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abd321-e28a-4bb2-bb0c-a8ea8a44c217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:42.597356 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe959d17-71d0-45ca-9f3d-4f5d44d7c4f8 None admin] PATH_INFO: `/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:42.599136 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abd321-e28a-4bb2-bb0c-a8ea8a44c217 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:42.599398 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe959d17-71d0-45ca-9f3d-4f5d44d7c4f8 None admin] RBAC: Authorizing `identity:get_group(group_id=2fc8514ec6ca4fd48bf6e23fcf094219)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:42.601065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe959d17-71d0-45ca-9f3d-4f5d44d7c4f8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:42.603476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 177/355] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 5 15:28:42 2022] GET /identity/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:42.605801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b810ea9-efb4-4786-b0f3-91b52c23b299 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:42.606317 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b810ea9-efb4-4786-b0f3-91b52c23b299 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:42.606805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b810ea9-efb4-4786-b0f3-91b52c23b299 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:42.608637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 178/356] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:42.609567 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b810ea9-efb4-4786-b0f3-91b52c23b299 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:42.709294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 179/357] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:42.710159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abd321-e28a-4bb2-bb0c-a8ea8a44c217 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:42.715141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b810ea9-efb4-4786-b0f3-91b52c23b299 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:42.749299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa96e70-8fc7-4ba5-b592-7a6e904bc221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:42.750491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa96e70-8fc7-4ba5-b592-7a6e904bc221 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:42.751034 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa96e70-8fc7-4ba5-b592-7a6e904bc221 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:42.751517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa96e70-8fc7-4ba5-b592-7a6e904bc221 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:42.763068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa96e70-8fc7-4ba5-b592-7a6e904bc221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-1fa96e70-8fc7-4ba5-b592-7a6e904bc221 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:42.771018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:42.771991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:42.772826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:42.772826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:42.772826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:42.772826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:42.772826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:42.772826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:42.772826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:42.772826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:42.772826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:42.772826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:42.772826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 05 15:28:42.772826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:42.775213 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 179/358] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:42.777596 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416462e-d3f7-4682-8431-0c7db0c9642d None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:42.778093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416462e-d3f7-4682-8431-0c7db0c9642d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:42.778599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416462e-d3f7-4682-8431-0c7db0c9642d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:42.795421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-5416462e-d3f7-4682-8431-0c7db0c9642d None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:42.796917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5416462e-d3f7-4682-8431-0c7db0c9642d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:42.820234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abd321-e28a-4bb2-bb0c-a8ea8a44c217 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:42.858478 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb1f74-b008-43f2-9e5d-19624195c303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:42.858828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb1f74-b008-43f2-9e5d-19624195c303 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:42.859007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb1f74-b008-43f2-9e5d-19624195c303 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:42.859537 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb1f74-b008-43f2-9e5d-19624195c303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:42.860114 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb1f74-b008-43f2-9e5d-19624195c303 None admin] RBAC: Adding query filter params (group.id=2fc8514ec6ca4fd48bf6e23fcf094219, role.id=8b51e457da8145c6995241d379986c7c, scope.project.id=d19a556265e745c3a127579e6b3fed9c) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:42.860427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb1f74-b008-43f2-9e5d-19624195c303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:42.861856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb1f74-b008-43f2-9e5d-19624195c303 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:42.869543 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 180/359] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 5 15:28:42 2022] GET /identity/v3/role_assignments?group.id=2fc8514ec6ca4fd48bf6e23fcf094219&scope.project.id=d19a556265e745c3a127579e6b3fed9c&role.id=8b51e457da8145c6995241d379986c7c => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:42.870940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb1f74-b008-43f2-9e5d-19624195c303 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:42.884560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 180/360] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:42.885989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416462e-d3f7-4682-8431-0c7db0c9642d None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:42.999340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb1f74-b008-43f2-9e5d-19624195c303 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:43.008744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416462e-d3f7-4682-8431-0c7db0c9642d None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:43.050400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b581cfe-9e9f-475d-924c-5710fa2aebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:43.051289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b581cfe-9e9f-475d-924c-5710fa2aebd1 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.051569 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b581cfe-9e9f-475d-924c-5710fa2aebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.052216 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b581cfe-9e9f-475d-924c-5710fa2aebd1 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.053167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b581cfe-9e9f-475d-924c-5710fa2aebd1 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:43.054652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b581cfe-9e9f-475d-924c-5710fa2aebd1 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:43.056631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 181/361] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:42 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:43.057960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf3e67-2e9a-4974-9d69-ad033d2f8d54 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.058711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92693c-efbe-4861-897e-c7212f85f3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:43.059619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92693c-efbe-4861-897e-c7212f85f3ce None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.061074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf3e67-2e9a-4974-9d69-ad033d2f8d54 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.061074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf3e67-2e9a-4974-9d69-ad033d2f8d54 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.061507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92693c-efbe-4861-897e-c7212f85f3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.061843 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 182/362] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:43.062321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92693c-efbe-4861-897e-c7212f85f3ce None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.062614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf3e67-2e9a-4974-9d69-ad033d2f8d54 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:43.063743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92693c-efbe-4861-897e-c7212f85f3ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:43.064273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92693c-efbe-4861-897e-c7212f85f3ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:43.066272 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92693c-efbe-4861-897e-c7212f85f3ce None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:43.077024 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 181/363] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:43.078361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92693c-efbe-4861-897e-c7212f85f3ce None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:43.177218 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf3e67-2e9a-4974-9d69-ad033d2f8d54 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:43.182427 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92693c-efbe-4861-897e-c7212f85f3ce None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:43.212686 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e66783-6435-4e6e-961a-66d13918700b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:43.213492 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e66783-6435-4e6e-961a-66d13918700b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.213774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e66783-6435-4e6e-961a-66d13918700b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.214363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e66783-6435-4e6e-961a-66d13918700b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.218273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ddd8b-48d0-4d23-a826-4e2ad929b70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:43.219363 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ddd8b-48d0-4d23-a826-4e2ad929b70e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.219839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ddd8b-48d0-4d23-a826-4e2ad929b70e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.220519 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ddd8b-48d0-4d23-a826-4e2ad929b70e None admin] PATH_INFO: `/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.221902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ddd8b-48d0-4d23-a826-4e2ad929b70e None admin] RBAC: Authorizing `identity:get_group(group_id=2fc8514ec6ca4fd48bf6e23fcf094219)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:43.223561 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ddd8b-48d0-4d23-a826-4e2ad929b70e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:43.225015 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e66783-6435-4e6e-961a-66d13918700b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:43.226304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 182/364] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 5 15:28:43 2022] GET /identity/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:43.227786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703232c3-fe22-492d-b83f-14d8b97627bc None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.228276 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703232c3-fe22-492d-b83f-14d8b97627bc None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.228745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703232c3-fe22-492d-b83f-14d8b97627bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-b2e66783-6435-4e6e-961a-66d13918700b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:43.234014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:43.234941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:43.235714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:43.235714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:43.235714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:43.235714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:43.235714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:43.235714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:43.235714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:43.235714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:43.235714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:43.235714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:43.235714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:43.235714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:43.237004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 183/365] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:28:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:43.237367 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e66783-6435-4e6e-961a-66d13918700b None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:43.252590 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-703232c3-fe22-492d-b83f-14d8b97627bc None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:43.254121 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-703232c3-fe22-492d-b83f-14d8b97627bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:43.324514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 183/366] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:43.326255 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703232c3-fe22-492d-b83f-14d8b97627bc None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:43.345252 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e66783-6435-4e6e-961a-66d13918700b None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:43.379657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab706a88-30d5-4f00-917a-33373596649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:43.380528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab706a88-30d5-4f00-917a-33373596649d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.380809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab706a88-30d5-4f00-917a-33373596649d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.381085 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab706a88-30d5-4f00-917a-33373596649d None admin] PATH_INFO: `/v3/users/1fd8bb1c3c7e4a358ba488f810d87a2f` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.382311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab706a88-30d5-4f00-917a-33373596649d None admin] RBAC: Authorizing `identity:get_user(user_id=1fd8bb1c3c7e4a358ba488f810d87a2f)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:43.383811 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab706a88-30d5-4f00-917a-33373596649d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:43.386185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 184/367] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:28:43 2022] GET /identity/v3/users/1fd8bb1c3c7e4a358ba488f810d87a2f => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:43.387055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab706a88-30d5-4f00-917a-33373596649d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:43.431890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703232c3-fe22-492d-b83f-14d8b97627bc None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:43.467399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0d031-3f3c-4bff-a450-492623179e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:43.468390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0d031-3f3c-4bff-a450-492623179e46 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.468863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0d031-3f3c-4bff-a450-492623179e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.469337 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0d031-3f3c-4bff-a450-492623179e46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.470417 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0d031-3f3c-4bff-a450-492623179e46 None admin] RBAC: Adding query filter params (group.id=2fc8514ec6ca4fd48bf6e23fcf094219, role.id=8f649e044d134d799d7bbaf6e0715e34, scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:43.470929 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0d031-3f3c-4bff-a450-492623179e46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:43.472597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0d031-3f3c-4bff-a450-492623179e46 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:43.478654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 184/368] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 5 15:28:43 2022] GET /identity/v3/role_assignments?group.id=2fc8514ec6ca4fd48bf6e23fcf094219&scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1&role.id=8f649e044d134d799d7bbaf6e0715e34 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:43.479897 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0d031-3f3c-4bff-a450-492623179e46 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:43.489577 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab706a88-30d5-4f00-917a-33373596649d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:43.527623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf5691-7589-4296-9bd0-b7e7a9853c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:43.528305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf5691-7589-4296-9bd0-b7e7a9853c8e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.528590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf5691-7589-4296-9bd0-b7e7a9853c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.528867 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf5691-7589-4296-9bd0-b7e7a9853c8e None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.529614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf5691-7589-4296-9bd0-b7e7a9853c8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:43.529909 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf5691-7589-4296-9bd0-b7e7a9853c8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:43.531318 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf5691-7589-4296-9bd0-b7e7a9853c8e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:43.541058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 185/369] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:28:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:43.542127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf5691-7589-4296-9bd0-b7e7a9853c8e None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:43.589538 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0d031-3f3c-4bff-a450-492623179e46 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:43.628114 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8149e-2697-4611-9ec8-cf5c4bc76407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:43.629302 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8149e-2697-4611-9ec8-cf5c4bc76407 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.629776 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8149e-2697-4611-9ec8-cf5c4bc76407 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.630291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8149e-2697-4611-9ec8-cf5c4bc76407 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.642368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8149e-2697-4611-9ec8-cf5c4bc76407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-aad8149e-2697-4611-9ec8-cf5c4bc76407 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:43.650693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:43.651810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:43.652585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:43.652585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:43.652585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:43.652585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:43.652585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:43.652585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:43.652585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:43.652585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:43.652585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:43.652585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:43.652585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:43.652585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:43.653185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf5691-7589-4296-9bd0-b7e7a9853c8e None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:43.655640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 185/370] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:43.656818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8149e-2697-4611-9ec8-cf5c4bc76407 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:43.687981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badda5ae-b91a-4fa1-893a-20d21c8be15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:43.688644 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badda5ae-b91a-4fa1-893a-20d21c8be15e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.688926 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badda5ae-b91a-4fa1-893a-20d21c8be15e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.689199 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badda5ae-b91a-4fa1-893a-20d21c8be15e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.690034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badda5ae-b91a-4fa1-893a-20d21c8be15e None admin] RBAC: Adding query filter params (role.id=a9790af349c74b43901af6f1113b6124, user.id=1fd8bb1c3c7e4a358ba488f810d87a2f, scope.system=all) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:43.690403 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badda5ae-b91a-4fa1-893a-20d21c8be15e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:43.691897 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badda5ae-b91a-4fa1-893a-20d21c8be15e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:43.705257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 186/371] 10.222.0.58 () {56 vars in 1308 bytes} [Thu May 5 15:28:43 2022] GET /identity/v3/role_assignments?user.id=1fd8bb1c3c7e4a358ba488f810d87a2f&scope.system=all&role.id=a9790af349c74b43901af6f1113b6124 => generated 510 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:43.706102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badda5ae-b91a-4fa1-893a-20d21c8be15e None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:43.768032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8149e-2697-4611-9ec8-cf5c4bc76407 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:43.811257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c94a41-02e8-45c6-9a46-a70ad9268de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:43.812487 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c94a41-02e8-45c6-9a46-a70ad9268de0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.813094 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c94a41-02e8-45c6-9a46-a70ad9268de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.813617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c94a41-02e8-45c6-9a46-a70ad9268de0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.818281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badda5ae-b91a-4fa1-893a-20d21c8be15e None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:43.857098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e0b4f-4f61-4765-bba7-18282028bb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:43.857778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e0b4f-4f61-4765-bba7-18282028bb15 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:43.858061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e0b4f-4f61-4765-bba7-18282028bb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:43.858370 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e0b4f-4f61-4765-bba7-18282028bb15 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:43.859135 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e0b4f-4f61-4765-bba7-18282028bb15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:43.859425 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e0b4f-4f61-4765-bba7-18282028bb15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:43.860798 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e0b4f-4f61-4765-bba7-18282028bb15 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:43.877954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 187/372] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:43.882505 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e0b4f-4f61-4765-bba7-18282028bb15 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:43.904177 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c94a41-02e8-45c6-9a46-a70ad9268de0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:43.905637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c94a41-02e8-45c6-9a46-a70ad9268de0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:44.015746 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 186/373] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:44.017854 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e0b4f-4f61-4765-bba7-18282028bb15 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:44.021300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c94a41-02e8-45c6-9a46-a70ad9268de0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:44.056887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1d1cc-deff-45b6-926b-10661e4f97c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:44.058656 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1d1cc-deff-45b6-926b-10661e4f97c5 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:44.059241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1d1cc-deff-45b6-926b-10661e4f97c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:44.059734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1d1cc-deff-45b6-926b-10661e4f97c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:44.140007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1d1cc-deff-45b6-926b-10661e4f97c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:44.141906 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1d1cc-deff-45b6-926b-10661e4f97c5 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:44.219654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c94a41-02e8-45c6-9a46-a70ad9268de0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:44.257663 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d5f4d-369c-4f5b-98e0-23a4de9c9c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:44.258603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d5f4d-369c-4f5b-98e0-23a4de9c9c1b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:44.258845 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d5f4d-369c-4f5b-98e0-23a4de9c9c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:44.259119 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d5f4d-369c-4f5b-98e0-23a4de9c9c1b None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:44.260318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d5f4d-369c-4f5b-98e0-23a4de9c9c1b None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:44.264364 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d5f4d-369c-4f5b-98e0-23a4de9c9c1b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:44.266440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 187/374] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:44 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:44.267741 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 188/375] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:28:44.273186 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d5f4d-369c-4f5b-98e0-23a4de9c9c1b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:44.274466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1d1cc-deff-45b6-926b-10661e4f97c5 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:44.429760 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d5f4d-369c-4f5b-98e0-23a4de9c9c1b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:44.451451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1d1cc-deff-45b6-926b-10661e4f97c5 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:44.498315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886217d-7572-43aa-b0a4-5e97fad8b8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:44.500085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886217d-7572-43aa-b0a4-5e97fad8b8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:44.500723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886217d-7572-43aa-b0a4-5e97fad8b8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:44.502621 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886217d-7572-43aa-b0a4-5e97fad8b8d3 None admin] PATH_INFO: `/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:44.505019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886217d-7572-43aa-b0a4-5e97fad8b8d3 None admin] RBAC: Authorizing `identity:get_group(group_id=2fc8514ec6ca4fd48bf6e23fcf094219)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:44.507568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886217d-7572-43aa-b0a4-5e97fad8b8d3 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:44.508426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89690399-1747-49d3-a526-29ca0953f06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:44.509513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89690399-1747-49d3-a526-29ca0953f06f None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:44.512267 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 188/376] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 5 15:28:44 2022] GET /identity/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:44.512797 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89690399-1747-49d3-a526-29ca0953f06f None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:44.513284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89690399-1747-49d3-a526-29ca0953f06f None admin] PATH_INFO: `/v3/projects/e901518e00104463a2aa36d4de393e28` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:44.514770 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89690399-1747-49d3-a526-29ca0953f06f None admin] RBAC: Authorizing `identity:get_project(project_id=e901518e00104463a2aa36d4de393e28)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:44.516724 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89690399-1747-49d3-a526-29ca0953f06f None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:44.519580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886217d-7572-43aa-b0a4-5e97fad8b8d3 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:44.526548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 189/377] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:44 2022] GET /identity/v3/projects/e901518e00104463a2aa36d4de393e28 => generated 344 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:44.543980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89690399-1747-49d3-a526-29ca0953f06f None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:44.657213 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886217d-7572-43aa-b0a4-5e97fad8b8d3 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:44.704817 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431935b1-954a-4bce-893b-1acff1747423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:44.705725 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431935b1-954a-4bce-893b-1acff1747423 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:44.706281 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431935b1-954a-4bce-893b-1acff1747423 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:44.706717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431935b1-954a-4bce-893b-1acff1747423 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:44.707693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431935b1-954a-4bce-893b-1acff1747423 None admin] RBAC: Adding query filter params (group.id=2fc8514ec6ca4fd48bf6e23fcf094219, role.id=8b51e457da8145c6995241d379986c7c, scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:44.708146 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431935b1-954a-4bce-893b-1acff1747423 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:44.709726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431935b1-954a-4bce-893b-1acff1747423 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:44.720463 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 189/378] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 5 15:28:44 2022] GET /identity/v3/role_assignments?group.id=2fc8514ec6ca4fd48bf6e23fcf094219&scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1&role.id=8b51e457da8145c6995241d379986c7c => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:44.747124 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89690399-1747-49d3-a526-29ca0953f06f None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:44.798237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed417d-3a2b-4acd-a7cc-6a6da84faa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:44.799413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed417d-3a2b-4acd-a7cc-6a6da84faa42 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:44.799843 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed417d-3a2b-4acd-a7cc-6a6da84faa42 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:44.800262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed417d-3a2b-4acd-a7cc-6a6da84faa42 None admin] PATH_INFO: `/v3/groups/f6e6e4af555240ca88427d1a1f12df39` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:44.809567 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed417d-3a2b-4acd-a7cc-6a6da84faa42 None admin] RBAC: Authorizing `identity:get_group(group_id=f6e6e4af555240ca88427d1a1f12df39)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:44.811310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed417d-3a2b-4acd-a7cc-6a6da84faa42 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:44.813218 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 190/379] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 5 15:28:44 2022] GET /identity/v3/groups/f6e6e4af555240ca88427d1a1f12df39 => generated 229 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:44.819372 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431935b1-954a-4bce-893b-1acff1747423 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:44.942043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431935b1-954a-4bce-893b-1acff1747423 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:44.980710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73951112-fe7e-4612-967d-28c32a11be74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:44.981592 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73951112-fe7e-4612-967d-28c32a11be74 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:44.982037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73951112-fe7e-4612-967d-28c32a11be74 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:44.982501 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73951112-fe7e-4612-967d-28c32a11be74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:44.983485 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73951112-fe7e-4612-967d-28c32a11be74 None admin] RBAC: Adding query filter params (group.id=f6e6e4af555240ca88427d1a1f12df39, role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=e901518e00104463a2aa36d4de393e28) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:44.983948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73951112-fe7e-4612-967d-28c32a11be74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:44.985524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73951112-fe7e-4612-967d-28c32a11be74 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:44.993865 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 190/380] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 5 15:28:44 2022] GET /identity/v3/role_assignments?group.id=f6e6e4af555240ca88427d1a1f12df39&scope.project.id=e901518e00104463a2aa36d4de393e28&role.id=70f81a43849a47f7bf393b354a46d048 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:45.116442 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992b587-343f-4d3c-b087-1f0f47bcab90 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:45.117114 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992b587-343f-4d3c-b087-1f0f47bcab90 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:45.117399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992b587-343f-4d3c-b087-1f0f47bcab90 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:45.119092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 191/381] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:45.125272 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be10862-ac00-4eaa-b85e-c1e1da5f1101 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:45.125567 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be10862-ac00-4eaa-b85e-c1e1da5f1101 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:45.125848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be10862-ac00-4eaa-b85e-c1e1da5f1101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:45.143214 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-0be10862-ac00-4eaa-b85e-c1e1da5f1101 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:45.144800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0be10862-ac00-4eaa-b85e-c1e1da5f1101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:45.220168 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 191/382] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:45.243678 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992b587-343f-4d3c-b087-1f0f47bcab90 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:45.357045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992b587-343f-4d3c-b087-1f0f47bcab90 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:45.392371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990d86b-293d-4943-8d24-eeea74152baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:45.393575 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990d86b-293d-4943-8d24-eeea74152baf None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:45.394071 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990d86b-293d-4943-8d24-eeea74152baf None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:45.394557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990d86b-293d-4943-8d24-eeea74152baf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:45.405320 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990d86b-293d-4943-8d24-eeea74152baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-5990d86b-293d-4943-8d24-eeea74152baf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:45.413360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:45.414274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:45.415061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:45.415061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:45.415061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:45.415061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:45.415061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:45.415061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:45.415061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:45.415061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:45.415061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:45.415061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:45.415061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:45.415061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:45.422211 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 192/383] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:45.424414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be10862-ac00-4eaa-b85e-c1e1da5f1101 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:45.575512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be10862-ac00-4eaa-b85e-c1e1da5f1101 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:45.619047 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87385c3-d755-41fc-8131-a64e4004a9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:45.619725 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87385c3-d755-41fc-8131-a64e4004a9ad None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:45.620569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87385c3-d755-41fc-8131-a64e4004a9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:45.620831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87385c3-d755-41fc-8131-a64e4004a9ad None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:45.621579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87385c3-d755-41fc-8131-a64e4004a9ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:45.621881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87385c3-d755-41fc-8131-a64e4004a9ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:45.623283 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87385c3-d755-41fc-8131-a64e4004a9ad None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:45.634940 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 192/384] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:45.640553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990d86b-293d-4943-8d24-eeea74152baf None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:45.789263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990d86b-293d-4943-8d24-eeea74152baf None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:45.830866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c59d1-fecf-4f4a-b5e9-90c5af2d41ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:45.831802 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c59d1-fecf-4f4a-b5e9-90c5af2d41ba None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:45.832082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c59d1-fecf-4f4a-b5e9-90c5af2d41ba None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:45.832357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c59d1-fecf-4f4a-b5e9-90c5af2d41ba None admin] PATH_INFO: `/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:45.833535 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c59d1-fecf-4f4a-b5e9-90c5af2d41ba None admin] RBAC: Authorizing `identity:get_group(group_id=2fc8514ec6ca4fd48bf6e23fcf094219)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:45.834976 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c59d1-fecf-4f4a-b5e9-90c5af2d41ba None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:45.836772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 193/385] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 5 15:28:45 2022] GET /identity/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:45.842998 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87385c3-d755-41fc-8131-a64e4004a9ad None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:45.977233 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87385c3-d755-41fc-8131-a64e4004a9ad None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:46.023856 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30393015-761f-40bc-82b1-1c265623980e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:46.025128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30393015-761f-40bc-82b1-1c265623980e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:46.025128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30393015-761f-40bc-82b1-1c265623980e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:46.025315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30393015-761f-40bc-82b1-1c265623980e None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:46.027741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30393015-761f-40bc-82b1-1c265623980e None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:46.029207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30393015-761f-40bc-82b1-1c265623980e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:46.031279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 193/386] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:45 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:46.036886 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c59d1-fecf-4f4a-b5e9-90c5af2d41ba None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:46.166224 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c59d1-fecf-4f4a-b5e9-90c5af2d41ba None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:46.210728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e64b5-70d6-4151-8924-27c17ab8a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:46.211610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e64b5-70d6-4151-8924-27c17ab8a684 None admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:46.211887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e64b5-70d6-4151-8924-27c17ab8a684 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:46.212158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e64b5-70d6-4151-8924-27c17ab8a684 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c/groups/2fc8514ec6ca4fd48bf6e23fcf094219/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:46.219611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e64b5-70d6-4151-8924-27c17ab8a684 None admin] RBAC: Authorizing `identity:create_grant(project_id=d19a556265e745c3a127579e6b3fed9c, group_id=2fc8514ec6ca4fd48bf6e23fcf094219, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:46.219611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e64b5-70d6-4151-8924-27c17ab8a684 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:46.223571 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b460055-05eb-4548-bf43-df26121fee70 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:46.224164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b460055-05eb-4548-bf43-df26121fee70 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:46.224463 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b460055-05eb-4548-bf43-df26121fee70 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:46.226981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 194/387] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:46.233384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba3d5c-a979-42e5-9b8f-ff69d782dc28 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:46.233723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba3d5c-a979-42e5-9b8f-ff69d782dc28 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:46.234628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba3d5c-a979-42e5-9b8f-ff69d782dc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:46.235485 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 194/388] 10.222.0.58 () {58 vars in 1442 bytes} [Thu May 5 15:28:46 2022] PUT /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c/groups/2fc8514ec6ca4fd48bf6e23fcf094219/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:46.267442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-53ba3d5c-a979-42e5-9b8f-ff69d782dc28 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:46.268786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-53ba3d5c-a979-42e5-9b8f-ff69d782dc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:46.359908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 195/389] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:46.396750 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e64b5-70d6-4151-8924-27c17ab8a684 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:46.540588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e64b5-70d6-4151-8924-27c17ab8a684 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:46.587773 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b4d4a-7e8b-4265-b7c2-57171f9c55ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:46.588598 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b4d4a-7e8b-4265-b7c2-57171f9c55ed None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:46.589437 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b4d4a-7e8b-4265-b7c2-57171f9c55ed None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:46.589714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b4d4a-7e8b-4265-b7c2-57171f9c55ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:46.603971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b4d4a-7e8b-4265-b7c2-57171f9c55ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-ac1b4d4a-7e8b-4265-b7c2-57171f9c55ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:46.612207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:46.613084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:46.613870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:46.613870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:46.613870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:46.613870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:46.613870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:46.613870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:46.613870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:46.613870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:46.613870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:46.613870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:46.613870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:46.613870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:46.613870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 195/390] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:28:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:46.619590 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba3d5c-a979-42e5-9b8f-ff69d782dc28 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:46.732957 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba3d5c-a979-42e5-9b8f-ff69d782dc28 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:46.769122 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad002a-259c-4e48-af5c-993eaede394e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:46.769717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad002a-259c-4e48-af5c-993eaede394e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:46.769992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad002a-259c-4e48-af5c-993eaede394e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:46.770295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad002a-259c-4e48-af5c-993eaede394e None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:46.771039 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad002a-259c-4e48-af5c-993eaede394e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:46.771335 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad002a-259c-4e48-af5c-993eaede394e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:46.772690 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad002a-259c-4e48-af5c-993eaede394e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:46.786008 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 196/391] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:28:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:46.787907 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b4d4a-7e8b-4265-b7c2-57171f9c55ed None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:46.890131 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b4d4a-7e8b-4265-b7c2-57171f9c55ed None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:46.924155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c90cff-dcf9-4832-b793-8cbf1609464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:46.925067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c90cff-dcf9-4832-b793-8cbf1609464c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:46.925348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c90cff-dcf9-4832-b793-8cbf1609464c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:46.925621 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c90cff-dcf9-4832-b793-8cbf1609464c None admin] PATH_INFO: `/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:46.926980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c90cff-dcf9-4832-b793-8cbf1609464c None admin] RBAC: Authorizing `identity:get_group(group_id=2fc8514ec6ca4fd48bf6e23fcf094219)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:46.930188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c90cff-dcf9-4832-b793-8cbf1609464c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:46.934158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 196/392] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 5 15:28:46 2022] GET /identity/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:46.936019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad002a-259c-4e48-af5c-993eaede394e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:47.037234 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad002a-259c-4e48-af5c-993eaede394e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:47.058874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92817c-b427-4a9c-923a-bd6680154887 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:47.059189 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92817c-b427-4a9c-923a-bd6680154887 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:47.059405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92817c-b427-4a9c-923a-bd6680154887 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:47.061180 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 197/393] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:47.066537 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e4eca-2cd3-42d1-99b2-abd2dd2c2558 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:47.066822 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e4eca-2cd3-42d1-99b2-abd2dd2c2558 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:47.067143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e4eca-2cd3-42d1-99b2-abd2dd2c2558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:47.097090 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-4c9e4eca-2cd3-42d1-99b2-abd2dd2c2558 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:47.098321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4c9e4eca-2cd3-42d1-99b2-abd2dd2c2558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:47.104008 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0baaabe-477e-4c39-9baa-c36d530846ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:47.105538 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0baaabe-477e-4c39-9baa-c36d530846ea None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:47.105796 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0baaabe-477e-4c39-9baa-c36d530846ea None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:47.106069 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0baaabe-477e-4c39-9baa-c36d530846ea None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:47.109060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0baaabe-477e-4c39-9baa-c36d530846ea None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:47.113272 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0baaabe-477e-4c39-9baa-c36d530846ea None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:47.113736 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 197/394] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:46 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:47.134213 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0baaabe-477e-4c39-9baa-c36d530846ea None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:47.192813 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 198/395] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:47.221812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e4eca-2cd3-42d1-99b2-abd2dd2c2558 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:47.255481 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0baaabe-477e-4c39-9baa-c36d530846ea None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:47.318897 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677f96f-af10-4e52-af28-c2eceef95689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:47.319804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677f96f-af10-4e52-af28-c2eceef95689 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:47.320092 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677f96f-af10-4e52-af28-c2eceef95689 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:47.320372 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677f96f-af10-4e52-af28-c2eceef95689 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c/groups/2fc8514ec6ca4fd48bf6e23fcf094219/roles/8b51e457da8145c6995241d379986c7c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:47.322920 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677f96f-af10-4e52-af28-c2eceef95689 None admin] RBAC: Authorizing `identity:create_grant(project_id=d19a556265e745c3a127579e6b3fed9c, group_id=2fc8514ec6ca4fd48bf6e23fcf094219, role_id=8b51e457da8145c6995241d379986c7c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:47.324514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677f96f-af10-4e52-af28-c2eceef95689 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:47.335665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e4eca-2cd3-42d1-99b2-abd2dd2c2558 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:47.356960 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 198/396] 10.222.0.58 () {58 vars in 1442 bytes} [Thu May 5 15:28:47 2022] PUT /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c/groups/2fc8514ec6ca4fd48bf6e23fcf094219/roles/8b51e457da8145c6995241d379986c7c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:28:47.386524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1924c-2e75-484c-afb3-49ecbebd62e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:47.387710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1924c-2e75-484c-afb3-49ecbebd62e6 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:47.388126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1924c-2e75-484c-afb3-49ecbebd62e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:47.388532 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1924c-2e75-484c-afb3-49ecbebd62e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:47.407283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1924c-2e75-484c-afb3-49ecbebd62e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-fca1924c-2e75-484c-afb3-49ecbebd62e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:47.415175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:47.416157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:47.417510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:47.417510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:47.417510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:47.417510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:47.417510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:47.417510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:47.417510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:47.417510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:47.417510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:47.417510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:47.417510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:47.417510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:47.422304 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 199/397] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:47.425183 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677f96f-af10-4e52-af28-c2eceef95689 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:47.543848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677f96f-af10-4e52-af28-c2eceef95689 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:47.587148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd873f-39b0-4049-b30e-c204fb6e6d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:47.587761 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd873f-39b0-4049-b30e-c204fb6e6d22 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:47.588043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd873f-39b0-4049-b30e-c204fb6e6d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:47.588317 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd873f-39b0-4049-b30e-c204fb6e6d22 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:47.589308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd873f-39b0-4049-b30e-c204fb6e6d22 None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:47.589568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd873f-39b0-4049-b30e-c204fb6e6d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:47.590881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd873f-39b0-4049-b30e-c204fb6e6d22 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:47.602614 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 199/398] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:47.609116 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1924c-2e75-484c-afb3-49ecbebd62e6 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:47.733720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1924c-2e75-484c-afb3-49ecbebd62e6 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:47.778042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d74a82-1435-4a61-bc49-085a5d6c3d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:47.779178 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d74a82-1435-4a61-bc49-085a5d6c3d2a None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:47.779609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d74a82-1435-4a61-bc49-085a5d6c3d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:47.780027 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d74a82-1435-4a61-bc49-085a5d6c3d2a None admin] PATH_INFO: `/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:47.782881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d74a82-1435-4a61-bc49-085a5d6c3d2a None admin] RBAC: Authorizing `identity:get_group(group_id=2fc8514ec6ca4fd48bf6e23fcf094219)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:47.784522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d74a82-1435-4a61-bc49-085a5d6c3d2a None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:47.786868 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 200/399] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 5 15:28:47 2022] GET /identity/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:47.792212 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd873f-39b0-4049-b30e-c204fb6e6d22 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:47.894219 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef4eaf-f0b4-487c-a8e7-73c77d9e93e5 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:47.895164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef4eaf-f0b4-487c-a8e7-73c77d9e93e5 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:47.895611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef4eaf-f0b4-487c-a8e7-73c77d9e93e5 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:47.897169 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 201/400] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:47.902569 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9283ea-b408-48e8-9612-341ac33598ed None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:47.902853 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9283ea-b408-48e8-9612-341ac33598ed None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:47.903129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9283ea-b408-48e8-9612-341ac33598ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:47.914624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd873f-39b0-4049-b30e-c204fb6e6d22 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:47.930624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-5d9283ea-b408-48e8-9612-341ac33598ed None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:47.931826 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-5d9283ea-b408-48e8-9612-341ac33598ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:47.961052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adbff0-0d1f-4182-b3d7-12b590d1043a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:47.962427 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adbff0-0d1f-4182-b3d7-12b590d1043a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:47.963416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adbff0-0d1f-4182-b3d7-12b590d1043a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:47.964429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adbff0-0d1f-4182-b3d7-12b590d1043a None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:47.966913 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adbff0-0d1f-4182-b3d7-12b590d1043a None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:47.968359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adbff0-0d1f-4182-b3d7-12b590d1043a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:47.980391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 200/401] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:47 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:47.994574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adbff0-0d1f-4182-b3d7-12b590d1043a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:48.065525 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 202/402] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:48.106913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9283ea-b408-48e8-9612-341ac33598ed None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:48.162252 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adbff0-0d1f-4182-b3d7-12b590d1043a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:48.236419 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1789c49-2687-414a-b75d-03636b26812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:48.237073 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1789c49-2687-414a-b75d-03636b26812f None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:48.237355 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1789c49-2687-414a-b75d-03636b26812f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:48.237627 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1789c49-2687-414a-b75d-03636b26812f None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1/groups/2fc8514ec6ca4fd48bf6e23fcf094219/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:48.243111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9283ea-b408-48e8-9612-341ac33598ed None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:48.243469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1789c49-2687-414a-b75d-03636b26812f None admin] RBAC: Authorizing `identity:create_grant(project_id=b9d3917487e44e1a84cc0b98cfb33cb1, group_id=2fc8514ec6ca4fd48bf6e23fcf094219, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:48.245090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1789c49-2687-414a-b75d-03636b26812f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:48.283349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 201/403] 10.222.0.58 () {58 vars in 1442 bytes} [Thu May 5 15:28:47 2022] PUT /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1/groups/2fc8514ec6ca4fd48bf6e23fcf094219/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:28:48.284894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3daa1-f5d7-4838-adcc-fe7e8811db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:48.285970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3daa1-f5d7-4838-adcc-fe7e8811db0b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:48.286512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3daa1-f5d7-4838-adcc-fe7e8811db0b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:48.286992 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3daa1-f5d7-4838-adcc-fe7e8811db0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:48.300504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3daa1-f5d7-4838-adcc-fe7e8811db0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-42d3daa1-f5d7-4838-adcc-fe7e8811db0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:48.310400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:48.311375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:48.312164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:48.312164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:48.312164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:48.312164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:48.312164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:48.312164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:48.312164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:48.312164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:48.312164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:48.312164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:48.312164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:48.312164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:48.316220 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 203/404] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:28:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:28:48.321930 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1789c49-2687-414a-b75d-03636b26812f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:48.442736 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1789c49-2687-414a-b75d-03636b26812f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:48.479929 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397ad4d-469c-47c9-ab0b-e1f71b92a682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:48.481016 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397ad4d-469c-47c9-ab0b-e1f71b92a682 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:48.481520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397ad4d-469c-47c9-ab0b-e1f71b92a682 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:48.481996 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397ad4d-469c-47c9-ab0b-e1f71b92a682 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:48.483017 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397ad4d-469c-47c9-ab0b-e1f71b92a682 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:48.483588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397ad4d-469c-47c9-ab0b-e1f71b92a682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:48.485170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397ad4d-469c-47c9-ab0b-e1f71b92a682 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:48.494413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 202/405] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:28:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:48.503293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3daa1-f5d7-4838-adcc-fe7e8811db0b None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:48.622929 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bf97b-dbd7-42e0-8fe2-f4e36cb8c7d0 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:48.623259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bf97b-dbd7-42e0-8fe2-f4e36cb8c7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:48.623487 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bf97b-dbd7-42e0-8fe2-f4e36cb8c7d0 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:48.625034 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 203/406] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:48.630487 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd8656-f57b-44b9-a5e0-318154816a33 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:48.630764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd8656-f57b-44b9-a5e0-318154816a33 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:48.631036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd8656-f57b-44b9-a5e0-318154816a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:48.646669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3daa1-f5d7-4838-adcc-fe7e8811db0b None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:48.659200 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-1dfd8656-f57b-44b9-a5e0-318154816a33 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:48.660416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-1dfd8656-f57b-44b9-a5e0-318154816a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:48.700083 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac24c79-89e5-43d0-9dfc-c0c524ca5f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:48.701311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac24c79-89e5-43d0-9dfc-c0c524ca5f67 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:48.701778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac24c79-89e5-43d0-9dfc-c0c524ca5f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:48.702268 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac24c79-89e5-43d0-9dfc-c0c524ca5f67 None admin] PATH_INFO: `/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:48.704655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac24c79-89e5-43d0-9dfc-c0c524ca5f67 None admin] RBAC: Authorizing `identity:get_group(group_id=2fc8514ec6ca4fd48bf6e23fcf094219)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:48.708500 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac24c79-89e5-43d0-9dfc-c0c524ca5f67 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:48.711205 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 204/407] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 5 15:28:48 2022] GET /identity/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:48.717622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac24c79-89e5-43d0-9dfc-c0c524ca5f67 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:48.751183 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 204/408] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:48.775466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd8656-f57b-44b9-a5e0-318154816a33 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:48.884763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac24c79-89e5-43d0-9dfc-c0c524ca5f67 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:48.951868 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995bb86-7786-4c04-a1e4-abcf09629a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:48.952730 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995bb86-7786-4c04-a1e4-abcf09629a30 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:48.952916 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995bb86-7786-4c04-a1e4-abcf09629a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:48.953188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995bb86-7786-4c04-a1e4-abcf09629a30 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:48.954664 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995bb86-7786-4c04-a1e4-abcf09629a30 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:48.956159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995bb86-7786-4c04-a1e4-abcf09629a30 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:48.959798 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd8656-f57b-44b9-a5e0-318154816a33 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:48.961688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 205/409] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:48 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:48.964287 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995bb86-7786-4c04-a1e4-abcf09629a30 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:49.032082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26102b5-7a47-41a3-9229-88e0b71a9c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:49.032881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26102b5-7a47-41a3-9229-88e0b71a9c47 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:49.033149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26102b5-7a47-41a3-9229-88e0b71a9c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:49.033924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26102b5-7a47-41a3-9229-88e0b71a9c47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:49.056703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26102b5-7a47-41a3-9229-88e0b71a9c47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-c26102b5-7a47-41a3-9229-88e0b71a9c47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:49.066899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:49.067864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:49.068658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:49.068658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:49.068658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:49.068658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:49.068658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:49.068658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:49.068658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:49.068658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:49.068658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:49.068658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:49.068658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:49.068658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:49.071763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 205/410] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:28:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:49.078766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26102b5-7a47-41a3-9229-88e0b71a9c47 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:49.200082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26102b5-7a47-41a3-9229-88e0b71a9c47 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:49.200680 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995bb86-7786-4c04-a1e4-abcf09629a30 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:49.245240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa21a9f-8744-4d73-ad9a-bc3aa65a801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:49.246448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa21a9f-8744-4d73-ad9a-bc3aa65a801c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:49.246931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa21a9f-8744-4d73-ad9a-bc3aa65a801c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:49.247414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa21a9f-8744-4d73-ad9a-bc3aa65a801c None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:49.248360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa21a9f-8744-4d73-ad9a-bc3aa65a801c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:49.250187 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa21a9f-8744-4d73-ad9a-bc3aa65a801c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:49.251763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa21a9f-8744-4d73-ad9a-bc3aa65a801c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:49.272804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 206/411] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:49.276371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794337b9-9f24-4024-9ea0-915385a9b2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:49.277662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa21a9f-8744-4d73-ad9a-bc3aa65a801c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:49.279575 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794337b9-9f24-4024-9ea0-915385a9b2c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:49.282030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794337b9-9f24-4024-9ea0-915385a9b2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:49.282538 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794337b9-9f24-4024-9ea0-915385a9b2c5 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1/groups/2fc8514ec6ca4fd48bf6e23fcf094219/roles/8b51e457da8145c6995241d379986c7c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:49.288492 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794337b9-9f24-4024-9ea0-915385a9b2c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9d3917487e44e1a84cc0b98cfb33cb1, group_id=2fc8514ec6ca4fd48bf6e23fcf094219, role_id=8b51e457da8145c6995241d379986c7c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:49.290206 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794337b9-9f24-4024-9ea0-915385a9b2c5 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:49.317462 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 206/412] 10.222.0.58 () {58 vars in 1442 bytes} [Thu May 5 15:28:48 2022] PUT /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1/groups/2fc8514ec6ca4fd48bf6e23fcf094219/roles/8b51e457da8145c6995241d379986c7c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:49.318823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab0784-53e6-43f0-bdb8-20e89f34e301 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:49.319172 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab0784-53e6-43f0-bdb8-20e89f34e301 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:49.319503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab0784-53e6-43f0-bdb8-20e89f34e301 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:49.321026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 207/413] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:49.328769 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5079f1e-8fdf-4109-b311-6336a722c4c4 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:49.329246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5079f1e-8fdf-4109-b311-6336a722c4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:49.329740 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5079f1e-8fdf-4109-b311-6336a722c4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:49.365542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-c5079f1e-8fdf-4109-b311-6336a722c4c4 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:49.367278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c5079f1e-8fdf-4109-b311-6336a722c4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:49.456028 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 208/414] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:49.489577 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5079f1e-8fdf-4109-b311-6336a722c4c4 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:49.532176 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa21a9f-8744-4d73-ad9a-bc3aa65a801c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:49.592922 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f27da-04d5-4131-9d6a-8cf70d1393e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:49.593795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f27da-04d5-4131-9d6a-8cf70d1393e1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:49.594071 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f27da-04d5-4131-9d6a-8cf70d1393e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:49.594367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f27da-04d5-4131-9d6a-8cf70d1393e1 None admin] PATH_INFO: `/v3/groups/f6e6e4af555240ca88427d1a1f12df39` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:49.599248 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f27da-04d5-4131-9d6a-8cf70d1393e1 None admin] RBAC: Authorizing `identity:get_group(group_id=f6e6e4af555240ca88427d1a1f12df39)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:49.600715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f27da-04d5-4131-9d6a-8cf70d1393e1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:49.602712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 207/415] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 5 15:28:49 2022] GET /identity/v3/groups/f6e6e4af555240ca88427d1a1f12df39 => generated 229 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:49.607441 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5079f1e-8fdf-4109-b311-6336a722c4c4 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:49.608937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f27da-04d5-4131-9d6a-8cf70d1393e1 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:49.645250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a5c22-f51d-43f8-813b-8261dd21777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:49.646108 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a5c22-f51d-43f8-813b-8261dd21777c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:49.647233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a5c22-f51d-43f8-813b-8261dd21777c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:49.647583 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a5c22-f51d-43f8-813b-8261dd21777c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:49.662095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a5c22-f51d-43f8-813b-8261dd21777c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-b39a5c22-f51d-43f8-813b-8261dd21777c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:49.672560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:49.673563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:49.674405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:49.674405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:49.674405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:49.674405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:49.674405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:49.674405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:49.674405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:49.674405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:49.674405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:49.674405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:49.674405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:49.674405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:49.675711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 209/416] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:49.681498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a5c22-f51d-43f8-813b-8261dd21777c None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:49.721605 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f27da-04d5-4131-9d6a-8cf70d1393e1 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:49.760991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb8f8d-fbf1-4d4e-b591-e3ce805ad2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:49.762700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb8f8d-fbf1-4d4e-b591-e3ce805ad2cc None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:49.763325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb8f8d-fbf1-4d4e-b591-e3ce805ad2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:49.763784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb8f8d-fbf1-4d4e-b591-e3ce805ad2cc None admin] PATH_INFO: `/v3/projects/e901518e00104463a2aa36d4de393e28` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:49.765737 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb8f8d-fbf1-4d4e-b591-e3ce805ad2cc None admin] RBAC: Authorizing `identity:get_project(project_id=e901518e00104463a2aa36d4de393e28)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:49.767537 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb8f8d-fbf1-4d4e-b591-e3ce805ad2cc None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:49.770328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 208/417] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:49 2022] GET /identity/v3/projects/e901518e00104463a2aa36d4de393e28 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:49.777864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb8f8d-fbf1-4d4e-b591-e3ce805ad2cc None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:49.806073 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a5c22-f51d-43f8-813b-8261dd21777c None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:49.839895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375f300-5280-4dee-a8b8-36352bba2eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:49.840653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375f300-5280-4dee-a8b8-36352bba2eeb None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:49.841012 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375f300-5280-4dee-a8b8-36352bba2eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:49.841291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375f300-5280-4dee-a8b8-36352bba2eeb None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:49.842060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375f300-5280-4dee-a8b8-36352bba2eeb None admin] RBAC: Adding query filter params (name=member) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:49.842404 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375f300-5280-4dee-a8b8-36352bba2eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:49.843849 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375f300-5280-4dee-a8b8-36352bba2eeb None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:49.852753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 210/418] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:49.859056 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375f300-5280-4dee-a8b8-36352bba2eeb None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:49.894560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb8f8d-fbf1-4d4e-b591-e3ce805ad2cc None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:49.960707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375f300-5280-4dee-a8b8-36352bba2eeb None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:49.983788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786ce9b-4924-4d9f-b96d-9ac226f52588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:49.984678 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786ce9b-4924-4d9f-b96d-9ac226f52588 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:49.984959 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786ce9b-4924-4d9f-b96d-9ac226f52588 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:49.985235 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786ce9b-4924-4d9f-b96d-9ac226f52588 None admin] PATH_INFO: `/v3/projects/e901518e00104463a2aa36d4de393e28/groups/f6e6e4af555240ca88427d1a1f12df39/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:49.991531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786ce9b-4924-4d9f-b96d-9ac226f52588 None admin] RBAC: Authorizing `identity:create_grant(project_id=e901518e00104463a2aa36d4de393e28, group_id=f6e6e4af555240ca88427d1a1f12df39, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:49.992986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786ce9b-4924-4d9f-b96d-9ac226f52588 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:49.995796 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc380b3-906e-4ca7-8df8-71a084629d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:49.996442 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc380b3-906e-4ca7-8df8-71a084629d6b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:49.996720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc380b3-906e-4ca7-8df8-71a084629d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:49.997138 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc380b3-906e-4ca7-8df8-71a084629d6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:50.020666 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 209/419] 10.222.0.58 () {58 vars in 1442 bytes} [Thu May 5 15:28:49 2022] PUT /identity/v3/projects/e901518e00104463a2aa36d4de393e28/groups/f6e6e4af555240ca88427d1a1f12df39/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:28:50.085451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc380b3-906e-4ca7-8df8-71a084629d6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:50.086947 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc380b3-906e-4ca7-8df8-71a084629d6b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:50.196735 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 211/420] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:28:50.203179 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786ce9b-4924-4d9f-b96d-9ac226f52588 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:50.324967 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786ce9b-4924-4d9f-b96d-9ac226f52588 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:50.361643 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a07e1-47e4-424a-9cff-f28a9e31de0f None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:50.362038 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a07e1-47e4-424a-9cff-f28a9e31de0f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:50.362436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a07e1-47e4-424a-9cff-f28a9e31de0f None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:50.363277 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0525f7-8d9e-4ac8-b1b9-9e176ddba994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:50.364060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 212/421] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:50.364233 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0525f7-8d9e-4ac8-b1b9-9e176ddba994 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:50.364483 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0525f7-8d9e-4ac8-b1b9-9e176ddba994 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:50.364758 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0525f7-8d9e-4ac8-b1b9-9e176ddba994 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:50.365971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0525f7-8d9e-4ac8-b1b9-9e176ddba994 None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:50.367534 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0525f7-8d9e-4ac8-b1b9-9e176ddba994 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:50.371303 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 210/422] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:50 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:50.376346 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff347eb-3b64-436c-a54e-2333c09d0bd9 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:50.376634 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff347eb-3b64-436c-a54e-2333c09d0bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:50.376912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff347eb-3b64-436c-a54e-2333c09d0bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:50.379158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0525f7-8d9e-4ac8-b1b9-9e176ddba994 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:50.398112 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-aff347eb-3b64-436c-a54e-2333c09d0bd9 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:50.399772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-aff347eb-3b64-436c-a54e-2333c09d0bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:50.509001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0525f7-8d9e-4ac8-b1b9-9e176ddba994 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:50.512840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 213/423] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:50.529608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff347eb-3b64-436c-a54e-2333c09d0bd9 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:50.577220 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a08b0a-4f51-498d-946b-b8a8d716996a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:50.578003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a08b0a-4f51-498d-946b-b8a8d716996a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:50.578306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a08b0a-4f51-498d-946b-b8a8d716996a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:50.578582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a08b0a-4f51-498d-946b-b8a8d716996a None admin] PATH_INFO: `/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:50.579867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a08b0a-4f51-498d-946b-b8a8d716996a None admin] RBAC: Authorizing `identity:get_group(group_id=2fc8514ec6ca4fd48bf6e23fcf094219)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:50.581287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a08b0a-4f51-498d-946b-b8a8d716996a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:50.586258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 211/424] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 5 15:28:50 2022] GET /identity/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:50.589824 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a08b0a-4f51-498d-946b-b8a8d716996a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:50.697799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff347eb-3b64-436c-a54e-2333c09d0bd9 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:50.762409 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aba298-b1d8-42ed-a2ba-9c01da7d9fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:50.763210 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aba298-b1d8-42ed-a2ba-9c01da7d9fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:50.763488 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aba298-b1d8-42ed-a2ba-9c01da7d9fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:50.763757 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aba298-b1d8-42ed-a2ba-9c01da7d9fe8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:50.765954 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a08b0a-4f51-498d-946b-b8a8d716996a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:50.786086 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aba298-b1d8-42ed-a2ba-9c01da7d9fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-15aba298-b1d8-42ed-a2ba-9c01da7d9fe8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:50.794812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:50.795848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:50.796627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:50.796627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:50.796627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:50.796627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:50.796627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:50.796627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:50.796627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:50.796627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:50.796627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:50.796627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:50.796627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:50.796627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:50.797699 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 214/425] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:28:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:28:50.805390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aba298-b1d8-42ed-a2ba-9c01da7d9fe8 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:50.841026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100e8c8-6eea-4f62-a59b-dee3a07c17a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:50.841602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e8c8-6eea-4f62-a59b-dee3a07c17a4 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:50.841878 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e8c8-6eea-4f62-a59b-dee3a07c17a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:50.842148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100e8c8-6eea-4f62-a59b-dee3a07c17a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:50.842999 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100e8c8-6eea-4f62-a59b-dee3a07c17a4 None admin] RBAC: Adding query filter params (group.id=2fc8514ec6ca4fd48bf6e23fcf094219, role.id=8f649e044d134d799d7bbaf6e0715e34, scope.project.id=d19a556265e745c3a127579e6b3fed9c) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:50.843305 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100e8c8-6eea-4f62-a59b-dee3a07c17a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:50.844720 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100e8c8-6eea-4f62-a59b-dee3a07c17a4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:50.859529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 212/426] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 5 15:28:50 2022] GET /identity/v3/role_assignments?group.id=2fc8514ec6ca4fd48bf6e23fcf094219&scope.project.id=d19a556265e745c3a127579e6b3fed9c&role.id=8f649e044d134d799d7bbaf6e0715e34 => generated 611 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:50.983249 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aba298-b1d8-42ed-a2ba-9c01da7d9fe8 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:51.036155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3ce0f-5ee4-4efa-bc10-1638838477e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:51.036831 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3ce0f-5ee4-4efa-bc10-1638838477e7 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:51.037120 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3ce0f-5ee4-4efa-bc10-1638838477e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:51.037399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3ce0f-5ee4-4efa-bc10-1638838477e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:51.038151 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3ce0f-5ee4-4efa-bc10-1638838477e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:51.038483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3ce0f-5ee4-4efa-bc10-1638838477e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:51.039857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3ce0f-5ee4-4efa-bc10-1638838477e7 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:51.054040 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 215/427] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:28:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:51.060289 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100e8c8-6eea-4f62-a59b-dee3a07c17a4 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:51.196609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100e8c8-6eea-4f62-a59b-dee3a07c17a4 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:51.232733 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8e21c-69ab-4412-addd-21618e2a165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:51.233384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8e21c-69ab-4412-addd-21618e2a165f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:51.233667 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8e21c-69ab-4412-addd-21618e2a165f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:51.233939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8e21c-69ab-4412-addd-21618e2a165f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:51.303931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8e21c-69ab-4412-addd-21618e2a165f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:51.305442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8e21c-69ab-4412-addd-21618e2a165f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:51.430562 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 213/428] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:51.434400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3ce0f-5ee4-4efa-bc10-1638838477e7 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:51.539970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64911e77-3048-45ca-adc6-7cc01f0c87ee None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:51.540308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64911e77-3048-45ca-adc6-7cc01f0c87ee None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:51.540523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64911e77-3048-45ca-adc6-7cc01f0c87ee None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:51.542659 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 214/429] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:51.548543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7bf58-0485-4741-99a5-327a26f9386a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:51.548832 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7bf58-0485-4741-99a5-327a26f9386a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:51.549114 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7bf58-0485-4741-99a5-327a26f9386a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:51.559937 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3ce0f-5ee4-4efa-bc10-1638838477e7 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:51.568963 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-57e7bf58-0485-4741-99a5-327a26f9386a None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:51.570265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-57e7bf58-0485-4741-99a5-327a26f9386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:51.601219 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61baa1-7114-4391-85fb-2d538afb5194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:51.602083 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61baa1-7114-4391-85fb-2d538afb5194 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:51.603231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61baa1-7114-4391-85fb-2d538afb5194 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:51.603399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61baa1-7114-4391-85fb-2d538afb5194 None admin] PATH_INFO: `/v3/projects/d19a556265e745c3a127579e6b3fed9c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:51.606063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61baa1-7114-4391-85fb-2d538afb5194 None admin] RBAC: Authorizing `identity:get_project(project_id=d19a556265e745c3a127579e6b3fed9c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:51.607532 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61baa1-7114-4391-85fb-2d538afb5194 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:51.609781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 216/430] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:51 2022] GET /identity/v3/projects/d19a556265e745c3a127579e6b3fed9c => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:51.615002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61baa1-7114-4391-85fb-2d538afb5194 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:51.657332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 215/431] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:51.685448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7bf58-0485-4741-99a5-327a26f9386a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:51.718741 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61baa1-7114-4391-85fb-2d538afb5194 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:51.753076 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e12d6c-0a46-4b8d-836c-3935fd53bac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:51.754246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e12d6c-0a46-4b8d-836c-3935fd53bac3 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:51.754689 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e12d6c-0a46-4b8d-836c-3935fd53bac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:51.755128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e12d6c-0a46-4b8d-836c-3935fd53bac3 None admin] PATH_INFO: `/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:51.756450 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e12d6c-0a46-4b8d-836c-3935fd53bac3 None admin] RBAC: Authorizing `identity:get_group(group_id=2fc8514ec6ca4fd48bf6e23fcf094219)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:51.758125 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e12d6c-0a46-4b8d-836c-3935fd53bac3 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:51.760231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 217/432] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 5 15:28:51 2022] GET /identity/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:51.769250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e12d6c-0a46-4b8d-836c-3935fd53bac3 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:51.806316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7bf58-0485-4741-99a5-327a26f9386a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:51.849977 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0206f31-4f2a-4599-8400-0294e7ad506c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:51.851228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0206f31-4f2a-4599-8400-0294e7ad506c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:51.851228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0206f31-4f2a-4599-8400-0294e7ad506c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:51.851377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0206f31-4f2a-4599-8400-0294e7ad506c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:51.864430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0206f31-4f2a-4599-8400-0294e7ad506c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-f0206f31-4f2a-4599-8400-0294e7ad506c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:51.875020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:51.876128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:51.877056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:51.877056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:51.877056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:51.877056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:51.877056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:51.877056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:51.877056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:51.877056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:51.877056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:51.877056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:51.877056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 05 15:28:51.877056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:51.877056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 216/433] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:51.882297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0206f31-4f2a-4599-8400-0294e7ad506c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:51.887332 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e12d6c-0a46-4b8d-836c-3935fd53bac3 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:51.922528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be8ee9-70ed-4c1d-8239-dd95ca869254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:51.923553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be8ee9-70ed-4c1d-8239-dd95ca869254 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:51.924003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be8ee9-70ed-4c1d-8239-dd95ca869254 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:51.924443 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be8ee9-70ed-4c1d-8239-dd95ca869254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:51.925516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be8ee9-70ed-4c1d-8239-dd95ca869254 None admin] RBAC: Adding query filter params (group.id=2fc8514ec6ca4fd48bf6e23fcf094219, role.id=8b51e457da8145c6995241d379986c7c, scope.project.id=d19a556265e745c3a127579e6b3fed9c) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:51.926023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be8ee9-70ed-4c1d-8239-dd95ca869254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:51.927766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be8ee9-70ed-4c1d-8239-dd95ca869254 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:51.936287 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 218/434] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 5 15:28:51 2022] GET /identity/v3/role_assignments?group.id=2fc8514ec6ca4fd48bf6e23fcf094219&scope.project.id=d19a556265e745c3a127579e6b3fed9c&role.id=8b51e457da8145c6995241d379986c7c => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:52.011770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0206f31-4f2a-4599-8400-0294e7ad506c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:52.054922 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a064e49-8804-46e9-9a9a-7cc133a4d26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:52.055529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a064e49-8804-46e9-9a9a-7cc133a4d26d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:52.055815 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a064e49-8804-46e9-9a9a-7cc133a4d26d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:52.056092 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a064e49-8804-46e9-9a9a-7cc133a4d26d None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:52.056923 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a064e49-8804-46e9-9a9a-7cc133a4d26d None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:52.057333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a064e49-8804-46e9-9a9a-7cc133a4d26d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:52.059531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a064e49-8804-46e9-9a9a-7cc133a4d26d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:52.074623 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 217/435] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:28:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:52.077436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be8ee9-70ed-4c1d-8239-dd95ca869254 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:52.144329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3044ca-cf68-43c2-a2cc-2701d3ed411e None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:52.144654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3044ca-cf68-43c2-a2cc-2701d3ed411e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:52.144965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3044ca-cf68-43c2-a2cc-2701d3ed411e None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:52.146714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 218/436] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:52.152064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cad4b-79d8-4dec-9145-6130a5057476 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:52.152356 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cad4b-79d8-4dec-9145-6130a5057476 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:52.152653 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cad4b-79d8-4dec-9145-6130a5057476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:52.175694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-328cad4b-79d8-4dec-9145-6130a5057476 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:52.176878 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-328cad4b-79d8-4dec-9145-6130a5057476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:52.217594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be8ee9-70ed-4c1d-8239-dd95ca869254 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:52.260814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99525c-f801-4739-8ed1-72ce024c3b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:52.260814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99525c-f801-4739-8ed1-72ce024c3b7f None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:52.260814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99525c-f801-4739-8ed1-72ce024c3b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:52.260814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99525c-f801-4739-8ed1-72ce024c3b7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:52.271011 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 219/437] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:52.295980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cad4b-79d8-4dec-9145-6130a5057476 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:52.337112 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99525c-f801-4739-8ed1-72ce024c3b7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:52.339210 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99525c-f801-4739-8ed1-72ce024c3b7f None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:52.398695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cad4b-79d8-4dec-9145-6130a5057476 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:52.435291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7779e12-0252-4667-8413-9c4006d62682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:52.436106 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7779e12-0252-4667-8413-9c4006d62682 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:52.436383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7779e12-0252-4667-8413-9c4006d62682 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:52.436652 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7779e12-0252-4667-8413-9c4006d62682 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:52.450425 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 219/438] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:28:52.454374 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7779e12-0252-4667-8413-9c4006d62682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:52.454886 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99525c-f801-4739-8ed1-72ce024c3b7f None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-e7779e12-0252-4667-8413-9c4006d62682 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:52.462887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:52.464484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:52.465251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:52.465251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:52.465251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:52.465251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:52.465251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:52.465251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:52.465251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:52.465251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:52.465251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:52.465251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:52.465251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:52.465251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:52.466245 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 220/439] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:28:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:28:52.474221 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7779e12-0252-4667-8413-9c4006d62682 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:52.565429 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99525c-f801-4739-8ed1-72ce024c3b7f None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:52.579953 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7779e12-0252-4667-8413-9c4006d62682 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:52.599974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a08d9b-b3df-4377-a887-79aef8d63517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:52.600766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a08d9b-b3df-4377-a887-79aef8d63517 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:52.601044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a08d9b-b3df-4377-a887-79aef8d63517 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:52.601327 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a08d9b-b3df-4377-a887-79aef8d63517 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:52.602721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a08d9b-b3df-4377-a887-79aef8d63517 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:52.604303 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a08d9b-b3df-4377-a887-79aef8d63517 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:52.606202 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 220/440] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:52 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:52.611903 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a08d9b-b3df-4377-a887-79aef8d63517 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:52.617572 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424d7b2-d834-4f2a-bfe8-9f555c0bf6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:52.618289 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424d7b2-d834-4f2a-bfe8-9f555c0bf6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:52.618577 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424d7b2-d834-4f2a-bfe8-9f555c0bf6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:52.618855 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424d7b2-d834-4f2a-bfe8-9f555c0bf6e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:52.619618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424d7b2-d834-4f2a-bfe8-9f555c0bf6e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:52.620458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424d7b2-d834-4f2a-bfe8-9f555c0bf6e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:52.621979 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424d7b2-d834-4f2a-bfe8-9f555c0bf6e5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:52.631747 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 221/441] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:28:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:52.637780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424d7b2-d834-4f2a-bfe8-9f555c0bf6e5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:52.710377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a08d9b-b3df-4377-a887-79aef8d63517 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:52.737782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424d7b2-d834-4f2a-bfe8-9f555c0bf6e5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:52.742845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664f11-7cee-44bc-a508-120435257c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:52.743695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664f11-7cee-44bc-a508-120435257c2d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:52.743975 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664f11-7cee-44bc-a508-120435257c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:52.744243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664f11-7cee-44bc-a508-120435257c2d None admin] PATH_INFO: `/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:52.745749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664f11-7cee-44bc-a508-120435257c2d None admin] RBAC: Authorizing `identity:get_group(group_id=2fc8514ec6ca4fd48bf6e23fcf094219)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:52.747336 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664f11-7cee-44bc-a508-120435257c2d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:52.753584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 221/442] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 5 15:28:52 2022] GET /identity/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:52.754546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664f11-7cee-44bc-a508-120435257c2d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:52.775199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb77cf-9d5c-42b9-9091-850daaca0da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:52.775846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb77cf-9d5c-42b9-9091-850daaca0da4 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:52.776187 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb77cf-9d5c-42b9-9091-850daaca0da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:52.776649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb77cf-9d5c-42b9-9091-850daaca0da4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:52.841093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb77cf-9d5c-42b9-9091-850daaca0da4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:52.842562 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb77cf-9d5c-42b9-9091-850daaca0da4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:52.852371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664f11-7cee-44bc-a508-120435257c2d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:52.886777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186485a-ccc4-47ca-b569-3e85f4479416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:52.887467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186485a-ccc4-47ca-b569-3e85f4479416 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:52.887753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186485a-ccc4-47ca-b569-3e85f4479416 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:52.888031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186485a-ccc4-47ca-b569-3e85f4479416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:52.888856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186485a-ccc4-47ca-b569-3e85f4479416 None admin] RBAC: Adding query filter params (group.id=2fc8514ec6ca4fd48bf6e23fcf094219, role.id=8f649e044d134d799d7bbaf6e0715e34, scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:52.889166 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186485a-ccc4-47ca-b569-3e85f4479416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:52.890662 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186485a-ccc4-47ca-b569-3e85f4479416 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:52.896391 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 222/443] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 5 15:28:52 2022] GET /identity/v3/role_assignments?group.id=2fc8514ec6ca4fd48bf6e23fcf094219&scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1&role.id=8f649e044d134d799d7bbaf6e0715e34 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:52.899455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa19f4-77c7-4706-be57-1ef13892d94a None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:52.899742 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa19f4-77c7-4706-be57-1ef13892d94a None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:52.900021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa19f4-77c7-4706-be57-1ef13892d94a None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:52.902403 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 223/444] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:52.911982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a194be-2fde-4f6e-b8fc-93841cd62596 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:52.912303 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a194be-2fde-4f6e-b8fc-93841cd62596 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:52.912545 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a194be-2fde-4f6e-b8fc-93841cd62596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:52.929807 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-c5a194be-2fde-4f6e-b8fc-93841cd62596 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:52.931075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c5a194be-2fde-4f6e-b8fc-93841cd62596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:52.943633 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 222/445] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:28:52.950637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb77cf-9d5c-42b9-9091-850daaca0da4 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:53.012453 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 224/446] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:53.036542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a194be-2fde-4f6e-b8fc-93841cd62596 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:53.056624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb77cf-9d5c-42b9-9091-850daaca0da4 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:53.093954 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b81cc-3a3c-4a10-a419-a7e9ffa40643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:53.094625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b81cc-3a3c-4a10-a419-a7e9ffa40643 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:53.095530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b81cc-3a3c-4a10-a419-a7e9ffa40643 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:53.095530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b81cc-3a3c-4a10-a419-a7e9ffa40643 None admin] PATH_INFO: `/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:53.097014 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b81cc-3a3c-4a10-a419-a7e9ffa40643 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d3917487e44e1a84cc0b98cfb33cb1)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:53.098525 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b81cc-3a3c-4a10-a419-a7e9ffa40643 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:53.100489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 223/447] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:52 2022] GET /identity/v3/projects/b9d3917487e44e1a84cc0b98cfb33cb1 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:53.106112 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b81cc-3a3c-4a10-a419-a7e9ffa40643 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:53.143438 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a194be-2fde-4f6e-b8fc-93841cd62596 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:53.184590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c3d70-22e8-4888-829d-14931692a8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:53.185670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c3d70-22e8-4888-829d-14931692a8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:53.185670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c3d70-22e8-4888-829d-14931692a8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:53.186399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c3d70-22e8-4888-829d-14931692a8f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:53.197560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c3d70-22e8-4888-829d-14931692a8f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-bf9c3d70-22e8-4888-829d-14931692a8f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:53.205946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:53.206966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:53.207987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:53.207987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:53.207987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:53.207987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:53.207987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:53.207987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:53.207987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:53.207987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:53.207987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:53.207987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:53.207987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:28:53.207987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:53.207987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 225/448] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:28:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:28:53.211890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b81cc-3a3c-4a10-a419-a7e9ffa40643 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:53.215099 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c3d70-22e8-4888-829d-14931692a8f8 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:53.255297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f113183-a017-4487-83a6-82a09de076ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:53.256151 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f113183-a017-4487-83a6-82a09de076ea None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:53.256425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f113183-a017-4487-83a6-82a09de076ea None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:53.256694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f113183-a017-4487-83a6-82a09de076ea None admin] PATH_INFO: `/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:53.258081 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f113183-a017-4487-83a6-82a09de076ea None admin] RBAC: Authorizing `identity:get_group(group_id=2fc8514ec6ca4fd48bf6e23fcf094219)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:53.259550 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f113183-a017-4487-83a6-82a09de076ea None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:53.262564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 224/449] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 5 15:28:53 2022] GET /identity/v3/groups/2fc8514ec6ca4fd48bf6e23fcf094219 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:53.269553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f113183-a017-4487-83a6-82a09de076ea None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:53.323876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c3d70-22e8-4888-829d-14931692a8f8 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:53.354709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9a115-992a-4fce-99ca-1c4674592b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:53.355357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9a115-992a-4fce-99ca-1c4674592b81 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:53.355636 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9a115-992a-4fce-99ca-1c4674592b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:53.355908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9a115-992a-4fce-99ca-1c4674592b81 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:53.356692 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9a115-992a-4fce-99ca-1c4674592b81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:53.356936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9a115-992a-4fce-99ca-1c4674592b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:53.358317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9a115-992a-4fce-99ca-1c4674592b81 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:53.365924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 226/450] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:28:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:53.367133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f113183-a017-4487-83a6-82a09de076ea None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:53.371912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9a115-992a-4fce-99ca-1c4674592b81 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:53.400864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acce0b-64f3-4c7c-a376-5a04e99cdd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:53.401516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acce0b-64f3-4c7c-a376-5a04e99cdd2e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:53.401797 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acce0b-64f3-4c7c-a376-5a04e99cdd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:53.402068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acce0b-64f3-4c7c-a376-5a04e99cdd2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:53.402912 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acce0b-64f3-4c7c-a376-5a04e99cdd2e None admin] RBAC: Adding query filter params (group.id=2fc8514ec6ca4fd48bf6e23fcf094219, role.id=8b51e457da8145c6995241d379986c7c, scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:53.403221 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acce0b-64f3-4c7c-a376-5a04e99cdd2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:53.404630 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acce0b-64f3-4c7c-a376-5a04e99cdd2e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:53.410378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 225/451] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 5 15:28:53 2022] GET /identity/v3/role_assignments?group.id=2fc8514ec6ca4fd48bf6e23fcf094219&scope.project.id=b9d3917487e44e1a84cc0b98cfb33cb1&role.id=8b51e457da8145c6995241d379986c7c => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:53.469077 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9a115-992a-4fce-99ca-1c4674592b81 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:53.504378 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86534d9d-ad78-47c0-8d9a-e2252cac4af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:53.505043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86534d9d-ad78-47c0-8d9a-e2252cac4af6 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:53.505322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86534d9d-ad78-47c0-8d9a-e2252cac4af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:53.505591 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86534d9d-ad78-47c0-8d9a-e2252cac4af6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:53.576065 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86534d9d-ad78-47c0-8d9a-e2252cac4af6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:53.577522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86534d9d-ad78-47c0-8d9a-e2252cac4af6 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:53.674599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 227/452] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:28:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:28:53.681526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acce0b-64f3-4c7c-a376-5a04e99cdd2e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:53.780446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acce0b-64f3-4c7c-a376-5a04e99cdd2e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:53.813899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d22f2-bdee-4601-a9a3-86f995aa996a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:53.814776 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d22f2-bdee-4601-a9a3-86f995aa996a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:53.815060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d22f2-bdee-4601-a9a3-86f995aa996a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:53.815331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d22f2-bdee-4601-a9a3-86f995aa996a None admin] PATH_INFO: `/v3/projects/e901518e00104463a2aa36d4de393e28` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:53.816513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d22f2-bdee-4601-a9a3-86f995aa996a None admin] RBAC: Authorizing `identity:get_project(project_id=e901518e00104463a2aa36d4de393e28)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:53.817945 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d22f2-bdee-4601-a9a3-86f995aa996a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:53.819661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 226/453] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:28:53 2022] GET /identity/v3/projects/e901518e00104463a2aa36d4de393e28 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:53.825778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86534d9d-ad78-47c0-8d9a-e2252cac4af6 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:53.918123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86534d9d-ad78-47c0-8d9a-e2252cac4af6 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:53.950210 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21972f0c-f442-413e-a73a-d63f0249b9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:53.950996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21972f0c-f442-413e-a73a-d63f0249b9bc None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:53.951276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21972f0c-f442-413e-a73a-d63f0249b9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:53.951548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21972f0c-f442-413e-a73a-d63f0249b9bc None admin] PATH_INFO: `/v3/groups/f6e6e4af555240ca88427d1a1f12df39` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:53.952691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21972f0c-f442-413e-a73a-d63f0249b9bc None admin] RBAC: Authorizing `identity:get_group(group_id=f6e6e4af555240ca88427d1a1f12df39)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:53.954106 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21972f0c-f442-413e-a73a-d63f0249b9bc None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:53.955760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 228/454] 10.222.0.58 () {56 vars in 1180 bytes} [Thu May 5 15:28:53 2022] GET /identity/v3/groups/f6e6e4af555240ca88427d1a1f12df39 => generated 229 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:53.961316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d22f2-bdee-4601-a9a3-86f995aa996a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:54.061481 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d22f2-bdee-4601-a9a3-86f995aa996a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:54.093221 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667227d0-60bd-41c4-998c-6c738558a3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:54.093861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667227d0-60bd-41c4-998c-6c738558a3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:54.094138 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667227d0-60bd-41c4-998c-6c738558a3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:54.094670 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667227d0-60bd-41c4-998c-6c738558a3a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:54.095232 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667227d0-60bd-41c4-998c-6c738558a3a7 None admin] RBAC: Adding query filter params (group.id=f6e6e4af555240ca88427d1a1f12df39, role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=e901518e00104463a2aa36d4de393e28) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:54.095539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667227d0-60bd-41c4-998c-6c738558a3a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:54.096942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667227d0-60bd-41c4-998c-6c738558a3a7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:54.102695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 227/455] 10.222.0.58 () {56 vars in 1376 bytes} [Thu May 5 15:28:53 2022] GET /identity/v3/role_assignments?group.id=f6e6e4af555240ca88427d1a1f12df39&scope.project.id=e901518e00104463a2aa36d4de393e28&role.id=70f81a43849a47f7bf393b354a46d048 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:56.717429 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6f8a-3245-4a3d-b987-f8162f718777 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:56.718497 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6f8a-3245-4a3d-b987-f8162f718777 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:56.719086 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6f8a-3245-4a3d-b987-f8162f718777 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:56.721053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 229/456] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:56.726745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4062c-47d1-4daf-a884-280ddffc8cfe None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:56.727636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4062c-47d1-4daf-a884-280ddffc8cfe None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:56.728140 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4062c-47d1-4daf-a884-280ddffc8cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:56.751157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-7be4062c-47d1-4daf-a884-280ddffc8cfe None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:56.752350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7be4062c-47d1-4daf-a884-280ddffc8cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:56.836446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 228/457] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:56.879416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b6f8a-3245-4a3d-b987-f8162f718777 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:56.944904 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3e7a2-3420-4c26-aea9-453ec9ef4db0 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:56.945247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3e7a2-3420-4c26-aea9-453ec9ef4db0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:56.945462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3e7a2-3420-4c26-aea9-453ec9ef4db0 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:56.947088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 229/458] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:28:56.957331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d0785-79f3-44b7-adcb-1ee9f383d4e8 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:56.957604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d0785-79f3-44b7-adcb-1ee9f383d4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:56.957886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d0785-79f3-44b7-adcb-1ee9f383d4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:56.974727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-529d0785-79f3-44b7-adcb-1ee9f383d4e8 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:56.976239 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-529d0785-79f3-44b7-adcb-1ee9f383d4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:57.050344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 230/459] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:28:57.054832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b6f8a-3245-4a3d-b987-f8162f718777 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:57.070266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d0785-79f3-44b7-adcb-1ee9f383d4e8 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:57.120553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb240dba-c7aa-4707-9072-1c640f2c79de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:57.121288 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb240dba-c7aa-4707-9072-1c640f2c79de None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:57.121728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb240dba-c7aa-4707-9072-1c640f2c79de None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:57.122146 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb240dba-c7aa-4707-9072-1c640f2c79de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:57.144264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb240dba-c7aa-4707-9072-1c640f2c79de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:57.145918 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb240dba-c7aa-4707-9072-1c640f2c79de None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:57.172793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d0785-79f3-44b7-adcb-1ee9f383d4e8 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:57.180726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-cb240dba-c7aa-4707-9072-1c640f2c79de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:28:57.180726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:57.180726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:57.180726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:57.180726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:57.180726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:57.180726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:57.180726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:57.180726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:57.180726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:57.180726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:57.180726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:57.180726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:28:57.180726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:28:57.180726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:57.183482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:57.184316 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:28:57.184316 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:28:57.184316 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:28:57.184316 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:57.184316 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 230/460] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:57.188630 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb240dba-c7aa-4707-9072-1c640f2c79de None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:57.209889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd0683-6bf9-448d-a8a0-e0b31476c6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:57.210821 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd0683-6bf9-448d-a8a0-e0b31476c6aa None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:57.211165 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd0683-6bf9-448d-a8a0-e0b31476c6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:57.211523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd0683-6bf9-448d-a8a0-e0b31476c6aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:57.222493 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd0683-6bf9-448d-a8a0-e0b31476c6aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:57.224325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd0683-6bf9-448d-a8a0-e0b31476c6aa None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:57.242325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-bbcd0683-6bf9-448d-a8a0-e0b31476c6aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:28:57.242325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:57.242325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:57.242325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:57.242325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:57.242325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:57.242325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:57.242325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:57.242325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:57.242325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:57.242325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:57.242325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:57.242325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:28:57.242325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:28:57.242325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:57.243197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:57.244023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:28:57.244023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:28:57.244023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:28:57.244023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:57.247509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 231/461] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:57.250409 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd0683-6bf9-448d-a8a0-e0b31476c6aa None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:57.353300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd0683-6bf9-448d-a8a0-e0b31476c6aa None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:57.388733 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fed9a5-5a2f-4ed6-98e1-dd21065a1d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:57.389318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fed9a5-5a2f-4ed6-98e1-dd21065a1d7c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:57.389597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fed9a5-5a2f-4ed6-98e1-dd21065a1d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:57.389870 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fed9a5-5a2f-4ed6-98e1-dd21065a1d7c None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:57.390626 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fed9a5-5a2f-4ed6-98e1-dd21065a1d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:57.390952 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fed9a5-5a2f-4ed6-98e1-dd21065a1d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:57.392287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fed9a5-5a2f-4ed6-98e1-dd21065a1d7c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:57.408539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 232/462] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:57.409752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fed9a5-5a2f-4ed6-98e1-dd21065a1d7c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:57.428269 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb240dba-c7aa-4707-9072-1c640f2c79de None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:57.495340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb170e-2962-41d2-ba0d-9f9299f4cece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:57.496002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb170e-2962-41d2-ba0d-9f9299f4cece None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:57.496286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb170e-2962-41d2-ba0d-9f9299f4cece None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:57.496560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb170e-2962-41d2-ba0d-9f9299f4cece None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:57.497280 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb170e-2962-41d2-ba0d-9f9299f4cece None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:57.497583 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb170e-2962-41d2-ba0d-9f9299f4cece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:57.499424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb170e-2962-41d2-ba0d-9f9299f4cece None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:57.514448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 231/463] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:28:57.519493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bde8b7-84c4-4fb8-92f4-235f3c4eb947 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:57.519493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bde8b7-84c4-4fb8-92f4-235f3c4eb947 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:57.519493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bde8b7-84c4-4fb8-92f4-235f3c4eb947 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:57.519493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 232/464] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:57.519941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bde8b7-84c4-4fb8-92f4-235f3c4eb947 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:57.531802 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fed9a5-5a2f-4ed6-98e1-dd21065a1d7c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:57.566087 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4c0f0-3f43-4cad-b393-e9324a9300b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:57.566804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4c0f0-3f43-4cad-b393-e9324a9300b1 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:57.567086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4c0f0-3f43-4cad-b393-e9324a9300b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:57.567358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4c0f0-3f43-4cad-b393-e9324a9300b1 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:57.568137 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4c0f0-3f43-4cad-b393-e9324a9300b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:57.569630 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4c0f0-3f43-4cad-b393-e9324a9300b1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:57.593800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 233/465] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:28:57 2022] POST /identity/v3/users => generated 248 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:28:57.595167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c60ce7-9e8f-4ec7-9fb6-27ce7ea55b7c None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:57.595457 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c60ce7-9e8f-4ec7-9fb6-27ce7ea55b7c None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:57.595788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c60ce7-9e8f-4ec7-9fb6-27ce7ea55b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:57.617723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-76c60ce7-9e8f-4ec7-9fb6-27ce7ea55b7c None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:57.619055 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-76c60ce7-9e8f-4ec7-9fb6-27ce7ea55b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:57.704762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bde8b7-84c4-4fb8-92f4-235f3c4eb947 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:57.764271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 234/466] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:57.775351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45799601-f745-4ac9-b8bf-3f53d965aaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:57.777161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45799601-f745-4ac9-b8bf-3f53d965aaba None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:57.777521 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45799601-f745-4ac9-b8bf-3f53d965aaba None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:57.777808 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45799601-f745-4ac9-b8bf-3f53d965aaba None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:57.778560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45799601-f745-4ac9-b8bf-3f53d965aaba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:57.780137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45799601-f745-4ac9-b8bf-3f53d965aaba None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:57.808223 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 233/467] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:28:57 2022] POST /identity/v3/users => generated 246 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:28:57.813085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c60ce7-9e8f-4ec7-9fb6-27ce7ea55b7c None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:57.930195 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c60ce7-9e8f-4ec7-9fb6-27ce7ea55b7c None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:57.967906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b20ca-be2c-43cc-bbf2-b0b77e230b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:57.968641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b20ca-be2c-43cc-bbf2-b0b77e230b37 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:57.968921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b20ca-be2c-43cc-bbf2-b0b77e230b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:57.969196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b20ca-be2c-43cc-bbf2-b0b77e230b37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:57.981601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab769ae-0821-4feb-93c3-26104146d133 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:57.981916 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b20ca-be2c-43cc-bbf2-b0b77e230b37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:57.982420 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab769ae-0821-4feb-93c3-26104146d133 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:57.982919 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab769ae-0821-4feb-93c3-26104146d133 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:57.983441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b20ca-be2c-43cc-bbf2-b0b77e230b37 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:57.985363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 234/468] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:57.997710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33651d-07bc-48e8-bbeb-b2b75ade0f39 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:57.998412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33651d-07bc-48e8-bbeb-b2b75ade0f39 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:57.999050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33651d-07bc-48e8-bbeb-b2b75ade0f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.008088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-662b20ca-be2c-43cc-bbf2-b0b77e230b37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:28:58.008088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:58.008088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:58.008088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:58.008088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:58.008088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:58.008088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:58.008088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:58.008088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:58.008088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:58.008088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:58.008088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:58.008088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:28:58.008088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:28:58.008088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:58.009030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:58.013322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:28:58.013322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:28:58.013322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:28:58.013322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:58.013322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 235/469] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:58.017224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b20ca-be2c-43cc-bbf2-b0b77e230b37 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:58.024549 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-be33651d-07bc-48e8-bbeb-b2b75ade0f39 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:58.026438 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-be33651d-07bc-48e8-bbeb-b2b75ade0f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:58.123906 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 235/470] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:58.149873 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33651d-07bc-48e8-bbeb-b2b75ade0f39 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:58.151422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b20ca-be2c-43cc-bbf2-b0b77e230b37 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:58.187329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488a5af-8a8c-4632-a624-f7de1c196041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:58.188220 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488a5af-8a8c-4632-a624-f7de1c196041 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.188633 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488a5af-8a8c-4632-a624-f7de1c196041 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.189043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488a5af-8a8c-4632-a624-f7de1c196041 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.189923 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488a5af-8a8c-4632-a624-f7de1c196041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:58.190399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488a5af-8a8c-4632-a624-f7de1c196041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:58.191927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488a5af-8a8c-4632-a624-f7de1c196041 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:58.204872 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 236/471] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:58.210919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488a5af-8a8c-4632-a624-f7de1c196041 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:58.272732 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33651d-07bc-48e8-bbeb-b2b75ade0f39 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:58.310841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f850f-8ff4-48f8-8384-fa95bdbce7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:58.311864 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f850f-8ff4-48f8-8384-fa95bdbce7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.312283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f850f-8ff4-48f8-8384-fa95bdbce7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.312692 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f850f-8ff4-48f8-8384-fa95bdbce7a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.323107 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f850f-8ff4-48f8-8384-fa95bdbce7a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:58.324806 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f850f-8ff4-48f8-8384-fa95bdbce7a3 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:58.337187 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488a5af-8a8c-4632-a624-f7de1c196041 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:58.343161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-e56f850f-8ff4-48f8-8384-fa95bdbce7a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:28:58.343161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:58.343161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:58.343161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:58.343161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:58.343161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:58.343161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:58.343161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:58.343161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:58.343161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:58.343161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:58.343161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:58.343161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:28:58.343161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:28:58.343161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:58.344164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:58.345127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:28:58.345127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:28:58.345127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:28:58.345127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:58.346927 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 236/472] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:28:58.348400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a1b23-4a1d-47fe-85ab-6f87d5eb1c36 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.349170 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a1b23-4a1d-47fe-85ab-6f87d5eb1c36 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.349646 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a1b23-4a1d-47fe-85ab-6f87d5eb1c36 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.351112 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 237/473] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:28:58.352926 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a1b23-4a1d-47fe-85ab-6f87d5eb1c36 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:58.380831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c68e9-7482-4f33-99ba-77a30a4984d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:58.381505 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c68e9-7482-4f33-99ba-77a30a4984d6 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.381790 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c68e9-7482-4f33-99ba-77a30a4984d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.382067 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c68e9-7482-4f33-99ba-77a30a4984d6 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.382969 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c68e9-7482-4f33-99ba-77a30a4984d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:58.385236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c68e9-7482-4f33-99ba-77a30a4984d6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:58.412931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 237/474] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:28:58 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:28:58.414948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e7a83-77d1-418a-9af4-695439f5f975 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.415252 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e7a83-77d1-418a-9af4-695439f5f975 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.415571 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e7a83-77d1-418a-9af4-695439f5f975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.438396 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4c3e7a83-77d1-418a-9af4-695439f5f975 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:28:58.440597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4c3e7a83-77d1-418a-9af4-695439f5f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:28:58.473106 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a1b23-4a1d-47fe-85ab-6f87d5eb1c36 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:58.533236 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecd4b7-dfc2-4761-9ea1-4c7b922e61de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:58.535376 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecd4b7-dfc2-4761-9ea1-4c7b922e61de None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.536414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecd4b7-dfc2-4761-9ea1-4c7b922e61de None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.536903 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecd4b7-dfc2-4761-9ea1-4c7b922e61de None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.538784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecd4b7-dfc2-4761-9ea1-4c7b922e61de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:58.540193 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecd4b7-dfc2-4761-9ea1-4c7b922e61de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:58.543126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecd4b7-dfc2-4761-9ea1-4c7b922e61de None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:58.565744 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 238/475] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:28:58.572033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecd4b7-dfc2-4761-9ea1-4c7b922e61de None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:58.584352 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 238/476] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:28:58.627912 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e7a83-77d1-418a-9af4-695439f5f975 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:58.693497 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecd4b7-dfc2-4761-9ea1-4c7b922e61de None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:58.732399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed276d4-91f8-4bfa-a0c9-b257f317a531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:58.733077 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed276d4-91f8-4bfa-a0c9-b257f317a531 None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.733360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed276d4-91f8-4bfa-a0c9-b257f317a531 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.733639 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed276d4-91f8-4bfa-a0c9-b257f317a531 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.734375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed276d4-91f8-4bfa-a0c9-b257f317a531 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:58.735806 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed276d4-91f8-4bfa-a0c9-b257f317a531 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:58.761129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e7a83-77d1-418a-9af4-695439f5f975 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:58.761693 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 239/477] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:28:58 2022] POST /identity/v3/users => generated 249 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:28:58.802089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be190bc-025f-4331-b202-d0a066f85382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:58.803529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be190bc-025f-4331-b202-d0a066f85382 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:58.804063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be190bc-025f-4331-b202-d0a066f85382 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:58.804557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be190bc-025f-4331-b202-d0a066f85382 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:58.805607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be190bc-025f-4331-b202-d0a066f85382 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:58.807321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be190bc-025f-4331-b202-d0a066f85382 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:58.815661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.sql.core [None req-1be190bc-025f-4331-b202-d0a066f85382 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 05 15:28:58.815661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 05 15:28:58.815661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [parameters: {'id': 'e7353571183f464b8a4a16758ff9d1d5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 05 15:28:58.815661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80046) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 05 15:28:58.834564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-1be190bc-025f-4331-b202-d0a066f85382 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 05 15:28:58.834564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:58.834564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:28:58.834564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:28:58.834564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:28:58.834564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:28:58.834564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:28:58.834564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:28:58.834564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:28:58.834564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application conn.query(q) May 05 15:28:58.834564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:28:58.834564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:28:58.834564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:28:58.834564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application result.read() May 05 15:28:58.834564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return ref.to_dict() May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:28:58.835541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application next(self.gen) May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application yield resource May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application next(self.gen) May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self.session.rollback() May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self.force_reraise() May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise self.value May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application session.commit() May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 05 15:28:58.836466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._prepare_impl() May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self.session.flush() May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._flush(objects) May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application compat.raise_( May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application flush_context.execute() May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rec.execute(self) May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 05 15:28:58.837321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application _emit_insert_statements( May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application c = connection._execute_20( May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ret = self._execute_context( May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:28:58.839782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application conn.query(q) May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application result.read() May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:28:58.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [parameters: {'id': 'e7353571183f464b8a4a16758ff9d1d5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:58.841448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 05 15:28:58.843189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:28:58.847279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 239/478] 10.222.0.58 () {60 vars in 1131 bytes} [Thu May 5 15:28:58 2022] POST /identity/v3/roles => generated 144 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 05 15:28:58.855800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed276d4-91f8-4bfa-a0c9-b257f317a531 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:59.012170 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed276d4-91f8-4bfa-a0c9-b257f317a531 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:59.050394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27906f-8675-452b-a315-1621a9465a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:59.051208 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27906f-8675-452b-a315-1621a9465a5c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:59.051489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27906f-8675-452b-a315-1621a9465a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:59.051764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27906f-8675-452b-a315-1621a9465a5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:59.062105 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27906f-8675-452b-a315-1621a9465a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-0c27906f-8675-452b-a315-1621a9465a5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:28:59.070507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:28:59.071587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:28:59.072691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:28:59.072691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:28:59.072691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:28:59.072691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:28:59.072691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:28:59.072691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:28:59.072691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:28:59.072691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:28:59.072691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:28:59.072691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:28:59.072691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 05 15:28:59.072691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:28:59.075066 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 240/479] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:28:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:28:59.080304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be190bc-025f-4331-b202-d0a066f85382 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:28:59.189095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be190bc-025f-4331-b202-d0a066f85382 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:28:59.224593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8728b-9a61-4b44-83a2-0e3ca44da7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:28:59.225633 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8728b-9a61-4b44-83a2-0e3ca44da7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:28:59.226106 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8728b-9a61-4b44-83a2-0e3ca44da7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:28:59.226600 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8728b-9a61-4b44-83a2-0e3ca44da7d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:28:59.227592 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8728b-9a61-4b44-83a2-0e3ca44da7d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:28:59.228068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8728b-9a61-4b44-83a2-0e3ca44da7d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:28:59.229779 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8728b-9a61-4b44-83a2-0e3ca44da7d8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:28:59.238986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 240/480] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:28:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:00.504650 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf3839-b8c1-4e50-9a79-a68ffd402f13 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:00.505693 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf3839-b8c1-4e50-9a79-a68ffd402f13 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:00.506268 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf3839-b8c1-4e50-9a79-a68ffd402f13 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:00.508142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 241/481] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:00.514365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4743d43-c335-438b-bdd0-6d4a2c5dcf0e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:00.515163 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4743d43-c335-438b-bdd0-6d4a2c5dcf0e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:00.515635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4743d43-c335-438b-bdd0-6d4a2c5dcf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:00.538578 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d4743d43-c335-438b-bdd0-6d4a2c5dcf0e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:00.540120 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d4743d43-c335-438b-bdd0-6d4a2c5dcf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:00.644649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 241/482] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:00.668943 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf3839-b8c1-4e50-9a79-a68ffd402f13 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:00.822856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf3839-b8c1-4e50-9a79-a68ffd402f13 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:00.866628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64770b46-8e11-45e8-897c-34375b00686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:00.867782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770b46-8e11-45e8-897c-34375b00686d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:00.868263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770b46-8e11-45e8-897c-34375b00686d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:00.868794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770b46-8e11-45e8-897c-34375b00686d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:00.886752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64770b46-8e11-45e8-897c-34375b00686d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-64770b46-8e11-45e8-897c-34375b00686d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:00.894752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:00.895638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:00.896412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:00.896412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:00.896412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:00.896412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:00.896412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:00.896412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:00.896412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:00.896412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:00.896412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:00.896412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:00.896412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:00.896412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:00.902250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 242/483] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:00.905035 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4743d43-c335-438b-bdd0-6d4a2c5dcf0e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:00.993186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc6de6-6e32-430b-851c-37be6c212fcf None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:00.993506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc6de6-6e32-430b-851c-37be6c212fcf None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:00.993741 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc6de6-6e32-430b-851c-37be6c212fcf None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:00.995598 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 243/484] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:01.005529 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147715c-6015-4c06-b80d-dd19e4b09b2c None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:01.005814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147715c-6015-4c06-b80d-dd19e4b09b2c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:01.006086 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147715c-6015-4c06-b80d-dd19e4b09b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:01.034702 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-9147715c-6015-4c06-b80d-dd19e4b09b2c None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:01.035900 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9147715c-6015-4c06-b80d-dd19e4b09b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:01.084535 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4743d43-c335-438b-bdd0-6d4a2c5dcf0e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:01.165465 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afc936-8eea-4fe0-842a-d080e2f8ac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:01.166858 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afc936-8eea-4fe0-842a-d080e2f8ac11 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:01.168275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afc936-8eea-4fe0-842a-d080e2f8ac11 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:01.168553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afc936-8eea-4fe0-842a-d080e2f8ac11 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:01.169310 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afc936-8eea-4fe0-842a-d080e2f8ac11 None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:01.169616 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afc936-8eea-4fe0-842a-d080e2f8ac11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:01.173709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afc936-8eea-4fe0-842a-d080e2f8ac11 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:01.187370 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 244/485] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:01.189523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 242/486] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:01.194935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147715c-6015-4c06-b80d-dd19e4b09b2c None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:01.245043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afc936-8eea-4fe0-842a-d080e2f8ac11 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:01.358841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147715c-6015-4c06-b80d-dd19e4b09b2c None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:01.377914 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afc936-8eea-4fe0-842a-d080e2f8ac11 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:01.401821 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197a8ec-1e33-4a65-9c58-26c2bb7e507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:01.402885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197a8ec-1e33-4a65-9c58-26c2bb7e507b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:01.403241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197a8ec-1e33-4a65-9c58-26c2bb7e507b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:01.403430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197a8ec-1e33-4a65-9c58-26c2bb7e507b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:01.411807 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d7ad0-2a87-4466-9dba-f73609590c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:01.412788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d7ad0-2a87-4466-9dba-f73609590c63 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:01.413172 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d7ad0-2a87-4466-9dba-f73609590c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:01.413548 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d7ad0-2a87-4466-9dba-f73609590c63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:01.414981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197a8ec-1e33-4a65-9c58-26c2bb7e507b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:01.416951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197a8ec-1e33-4a65-9c58-26c2bb7e507b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:01.425399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d7ad0-2a87-4466-9dba-f73609590c63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-ae2d7ad0-2a87-4466-9dba-f73609590c63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:01.434315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:01.435259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:01.436045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:01.436045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:01.436045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:01.436045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:01.436045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:01.436045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:01.436045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:01.436045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:01.436045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:01.436045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:01.436045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:01.436045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:01.436045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 243/487] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:01.437364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-8197a8ec-1e33-4a65-9c58-26c2bb7e507b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:01.437364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:01.437364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:01.437364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:01.437364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:01.437364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:01.437364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:01.437364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:01.437364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:01.437364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:01.437364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:01.437364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:01.437364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:01.437364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:01.437364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:01.438355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:01.439339 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:01.439339 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:01.439339 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:01.439339 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:01.439604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1ca88-d1a4-4276-9124-d1e2146f6316 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:01.439604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1ca88-d1a4-4276-9124-d1e2146f6316 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:01.439847 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 245/488] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:01.439928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1ca88-d1a4-4276-9124-d1e2146f6316 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:01.439928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 244/489] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:01.447985 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197a8ec-1e33-4a65-9c58-26c2bb7e507b None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:01.448174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec884f-56dd-40e5-9261-16846f6a6c9b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:01.448174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec884f-56dd-40e5-9261-16846f6a6c9b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:01.448174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec884f-56dd-40e5-9261-16846f6a6c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:01.466506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-78ec884f-56dd-40e5-9261-16846f6a6c9b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:01.468290 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-78ec884f-56dd-40e5-9261-16846f6a6c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:01.548205 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197a8ec-1e33-4a65-9c58-26c2bb7e507b None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:01.561926 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 245/490] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:01.563433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec884f-56dd-40e5-9261-16846f6a6c9b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:01.602020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fde7a-d52b-42ea-a046-a179d19dd542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:01.602990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fde7a-d52b-42ea-a046-a179d19dd542 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:01.602990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fde7a-d52b-42ea-a046-a179d19dd542 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:01.603262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fde7a-d52b-42ea-a046-a179d19dd542 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:01.604024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fde7a-d52b-42ea-a046-a179d19dd542 None admin] RBAC: Adding query filter params (name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:01.604327 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fde7a-d52b-42ea-a046-a179d19dd542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:01.605891 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fde7a-d52b-42ea-a046-a179d19dd542 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:01.619842 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 246/491] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:01.620735 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fde7a-d52b-42ea-a046-a179d19dd542 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:01.670275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec884f-56dd-40e5-9261-16846f6a6c9b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:01.716961 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7e939-a99c-4bf6-996d-c78d06dee162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:01.717640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7e939-a99c-4bf6-996d-c78d06dee162 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:01.718284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7e939-a99c-4bf6-996d-c78d06dee162 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:01.718585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7e939-a99c-4bf6-996d-c78d06dee162 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:01.719321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7e939-a99c-4bf6-996d-c78d06dee162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:01.719630 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7e939-a99c-4bf6-996d-c78d06dee162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:01.721612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7e939-a99c-4bf6-996d-c78d06dee162 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:01.736381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 246/492] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:01.737844 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7e939-a99c-4bf6-996d-c78d06dee162 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:01.744488 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fde7a-d52b-42ea-a046-a179d19dd542 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:01.779677 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aef438-b158-4b95-81cd-aae9c09c9474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:01.780874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aef438-b158-4b95-81cd-aae9c09c9474 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:01.781677 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aef438-b158-4b95-81cd-aae9c09c9474 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:01.782980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aef438-b158-4b95-81cd-aae9c09c9474 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:01.796575 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aef438-b158-4b95-81cd-aae9c09c9474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-79aef438-b158-4b95-81cd-aae9c09c9474 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:01.806723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:01.807714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:01.808498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:01.808498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:01.808498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:01.808498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:01.808498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:01.808498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:01.808498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:01.808498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:01.808498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:01.808498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:01.808498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:01.808498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:01.809088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 247/493] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:01.810126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aef438-b158-4b95-81cd-aae9c09c9474 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:01.859026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7e939-a99c-4bf6-996d-c78d06dee162 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:01.892144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48af4a-d89b-4bf4-8431-3bb79971207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:01.892854 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48af4a-d89b-4bf4-8431-3bb79971207f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:01.893132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48af4a-d89b-4bf4-8431-3bb79971207f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:01.893397 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48af4a-d89b-4bf4-8431-3bb79971207f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:01.903474 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48af4a-d89b-4bf4-8431-3bb79971207f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:01.904906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48af4a-d89b-4bf4-8431-3bb79971207f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:01.910185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aef438-b158-4b95-81cd-aae9c09c9474 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:01.922089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-0a48af4a-d89b-4bf4-8431-3bb79971207f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:01.922089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:01.922089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:01.922089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:01.922089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:01.922089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:01.922089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:01.922089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:01.922089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:01.922089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:01.922089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:01.922089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:01.922089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:01.922089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:01.922089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:01.922970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:01.923818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:01.923818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:01.923818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:01.923818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:01.923818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 247/494] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:01.924607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48af4a-d89b-4bf4-8431-3bb79971207f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:01.949918 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9871e12-f664-4ed5-bd13-3a38ab7d3301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:01.950994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9871e12-f664-4ed5-bd13-3a38ab7d3301 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:01.951348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9871e12-f664-4ed5-bd13-3a38ab7d3301 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:01.951689 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9871e12-f664-4ed5-bd13-3a38ab7d3301 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:01.959103 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9871e12-f664-4ed5-bd13-3a38ab7d3301 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:01.960622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9871e12-f664-4ed5-bd13-3a38ab7d3301 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-b9871e12-f664-4ed5-bd13-3a38ab7d3301 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:01.975856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:01.976945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:01.978142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:01.978142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:01.978142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:01.978142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:01.978142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:01.978142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:01.978142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:01.978142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:01.978142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 05 15:29:01.978142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:01.983845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 248/495] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:29:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:01.983845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4e54a-242d-4160-a2f6-798e6c8cfb12 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:01.983845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4e54a-242d-4160-a2f6-798e6c8cfb12 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:01.983845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4e54a-242d-4160-a2f6-798e6c8cfb12 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:01.983845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 249/496] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:01.983845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4e54a-242d-4160-a2f6-798e6c8cfb12 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:02.033828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48af4a-d89b-4bf4-8431-3bb79971207f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:02.071229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5335b-aca1-462f-b522-d731e3fa1a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:02.071989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5335b-aca1-462f-b522-d731e3fa1a6f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:02.072368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5335b-aca1-462f-b522-d731e3fa1a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:02.072721 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5335b-aca1-462f-b522-d731e3fa1a6f None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:02.073530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5335b-aca1-462f-b522-d731e3fa1a6f None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:02.073895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5335b-aca1-462f-b522-d731e3fa1a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:02.075365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5335b-aca1-462f-b522-d731e3fa1a6f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:02.087864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 248/497] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:02.087864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5335b-aca1-462f-b522-d731e3fa1a6f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:02.096398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4e54a-242d-4160-a2f6-798e6c8cfb12 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:02.131834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814a280-79a1-42dc-94ff-05faad0b017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:02.132739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814a280-79a1-42dc-94ff-05faad0b017f None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:02.133027 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814a280-79a1-42dc-94ff-05faad0b017f None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:02.133305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814a280-79a1-42dc-94ff-05faad0b017f None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:02.134030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814a280-79a1-42dc-94ff-05faad0b017f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:02.134366 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814a280-79a1-42dc-94ff-05faad0b017f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:02.136395 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814a280-79a1-42dc-94ff-05faad0b017f None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:02.152861 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 250/498] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:02.152861 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac91ab0-1aee-4833-85c6-9ec45838a937 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:02.152861 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac91ab0-1aee-4833-85c6-9ec45838a937 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:02.152861 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac91ab0-1aee-4833-85c6-9ec45838a937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:02.167810 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-4ac91ab0-1aee-4833-85c6-9ec45838a937 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:02.169083 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4ac91ab0-1aee-4833-85c6-9ec45838a937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:02.195018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5335b-aca1-462f-b522-d731e3fa1a6f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:02.227964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacd039-490e-4572-b2a8-47d9ec06f28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:02.228738 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacd039-490e-4572-b2a8-47d9ec06f28f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:02.229094 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacd039-490e-4572-b2a8-47d9ec06f28f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:02.229373 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacd039-490e-4572-b2a8-47d9ec06f28f None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:02.230245 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacd039-490e-4572-b2a8-47d9ec06f28f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:02.230557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacd039-490e-4572-b2a8-47d9ec06f28f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:02.231978 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacd039-490e-4572-b2a8-47d9ec06f28f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:02.234770 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 251/499] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:02.235445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac91ab0-1aee-4833-85c6-9ec45838a937 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:02.268725 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 249/500] 10.222.0.58 () {56 vars in 1137 bytes} [Thu May 5 15:29:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:02.269556 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacd039-490e-4572-b2a8-47d9ec06f28f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:02.331526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac91ab0-1aee-4833-85c6-9ec45838a937 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:02.362430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacd039-490e-4572-b2a8-47d9ec06f28f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:02.363778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3dcc9-a354-4412-848f-e939269e837e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:02.364561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3dcc9-a354-4412-848f-e939269e837e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:02.364835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3dcc9-a354-4412-848f-e939269e837e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:02.365104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3dcc9-a354-4412-848f-e939269e837e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:02.375428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3dcc9-a354-4412-848f-e939269e837e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:02.376859 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3dcc9-a354-4412-848f-e939269e837e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:02.394278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-86e3dcc9-a354-4412-848f-e939269e837e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:02.394278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:02.394278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:02.394278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:02.394278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:02.394278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:02.394278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:02.394278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:02.394278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:02.394278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:02.394278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:02.394278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:02.394278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:02.394278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:02.394278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:02.395307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:02.396195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:02.396195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:02.396195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:02.396195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:02.396195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 252/501] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:02.396787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877f21d-da11-435b-b46a-392a2a336d6e None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:02.397072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877f21d-da11-435b-b46a-392a2a336d6e None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:02.397200 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e141c7a-c761-4cd3-90b6-77e63af3c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:02.397347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877f21d-da11-435b-b46a-392a2a336d6e None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:02.397989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e141c7a-c761-4cd3-90b6-77e63af3c89c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:02.398297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e141c7a-c761-4cd3-90b6-77e63af3c89c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:02.398763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e141c7a-c761-4cd3-90b6-77e63af3c89c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:02.398854 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 253/502] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:02.403000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877f21d-da11-435b-b46a-392a2a336d6e None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:02.405965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e141c7a-c761-4cd3-90b6-77e63af3c89c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:02.407443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e141c7a-c761-4cd3-90b6-77e63af3c89c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-7e141c7a-c761-4cd3-90b6-77e63af3c89c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:02.423304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:02.424360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:02.425390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:02.425390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:02.425390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:02.425390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:02.425390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:02.425390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:02.425390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:02.425390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:02.425390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:29:02.425390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:02.425390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 250/503] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 5 15:29:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:02.426130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e141c7a-c761-4cd3-90b6-77e63af3c89c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:02.501039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877f21d-da11-435b-b46a-392a2a336d6e None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:02.525242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e141c7a-c761-4cd3-90b6-77e63af3c89c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:02.535781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45343f4e-c658-4c4e-8e59-78ae7a072ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:02.536560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45343f4e-c658-4c4e-8e59-78ae7a072ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:02.536846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45343f4e-c658-4c4e-8e59-78ae7a072ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:02.537113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45343f4e-c658-4c4e-8e59-78ae7a072ab7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:02.547120 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45343f4e-c658-4c4e-8e59-78ae7a072ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-45343f4e-c658-4c4e-8e59-78ae7a072ab7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:02.554989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:02.556296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:02.557291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:02.557291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:02.557291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:02.557291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:02.557291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:02.557291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:02.557291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:02.557291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:02.557291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:02.557291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:02.557291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:02.557291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:02.557291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 254/504] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:02.557959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45343f4e-c658-4c4e-8e59-78ae7a072ab7 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:02.563457 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1e242-3fd6-4091-babb-0d81f785c2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:02.563957 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1e242-3fd6-4091-babb-0d81f785c2ea None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:02.564241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1e242-3fd6-4091-babb-0d81f785c2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:02.564518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1e242-3fd6-4091-babb-0d81f785c2ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:02.630786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1e242-3fd6-4091-babb-0d81f785c2ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:02.632237 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1e242-3fd6-4091-babb-0d81f785c2ea None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:02.656062 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45343f4e-c658-4c4e-8e59-78ae7a072ab7 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:02.688272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275573b4-8140-4432-a663-5165dddd5dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:02.688923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275573b4-8140-4432-a663-5165dddd5dcf None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:02.689204 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275573b4-8140-4432-a663-5165dddd5dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:02.689479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275573b4-8140-4432-a663-5165dddd5dcf None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:02.690224 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275573b4-8140-4432-a663-5165dddd5dcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:02.690535 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275573b4-8140-4432-a663-5165dddd5dcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:02.691899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275573b4-8140-4432-a663-5165dddd5dcf None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:02.703039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 255/505] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:02.704297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac5dfb-a1b2-4c09-9894-171491a8c5ad None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:02.704585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac5dfb-a1b2-4c09-9894-171491a8c5ad None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:02.704856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac5dfb-a1b2-4c09-9894-171491a8c5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:02.721361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-bbac5dfb-a1b2-4c09-9894-171491a8c5ad None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:02.722566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bbac5dfb-a1b2-4c09-9894-171491a8c5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:02.728478 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 251/506] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:29:02.729936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1e242-3fd6-4091-babb-0d81f785c2ea None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:02.785228 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 256/507] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:02.786044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac5dfb-a1b2-4c09-9894-171491a8c5ad None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:02.825519 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1e242-3fd6-4091-babb-0d81f785c2ea None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:02.858521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027a4f9-602f-4ff7-b3cc-7ea4a25cc370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:02.859176 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027a4f9-602f-4ff7-b3cc-7ea4a25cc370 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:02.859450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027a4f9-602f-4ff7-b3cc-7ea4a25cc370 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:02.859718 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027a4f9-602f-4ff7-b3cc-7ea4a25cc370 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:02.860536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027a4f9-602f-4ff7-b3cc-7ea4a25cc370 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:02.860840 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027a4f9-602f-4ff7-b3cc-7ea4a25cc370 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:02.862290 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027a4f9-602f-4ff7-b3cc-7ea4a25cc370 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:02.878914 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 252/508] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 5 15:29:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:02.879630 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027a4f9-602f-4ff7-b3cc-7ea4a25cc370 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:02.896717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac5dfb-a1b2-4c09-9894-171491a8c5ad None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:02.931048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730edc7-e379-40ed-af30-d04cfb2bd505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:02.931677 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730edc7-e379-40ed-af30-d04cfb2bd505 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:02.932185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730edc7-e379-40ed-af30-d04cfb2bd505 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:02.932497 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730edc7-e379-40ed-af30-d04cfb2bd505 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:02.933297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730edc7-e379-40ed-af30-d04cfb2bd505 None admin] RBAC: Adding query filter params (name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:02.933601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730edc7-e379-40ed-af30-d04cfb2bd505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:02.934995 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730edc7-e379-40ed-af30-d04cfb2bd505 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:02.942682 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 257/509] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:02.943448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730edc7-e379-40ed-af30-d04cfb2bd505 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:02.978077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027a4f9-602f-4ff7-b3cc-7ea4a25cc370 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:03.009707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f1a7b-4422-4bda-bd7b-657d3c3b6c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:03.010621 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f1a7b-4422-4bda-bd7b-657d3c3b6c24 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:03.010898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f1a7b-4422-4bda-bd7b-657d3c3b6c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:03.011168 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f1a7b-4422-4bda-bd7b-657d3c3b6c24 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:03.017856 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f1a7b-4422-4bda-bd7b-657d3c3b6c24 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:03.019595 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f1a7b-4422-4bda-bd7b-657d3c3b6c24 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-3d9f1a7b-4422-4bda-bd7b-657d3c3b6c24 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:03.035242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:03.036164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:03.037326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:03.037326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:03.037326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:03.037326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:03.037326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:03.037326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:03.037326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:03.037326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:03.037326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:29:03.037326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:03.037326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 253/510] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:29:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:03.037326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f1a7b-4422-4bda-bd7b-657d3c3b6c24 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:03.047791 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730edc7-e379-40ed-af30-d04cfb2bd505 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:03.080174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7911d9-a35f-4488-a11b-218ad246ef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:03.080950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7911d9-a35f-4488-a11b-218ad246ef11 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:03.081234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7911d9-a35f-4488-a11b-218ad246ef11 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:03.081502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7911d9-a35f-4488-a11b-218ad246ef11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:03.092354 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7911d9-a35f-4488-a11b-218ad246ef11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:03.093775 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7911d9-a35f-4488-a11b-218ad246ef11 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:03.110978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-3f7911d9-a35f-4488-a11b-218ad246ef11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:03.110978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:03.110978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:03.110978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:03.110978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:03.110978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:03.110978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:03.110978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:03.110978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:03.110978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:03.110978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:03.110978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:03.110978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:03.110978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:03.110978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:03.111970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:03.112834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:03.112834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:03.112834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:03.112834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:03.112834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 258/511] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:03.113099 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7911d9-a35f-4488-a11b-218ad246ef11 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:03.129992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f1a7b-4422-4bda-bd7b-657d3c3b6c24 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:03.162190 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870dcc6-b348-4b5c-8c4a-66317e28e9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:03.163004 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870dcc6-b348-4b5c-8c4a-66317e28e9cd None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:03.163287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870dcc6-b348-4b5c-8c4a-66317e28e9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:03.163629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870dcc6-b348-4b5c-8c4a-66317e28e9cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:03.174287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870dcc6-b348-4b5c-8c4a-66317e28e9cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:03.175715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870dcc6-b348-4b5c-8c4a-66317e28e9cd None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:03.192819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-4870dcc6-b348-4b5c-8c4a-66317e28e9cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:03.192819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:03.192819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:03.192819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:03.192819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:03.192819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:03.192819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:03.192819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:03.192819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:03.192819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:03.192819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:03.192819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:03.192819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:03.192819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:03.192819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:03.193661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:03.194541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:03.194541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:03.194541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:03.194541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:03.194541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 254/512] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:03.194803 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870dcc6-b348-4b5c-8c4a-66317e28e9cd None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:03.216043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7911d9-a35f-4488-a11b-218ad246ef11 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:03.250696 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97a446-8685-4ed0-b9cc-fad8597b80f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:03.251334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97a446-8685-4ed0-b9cc-fad8597b80f6 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:03.251614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97a446-8685-4ed0-b9cc-fad8597b80f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:03.251882 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97a446-8685-4ed0-b9cc-fad8597b80f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:03.292505 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870dcc6-b348-4b5c-8c4a-66317e28e9cd None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:03.315835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97a446-8685-4ed0-b9cc-fad8597b80f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:03.317299 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97a446-8685-4ed0-b9cc-fad8597b80f6 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:03.324585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b09de5-ac3d-463c-b08e-ba8de805fc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:03.325369 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b09de5-ac3d-463c-b08e-ba8de805fc38 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:03.325645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b09de5-ac3d-463c-b08e-ba8de805fc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:03.325915 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b09de5-ac3d-463c-b08e-ba8de805fc38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:03.335482 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b09de5-ac3d-463c-b08e-ba8de805fc38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:03.336916 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b09de5-ac3d-463c-b08e-ba8de805fc38 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:03.354889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-f0b09de5-ac3d-463c-b08e-ba8de805fc38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:03.354889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:03.354889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:03.354889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:03.354889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:03.354889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:03.354889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:03.354889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:03.354889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:03.354889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:03.354889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:03.354889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:03.354889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:03.354889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:03.354889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:03.355889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:03.356779 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:03.356779 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:03.356779 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:03.356779 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:03.356779 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 255/513] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:03.357042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b09de5-ac3d-463c-b08e-ba8de805fc38 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:03.413504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 259/514] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:29:03.414362 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97a446-8685-4ed0-b9cc-fad8597b80f6 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:03.450144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b09de5-ac3d-463c-b08e-ba8de805fc38 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:03.483162 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561214f-c60c-4209-9ea9-2f1083f65542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:03.483822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561214f-c60c-4209-9ea9-2f1083f65542 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:03.484106 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561214f-c60c-4209-9ea9-2f1083f65542 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:03.484382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561214f-c60c-4209-9ea9-2f1083f65542 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:03.485210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561214f-c60c-4209-9ea9-2f1083f65542 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:03.485518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561214f-c60c-4209-9ea9-2f1083f65542 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:03.486979 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561214f-c60c-4209-9ea9-2f1083f65542 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:03.503480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 256/515] 10.222.0.58 () {56 vars in 1137 bytes} [Thu May 5 15:29:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:03.504376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561214f-c60c-4209-9ea9-2f1083f65542 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:03.512266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97a446-8685-4ed0-b9cc-fad8597b80f6 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:03.555540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632be01c-a3e5-4202-a8b9-27e2da7685c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:03.556470 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632be01c-a3e5-4202-a8b9-27e2da7685c3 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:03.557288 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632be01c-a3e5-4202-a8b9-27e2da7685c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:03.557595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632be01c-a3e5-4202-a8b9-27e2da7685c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:03.558634 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632be01c-a3e5-4202-a8b9-27e2da7685c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:03.559097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632be01c-a3e5-4202-a8b9-27e2da7685c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:03.561122 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632be01c-a3e5-4202-a8b9-27e2da7685c3 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:03.574950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 260/516] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:03.575880 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632be01c-a3e5-4202-a8b9-27e2da7685c3 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:03.606982 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561214f-c60c-4209-9ea9-2f1083f65542 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:03.639925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b9566-3dfd-42da-b442-597d87d14ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:03.640583 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b9566-3dfd-42da-b442-597d87d14ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:03.640869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b9566-3dfd-42da-b442-597d87d14ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:03.641150 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b9566-3dfd-42da-b442-597d87d14ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:03.641865 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b9566-3dfd-42da-b442-597d87d14ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:03.642199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b9566-3dfd-42da-b442-597d87d14ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:03.643554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b9566-3dfd-42da-b442-597d87d14ed0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:03.654651 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 257/517] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:03.655517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b9566-3dfd-42da-b442-597d87d14ed0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:03.669216 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632be01c-a3e5-4202-a8b9-27e2da7685c3 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:03.701544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ad086-7cf8-4ffa-9718-df3fd865f6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:03.702134 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ad086-7cf8-4ffa-9718-df3fd865f6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:03.702452 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ad086-7cf8-4ffa-9718-df3fd865f6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:03.702726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ad086-7cf8-4ffa-9718-df3fd865f6a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:03.703435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ad086-7cf8-4ffa-9718-df3fd865f6a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:03.703741 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ad086-7cf8-4ffa-9718-df3fd865f6a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:03.705109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ad086-7cf8-4ffa-9718-df3fd865f6a6 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:03.716465 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 261/518] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:03.717295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ad086-7cf8-4ffa-9718-df3fd865f6a6 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:03.752759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b9566-3dfd-42da-b442-597d87d14ed0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:03.784248 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405f834-badb-44f3-bf27-6cb6823f8a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:03.785029 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405f834-badb-44f3-bf27-6cb6823f8a74 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:03.785309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405f834-badb-44f3-bf27-6cb6823f8a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:03.785579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405f834-badb-44f3-bf27-6cb6823f8a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:03.796130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405f834-badb-44f3-bf27-6cb6823f8a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:03.797564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405f834-badb-44f3-bf27-6cb6823f8a74 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:03.810239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ad086-7cf8-4ffa-9718-df3fd865f6a6 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:03.813722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-4405f834-badb-44f3-bf27-6cb6823f8a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:03.813722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:03.813722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:03.813722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:03.813722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:03.813722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:03.813722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:03.813722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:03.813722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:03.813722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:03.813722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:03.813722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:03.813722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:03.813722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:03.813722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:03.814591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:03.815423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:03.815423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:03.815423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:03.815423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:03.815423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 258/519] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:03.815689 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405f834-badb-44f3-bf27-6cb6823f8a74 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:03.850386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a5307-3eb1-4cac-b691-92f6be3d0b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:03.851032 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5307-3eb1-4cac-b691-92f6be3d0b07 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:03.851310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5307-3eb1-4cac-b691-92f6be3d0b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:03.851580 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5307-3eb1-4cac-b691-92f6be3d0b07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:03.913063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405f834-badb-44f3-bf27-6cb6823f8a74 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:03.918690 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a5307-3eb1-4cac-b691-92f6be3d0b07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:03.920127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a5307-3eb1-4cac-b691-92f6be3d0b07 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:03.944985 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf599879-8c2b-4397-9d3b-c832cf019e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:03.945775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf599879-8c2b-4397-9d3b-c832cf019e77 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:03.946059 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf599879-8c2b-4397-9d3b-c832cf019e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:03.946358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf599879-8c2b-4397-9d3b-c832cf019e77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:03.953385 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf599879-8c2b-4397-9d3b-c832cf019e77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:03.954808 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf599879-8c2b-4397-9d3b-c832cf019e77 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:03.969709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-bf599879-8c2b-4397-9d3b-c832cf019e77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:03.969709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:03.969709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:03.969709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:03.969709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:03.969709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:03.969709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:03.969709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:03.969709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:03.969709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:03.969709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:03.969709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:03.969709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:03.969709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:03.969709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:03.970645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:03.971470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:03.971470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:03.971470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:03.971470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:03.971470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:03.971470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:03.971470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:03.971470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:03.971470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 259/520] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:03.971932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf599879-8c2b-4397-9d3b-c832cf019e77 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:04.016943 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 262/521] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:29:04.017593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a5307-3eb1-4cac-b691-92f6be3d0b07 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:04.065939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf599879-8c2b-4397-9d3b-c832cf019e77 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:04.100834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0903d-0efa-4b03-891f-ada7a2f4de68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:04.101489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0903d-0efa-4b03-891f-ada7a2f4de68 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:04.101772 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0903d-0efa-4b03-891f-ada7a2f4de68 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:04.102047 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0903d-0efa-4b03-891f-ada7a2f4de68 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:04.102779 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0903d-0efa-4b03-891f-ada7a2f4de68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:04.104514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0903d-0efa-4b03-891f-ada7a2f4de68 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:04.114085 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a5307-3eb1-4cac-b691-92f6be3d0b07 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:04.124611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 260/522] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:29:03 2022] POST /identity/v3/users => generated 247 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:29:04.125437 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0903d-0efa-4b03-891f-ada7a2f4de68 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:04.150266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5809e8-78a2-4fbe-aa20-aec860de7060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:04.153379 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5809e8-78a2-4fbe-aa20-aec860de7060 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:04.153660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5809e8-78a2-4fbe-aa20-aec860de7060 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:04.153932 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5809e8-78a2-4fbe-aa20-aec860de7060 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:04.162481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5809e8-78a2-4fbe-aa20-aec860de7060 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:04.164370 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5809e8-78a2-4fbe-aa20-aec860de7060 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-be5809e8-78a2-4fbe-aa20-aec860de7060 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:04.181819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:04.183584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:04.184469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:04.184469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:04.184469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:04.184469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:04.184469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:04.184469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:04.184469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:04.184469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:04.184469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:29:04.184469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:04.184469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 263/523] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:04.184469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5809e8-78a2-4fbe-aa20-aec860de7060 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:04.245795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0903d-0efa-4b03-891f-ada7a2f4de68 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:04.281996 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22082e-8103-4724-8398-b1cf740c87ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:04.282693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22082e-8103-4724-8398-b1cf740c87ce None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:04.282976 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22082e-8103-4724-8398-b1cf740c87ce None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:04.283253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22082e-8103-4724-8398-b1cf740c87ce None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:04.283982 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22082e-8103-4724-8398-b1cf740c87ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:04.284283 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22082e-8103-4724-8398-b1cf740c87ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:04.285716 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22082e-8103-4724-8398-b1cf740c87ce None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:04.294644 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5809e8-78a2-4fbe-aa20-aec860de7060 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:04.302808 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 261/524] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:04.302808 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22082e-8103-4724-8398-b1cf740c87ce None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:04.334811 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee06d29-5318-44c1-97ca-6d8756e130d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:04.335576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee06d29-5318-44c1-97ca-6d8756e130d1 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:04.335855 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee06d29-5318-44c1-97ca-6d8756e130d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:04.336212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee06d29-5318-44c1-97ca-6d8756e130d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:04.337060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee06d29-5318-44c1-97ca-6d8756e130d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:04.337434 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee06d29-5318-44c1-97ca-6d8756e130d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:04.339247 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee06d29-5318-44c1-97ca-6d8756e130d1 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:04.365759 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 264/525] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:04.367203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee06d29-5318-44c1-97ca-6d8756e130d1 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:04.408683 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22082e-8103-4724-8398-b1cf740c87ce None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:04.441206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b1535-7265-40ec-b1bd-e6fe877ce331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:04.441987 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b1535-7265-40ec-b1bd-e6fe877ce331 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:04.442299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b1535-7265-40ec-b1bd-e6fe877ce331 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:04.442577 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b1535-7265-40ec-b1bd-e6fe877ce331 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:04.452641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b1535-7265-40ec-b1bd-e6fe877ce331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:04.454070 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b1535-7265-40ec-b1bd-e6fe877ce331 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:04.471431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-a34b1535-7265-40ec-b1bd-e6fe877ce331 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:04.471431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:04.471431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:04.471431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:04.471431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:04.471431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:04.471431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:04.471431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:04.471431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:04.471431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:04.471431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:04.471431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:04.471431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:04.471431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:04.471431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:04.472477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:04.473712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:04.473712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:04.473712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:04.473712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:04.473712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 262/526] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:04.474004 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b1535-7265-40ec-b1bd-e6fe877ce331 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:04.521998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee06d29-5318-44c1-97ca-6d8756e130d1 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:04.555870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740523c-c2c3-4935-b3ad-926e6db19b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:04.556515 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740523c-c2c3-4935-b3ad-926e6db19b24 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:04.557401 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740523c-c2c3-4935-b3ad-926e6db19b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:04.557664 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740523c-c2c3-4935-b3ad-926e6db19b24 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:04.558928 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740523c-c2c3-4935-b3ad-926e6db19b24 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:04.559413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740523c-c2c3-4935-b3ad-926e6db19b24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:04.560871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740523c-c2c3-4935-b3ad-926e6db19b24 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:04.596312 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b1535-7265-40ec-b1bd-e6fe877ce331 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:04.602793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 265/527] 10.222.0.58 () {56 vars in 1139 bytes} [Thu May 5 15:29:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:04.602793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740523c-c2c3-4935-b3ad-926e6db19b24 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:04.630674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba2651-695b-4be1-b1f0-7eec62cb0579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:04.632028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba2651-695b-4be1-b1f0-7eec62cb0579 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:04.632308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba2651-695b-4be1-b1f0-7eec62cb0579 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:04.632581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba2651-695b-4be1-b1f0-7eec62cb0579 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:04.639927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba2651-695b-4be1-b1f0-7eec62cb0579 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:04.641362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba2651-695b-4be1-b1f0-7eec62cb0579 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:04.654741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9fba2651-695b-4be1-b1f0-7eec62cb0579 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:04.654741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:04.654741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:04.654741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:04.654741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:04.654741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:04.654741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:04.654741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:04.654741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:04.654741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:04.654741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:04.654741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:04.654741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:04.654741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:04.654741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:04.655604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:04.656429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:04.656429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:04.656429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:04.656429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:04.656429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:04.656429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:04.656429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:04.656429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:04.660634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 263/528] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:04.661251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba2651-695b-4be1-b1f0-7eec62cb0579 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:04.698761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740523c-c2c3-4935-b3ad-926e6db19b24 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:04.735293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866241d-dc7d-441b-9196-5b7a648614ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:04.736506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866241d-dc7d-441b-9196-5b7a648614ba None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:04.737187 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866241d-dc7d-441b-9196-5b7a648614ba None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:04.737606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866241d-dc7d-441b-9196-5b7a648614ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:04.738742 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866241d-dc7d-441b-9196-5b7a648614ba None admin] RBAC: Adding query filter params (role.id=0b37e8a909204679b705bf258b1cd8f1, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=ab6c13dc02ba49d0be523fa9a73fdf5e) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:04.739550 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866241d-dc7d-441b-9196-5b7a648614ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:04.741549 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866241d-dc7d-441b-9196-5b7a648614ba None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:04.754575 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 266/529] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:04 2022] GET /identity/v3/role_assignments?user.id=ab6c13dc02ba49d0be523fa9a73fdf5e&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=0b37e8a909204679b705bf258b1cd8f1 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:04.756017 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866241d-dc7d-441b-9196-5b7a648614ba None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:04.757191 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba2651-695b-4be1-b1f0-7eec62cb0579 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:04.798158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f531166-6ff2-45b6-8e12-069795a8f5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:04.799104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f531166-6ff2-45b6-8e12-069795a8f5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:04.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f531166-6ff2-45b6-8e12-069795a8f5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:04.800036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f531166-6ff2-45b6-8e12-069795a8f5f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:04.800905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f531166-6ff2-45b6-8e12-069795a8f5f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:04.801357 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f531166-6ff2-45b6-8e12-069795a8f5f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:04.803019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f531166-6ff2-45b6-8e12-069795a8f5f6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:04.821759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 264/530] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:04.823406 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f531166-6ff2-45b6-8e12-069795a8f5f6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:04.884315 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866241d-dc7d-441b-9196-5b7a648614ba None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:04.923892 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa5a7a-8471-4297-b018-9318eb132a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:04.924832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa5a7a-8471-4297-b018-9318eb132a7d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:04.925291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa5a7a-8471-4297-b018-9318eb132a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:04.925733 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa5a7a-8471-4297-b018-9318eb132a7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:04.944466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f531166-6ff2-45b6-8e12-069795a8f5f6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:04.982845 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153304a-9e3b-4baa-ac90-4955639f921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:04.983830 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153304a-9e3b-4baa-ac90-4955639f921d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:04.984279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153304a-9e3b-4baa-ac90-4955639f921d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:04.984722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153304a-9e3b-4baa-ac90-4955639f921d None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:04.985697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153304a-9e3b-4baa-ac90-4955639f921d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:04.986244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153304a-9e3b-4baa-ac90-4955639f921d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:04.988073 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153304a-9e3b-4baa-ac90-4955639f921d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:05.006285 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa5a7a-8471-4297-b018-9318eb132a7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:05.010451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa5a7a-8471-4297-b018-9318eb132a7d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:05.010679 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 265/531] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:05.011775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153304a-9e3b-4baa-ac90-4955639f921d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:05.117057 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153304a-9e3b-4baa-ac90-4955639f921d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:05.135194 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 267/532] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:29:05.136280 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa5a7a-8471-4297-b018-9318eb132a7d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:05.153236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87678951-915f-4a25-9a3b-c6f16b22420d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:05.154373 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87678951-915f-4a25-9a3b-c6f16b22420d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:05.154870 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87678951-915f-4a25-9a3b-c6f16b22420d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:05.155327 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87678951-915f-4a25-9a3b-c6f16b22420d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:05.162268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87678951-915f-4a25-9a3b-c6f16b22420d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:05.163920 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87678951-915f-4a25-9a3b-c6f16b22420d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:05.179332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-87678951-915f-4a25-9a3b-c6f16b22420d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:05.179332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:05.179332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:05.179332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:05.179332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:05.179332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:05.179332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:05.179332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:05.179332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:05.179332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:05.179332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:05.179332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:05.179332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:05.179332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:05.179332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:05.180192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:05.181019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:05.181019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:05.181019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:05.181019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:05.181019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:05.181019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:05.181019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:05.181019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:05.184248 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 266/533] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:05.185262 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87678951-915f-4a25-9a3b-c6f16b22420d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:05.241693 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa5a7a-8471-4297-b018-9318eb132a7d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:05.276808 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6a0ff-2c51-44a2-b219-f39e63f2d2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:05.277807 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a0ff-2c51-44a2-b219-f39e63f2d2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:05.278349 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a0ff-2c51-44a2-b219-f39e63f2d2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:05.278915 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a0ff-2c51-44a2-b219-f39e63f2d2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:05.279941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6a0ff-2c51-44a2-b219-f39e63f2d2c7 None admin] RBAC: Adding query filter params (role.id=0b37e8a909204679b705bf258b1cd8f1, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=2a29a4b1b1aa45aea2e466d8f8b79365) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:05.280444 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6a0ff-2c51-44a2-b219-f39e63f2d2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:05.282054 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6a0ff-2c51-44a2-b219-f39e63f2d2c7 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:05.288197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 268/534] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:05 2022] GET /identity/v3/role_assignments?user.id=2a29a4b1b1aa45aea2e466d8f8b79365&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=0b37e8a909204679b705bf258b1cd8f1 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:05.289229 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6a0ff-2c51-44a2-b219-f39e63f2d2c7 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:05.291078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87678951-915f-4a25-9a3b-c6f16b22420d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:05.336971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb77870-b694-4197-a550-25ba4365932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:05.338359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb77870-b694-4197-a550-25ba4365932d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:05.338653 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb77870-b694-4197-a550-25ba4365932d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:05.338930 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb77870-b694-4197-a550-25ba4365932d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:05.361093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb77870-b694-4197-a550-25ba4365932d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:05.362641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb77870-b694-4197-a550-25ba4365932d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:05.392286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-2fb77870-b694-4197-a550-25ba4365932d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:05.392286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:05.392286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:05.392286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:05.392286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:05.392286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:05.392286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:05.392286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:05.392286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:05.392286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:05.392286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:05.392286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:05.392286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:05.392286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:05.392286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:05.393169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:05.393993 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:05.393993 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:05.393993 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:05.393993 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:05.393993 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 267/535] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:05.400070 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6a0ff-2c51-44a2-b219-f39e63f2d2c7 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:05.401078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb77870-b694-4197-a550-25ba4365932d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:05.437781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dd03c-07a5-4fc1-91d6-be720b2b7854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:05.438882 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dd03c-07a5-4fc1-91d6-be720b2b7854 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:05.439380 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dd03c-07a5-4fc1-91d6-be720b2b7854 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:05.439844 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dd03c-07a5-4fc1-91d6-be720b2b7854 None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:05.440828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dd03c-07a5-4fc1-91d6-be720b2b7854 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:05.441322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dd03c-07a5-4fc1-91d6-be720b2b7854 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:05.443056 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dd03c-07a5-4fc1-91d6-be720b2b7854 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:05.456308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 269/536] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:05.467266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dd03c-07a5-4fc1-91d6-be720b2b7854 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:05.538938 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb77870-b694-4197-a550-25ba4365932d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:05.585068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35d6f4-0c07-472a-8c89-dfecc1858226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:05.585793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35d6f4-0c07-472a-8c89-dfecc1858226 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:05.586093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35d6f4-0c07-472a-8c89-dfecc1858226 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:05.586385 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35d6f4-0c07-472a-8c89-dfecc1858226 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:05.587190 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35d6f4-0c07-472a-8c89-dfecc1858226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:05.587504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35d6f4-0c07-472a-8c89-dfecc1858226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:05.589516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35d6f4-0c07-472a-8c89-dfecc1858226 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:05.603302 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 268/537] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:05.615474 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35d6f4-0c07-472a-8c89-dfecc1858226 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:05.644508 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dd03c-07a5-4fc1-91d6-be720b2b7854 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:05.688802 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc5bba-e83a-43de-8c8d-c748dc62d791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:05.689613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc5bba-e83a-43de-8c8d-c748dc62d791 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:05.689904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc5bba-e83a-43de-8c8d-c748dc62d791 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:05.690205 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc5bba-e83a-43de-8c8d-c748dc62d791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:05.691412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc5bba-e83a-43de-8c8d-c748dc62d791 None admin] RBAC: Adding query filter params (role.id=0b37e8a909204679b705bf258b1cd8f1, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=bb9a301df6534b499d60486060df7068) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:05.691863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc5bba-e83a-43de-8c8d-c748dc62d791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:05.693504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc5bba-e83a-43de-8c8d-c748dc62d791 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:05.702145 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 270/538] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:05 2022] GET /identity/v3/role_assignments?user.id=bb9a301df6534b499d60486060df7068&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=0b37e8a909204679b705bf258b1cd8f1 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:05.770279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35d6f4-0c07-472a-8c89-dfecc1858226 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:05.846764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb7028-55f7-46f9-b30f-780b2633b029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:05.847584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb7028-55f7-46f9-b30f-780b2633b029 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:05.847867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb7028-55f7-46f9-b30f-780b2633b029 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:05.848143 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb7028-55f7-46f9-b30f-780b2633b029 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:05.861573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb7028-55f7-46f9-b30f-780b2633b029 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:05.863225 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb7028-55f7-46f9-b30f-780b2633b029 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:05.882545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-6cbb7028-55f7-46f9-b30f-780b2633b029 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:05.882545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:05.882545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:05.882545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:05.882545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:05.882545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:05.882545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:05.882545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:05.882545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:05.882545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:05.882545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:05.882545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:05.882545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:05.882545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:05.882545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:05.883430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:05.884249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:05.884249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:05.884249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:05.884249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:05.884249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:05.884249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:05.884249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:05.884249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:05.884249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 269/539] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:05.890057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc5bba-e83a-43de-8c8d-c748dc62d791 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:06.040958 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc5bba-e83a-43de-8c8d-c748dc62d791 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:06.089344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee247f3-f137-4a20-8c21-e95d2f650474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:06.090004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee247f3-f137-4a20-8c21-e95d2f650474 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:06.090310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee247f3-f137-4a20-8c21-e95d2f650474 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:06.090583 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee247f3-f137-4a20-8c21-e95d2f650474 None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:06.091360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee247f3-f137-4a20-8c21-e95d2f650474 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:06.091663 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee247f3-f137-4a20-8c21-e95d2f650474 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:06.093084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee247f3-f137-4a20-8c21-e95d2f650474 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:06.117451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 271/540] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:06.123292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb7028-55f7-46f9-b30f-780b2633b029 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:06.253570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb7028-55f7-46f9-b30f-780b2633b029 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:06.294257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b5eb3-6eb1-4480-b6d9-9ed4bc5320fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:06.294841 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b5eb3-6eb1-4480-b6d9-9ed4bc5320fc None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:06.295123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b5eb3-6eb1-4480-b6d9-9ed4bc5320fc None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:06.295402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b5eb3-6eb1-4480-b6d9-9ed4bc5320fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:06.296239 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b5eb3-6eb1-4480-b6d9-9ed4bc5320fc None admin] RBAC: Adding query filter params (role.id=0b37e8a909204679b705bf258b1cd8f1, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=2fe9f8eb94c84c36ad7a49507b2c8360) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:06.296549 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b5eb3-6eb1-4480-b6d9-9ed4bc5320fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:06.297985 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b5eb3-6eb1-4480-b6d9-9ed4bc5320fc None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:06.303740 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 270/541] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:06 2022] GET /identity/v3/role_assignments?user.id=2fe9f8eb94c84c36ad7a49507b2c8360&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=0b37e8a909204679b705bf258b1cd8f1 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:06.815049 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959713a-6c4d-4360-8cec-fd0519319422 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:06.815567 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959713a-6c4d-4360-8cec-fd0519319422 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:06.815673 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959713a-6c4d-4360-8cec-fd0519319422 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:06.817269 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 272/542] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:06.823500 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f0681-3b01-4b44-b4ad-89f75a656222 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:06.824010 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f0681-3b01-4b44-b4ad-89f75a656222 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:06.824082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f0681-3b01-4b44-b4ad-89f75a656222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:06.844810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-3b7f0681-3b01-4b44-b4ad-89f75a656222 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:06.846480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3b7f0681-3b01-4b44-b4ad-89f75a656222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:06.928431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 271/543] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:06.963926 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959713a-6c4d-4360-8cec-fd0519319422 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:07.107667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959713a-6c4d-4360-8cec-fd0519319422 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:07.149330 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ca048-4d9e-4f2f-9f22-51296e5b2c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:07.150123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ca048-4d9e-4f2f-9f22-51296e5b2c54 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:07.151179 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ca048-4d9e-4f2f-9f22-51296e5b2c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:07.151686 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ca048-4d9e-4f2f-9f22-51296e5b2c54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:07.164242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ca048-4d9e-4f2f-9f22-51296e5b2c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-e51ca048-4d9e-4f2f-9f22-51296e5b2c54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:07.177481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:07.178498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:07.179283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:07.179283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:07.179283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:07.179283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:07.179283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:07.179283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:07.179283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:07.179283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:07.179283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:07.179283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:07.179283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:07.179283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:07.182596 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 273/544] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:07.188664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f0681-3b01-4b44-b4ad-89f75a656222 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:07.305216 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f0681-3b01-4b44-b4ad-89f75a656222 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:07.349713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80becb1c-07eb-4a75-8350-9e6d26f64ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:07.350778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80becb1c-07eb-4a75-8350-9e6d26f64ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:07.351283 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80becb1c-07eb-4a75-8350-9e6d26f64ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:07.351753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80becb1c-07eb-4a75-8350-9e6d26f64ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:07.352774 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80becb1c-07eb-4a75-8350-9e6d26f64ea5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:07.353330 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80becb1c-07eb-4a75-8350-9e6d26f64ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:07.355536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80becb1c-07eb-4a75-8350-9e6d26f64ea5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:07.364573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 272/545] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:07.371290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ca048-4d9e-4f2f-9f22-51296e5b2c54 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:07.464204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e8e89-1664-4544-bf45-958573270199 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:07.464550 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e8e89-1664-4544-bf45-958573270199 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:07.464755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e8e89-1664-4544-bf45-958573270199 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:07.466396 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 273/546] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:29:07.473571 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7804ecb-f6e7-4060-9cd5-98b40e1fee43 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:07.473860 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7804ecb-f6e7-4060-9cd5-98b40e1fee43 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:07.474136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7804ecb-f6e7-4060-9cd5-98b40e1fee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:07.478746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ca048-4d9e-4f2f-9f22-51296e5b2c54 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:07.502159 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f7804ecb-f6e7-4060-9cd5-98b40e1fee43 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:07.513226 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f7804ecb-f6e7-4060-9cd5-98b40e1fee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:07.551344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6f622-84cb-4eb3-a9b2-de68785a2129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:07.555220 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6f622-84cb-4eb3-a9b2-de68785a2129 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:07.555778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6f622-84cb-4eb3-a9b2-de68785a2129 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:07.556254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6f622-84cb-4eb3-a9b2-de68785a2129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:07.575038 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6f622-84cb-4eb3-a9b2-de68785a2129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:07.576982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6f622-84cb-4eb3-a9b2-de68785a2129 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:07.618483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-02b6f622-84cb-4eb3-a9b2-de68785a2129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:07.618483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:07.618483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:07.618483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:07.618483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:07.618483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:07.618483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:07.618483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:07.618483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:07.618483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:07.618483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:07.618483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:07.618483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:07.618483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:07.618483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:07.620160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:07.621154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:07.621154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:07.621154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:07.621154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:07.621154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 274/547] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:07.624647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 274/548] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:29:07.626118 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6f622-84cb-4eb3-a9b2-de68785a2129 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:07.659033 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7804ecb-f6e7-4060-9cd5-98b40e1fee43 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:07.727059 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6f622-84cb-4eb3-a9b2-de68785a2129 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:07.764453 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4d2b9-7dd2-4de0-aaee-103f3d13d5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:07.765118 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4d2b9-7dd2-4de0-aaee-103f3d13d5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:07.765400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4d2b9-7dd2-4de0-aaee-103f3d13d5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:07.765674 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4d2b9-7dd2-4de0-aaee-103f3d13d5a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:07.766418 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4d2b9-7dd2-4de0-aaee-103f3d13d5a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:07.766723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4d2b9-7dd2-4de0-aaee-103f3d13d5a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:07.768093 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4d2b9-7dd2-4de0-aaee-103f3d13d5a1 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:07.791334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 275/549] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:07.797498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4d2b9-7dd2-4de0-aaee-103f3d13d5a1 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:07.854584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7804ecb-f6e7-4060-9cd5-98b40e1fee43 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:07.924278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe647c-e5be-413d-8c05-9dffe48c620c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:07.925012 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe647c-e5be-413d-8c05-9dffe48c620c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:07.925288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe647c-e5be-413d-8c05-9dffe48c620c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:07.925558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe647c-e5be-413d-8c05-9dffe48c620c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:07.953622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe647c-e5be-413d-8c05-9dffe48c620c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-09fe647c-e5be-413d-8c05-9dffe48c620c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:07.961640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:07.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:07.963584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:07.963584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:07.963584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:07.963584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:07.963584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:07.963584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:07.963584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:07.963584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:07.963584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:07.963584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:07.963584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:07.963584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:07.974569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 275/550] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:07.975541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe647c-e5be-413d-8c05-9dffe48c620c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:07.984641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4d2b9-7dd2-4de0-aaee-103f3d13d5a1 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:08.023583 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc884cf8-ba9a-43e8-a970-beea287c616a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:08.024370 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc884cf8-ba9a-43e8-a970-beea287c616a None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:08.024651 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc884cf8-ba9a-43e8-a970-beea287c616a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:08.024923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc884cf8-ba9a-43e8-a970-beea287c616a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:08.036011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc884cf8-ba9a-43e8-a970-beea287c616a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:08.037462 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc884cf8-ba9a-43e8-a970-beea287c616a None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-cc884cf8-ba9a-43e8-a970-beea287c616a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:08.064504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:08.065473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:08.066394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:08.066394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:08.066394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:08.066394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:08.066394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:08.066394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:08.066394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:08.066394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:08.066394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:29:08.066394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:08.067890 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 276/551] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:29:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:08.077450 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc884cf8-ba9a-43e8-a970-beea287c616a None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:08.175804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe647c-e5be-413d-8c05-9dffe48c620c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:08.206981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc884cf8-ba9a-43e8-a970-beea287c616a None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:08.217385 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc346b36-2dd0-4b43-9d2e-f06b796bdd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:08.218545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc346b36-2dd0-4b43-9d2e-f06b796bdd48 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:08.218905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc346b36-2dd0-4b43-9d2e-f06b796bdd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:08.219563 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc346b36-2dd0-4b43-9d2e-f06b796bdd48 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:08.220664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc346b36-2dd0-4b43-9d2e-f06b796bdd48 None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:08.221040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc346b36-2dd0-4b43-9d2e-f06b796bdd48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:08.223029 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc346b36-2dd0-4b43-9d2e-f06b796bdd48 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:08.232876 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 276/552] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:08.234314 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea854f1-bb36-4ee2-a905-1ae2fc3f3f63 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:08.234668 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea854f1-bb36-4ee2-a905-1ae2fc3f3f63 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:08.235034 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea854f1-bb36-4ee2-a905-1ae2fc3f3f63 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:08.240593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 277/553] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:08.241539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea854f1-bb36-4ee2-a905-1ae2fc3f3f63 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:08.244406 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ee0b3-cf52-4921-9fec-da17b362ed94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:08.245102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ee0b3-cf52-4921-9fec-da17b362ed94 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:08.245380 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ee0b3-cf52-4921-9fec-da17b362ed94 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:08.245652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ee0b3-cf52-4921-9fec-da17b362ed94 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:08.246552 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ee0b3-cf52-4921-9fec-da17b362ed94 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:08.246933 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ee0b3-cf52-4921-9fec-da17b362ed94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:08.248485 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ee0b3-cf52-4921-9fec-da17b362ed94 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:08.273142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 277/554] 10.222.0.58 () {56 vars in 1135 bytes} [Thu May 5 15:29:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:08.273142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42864ec-1042-4297-94c8-a9e2a247f4c1 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:08.273142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42864ec-1042-4297-94c8-a9e2a247f4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:08.273142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42864ec-1042-4297-94c8-a9e2a247f4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:08.289754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-d42864ec-1042-4297-94c8-a9e2a247f4c1 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:08.291610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d42864ec-1042-4297-94c8-a9e2a247f4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:08.360673 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 278/555] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:08.361415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea854f1-bb36-4ee2-a905-1ae2fc3f3f63 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:08.361909 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42864ec-1042-4297-94c8-a9e2a247f4c1 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:08.396639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5505e96-5f7f-4382-bf02-281a9de81172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:08.397704 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5505e96-5f7f-4382-bf02-281a9de81172 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:08.398131 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5505e96-5f7f-4382-bf02-281a9de81172 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:08.398568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5505e96-5f7f-4382-bf02-281a9de81172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:08.412064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5505e96-5f7f-4382-bf02-281a9de81172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:08.413799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5505e96-5f7f-4382-bf02-281a9de81172 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:08.431607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-a5505e96-5f7f-4382-bf02-281a9de81172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:08.431607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:08.431607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:08.431607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:08.431607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:08.431607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:08.431607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:08.431607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:08.431607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:08.431607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:08.431607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:08.431607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:08.431607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:08.431607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:08.431607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:08.432479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:08.433314 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:08.433314 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:08.433314 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:08.433314 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:08.435706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 278/556] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:08.436775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5505e96-5f7f-4382-bf02-281a9de81172 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:08.465896 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42864ec-1042-4297-94c8-a9e2a247f4c1 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:08.501896 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997e887-e199-4bd3-ae8b-0b51e5c611b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:08.502593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997e887-e199-4bd3-ae8b-0b51e5c611b9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:08.502873 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997e887-e199-4bd3-ae8b-0b51e5c611b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:08.503287 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997e887-e199-4bd3-ae8b-0b51e5c611b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:08.552893 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5505e96-5f7f-4382-bf02-281a9de81172 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:08.569277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997e887-e199-4bd3-ae8b-0b51e5c611b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:08.570753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997e887-e199-4bd3-ae8b-0b51e5c611b9 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:08.587852 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7727e-8ef2-453c-9bf1-d2d32746593f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:08.588716 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7727e-8ef2-453c-9bf1-d2d32746593f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:08.589000 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7727e-8ef2-453c-9bf1-d2d32746593f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:08.589272 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7727e-8ef2-453c-9bf1-d2d32746593f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:08.599528 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7727e-8ef2-453c-9bf1-d2d32746593f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-fec7727e-8ef2-453c-9bf1-d2d32746593f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:08.607665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:08.608717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:08.609708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:08.609708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:08.609708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:08.609708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:08.609708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:08.609708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:08.609708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:08.609708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:08.609708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:08.609708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:08.609708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:08.609708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:08.609708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 279/557] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:08.610469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7727e-8ef2-453c-9bf1-d2d32746593f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:08.676338 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 279/558] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:29:08.676338 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4d7b6-938c-4e6c-9de8-4a1c0c865d51 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:08.676338 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4d7b6-938c-4e6c-9de8-4a1c0c865d51 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:08.676338 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4d7b6-938c-4e6c-9de8-4a1c0c865d51 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:08.676338 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 280/559] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:08.676338 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4d7b6-938c-4e6c-9de8-4a1c0c865d51 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:08.714588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7727e-8ef2-453c-9bf1-d2d32746593f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:08.747680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9c72a-fc87-4224-a5f6-ef5cc73cdec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:08.748335 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9c72a-fc87-4224-a5f6-ef5cc73cdec6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:08.748613 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9c72a-fc87-4224-a5f6-ef5cc73cdec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:08.748892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9c72a-fc87-4224-a5f6-ef5cc73cdec6 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:08.749608 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9c72a-fc87-4224-a5f6-ef5cc73cdec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:08.749915 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9c72a-fc87-4224-a5f6-ef5cc73cdec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:08.751299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9c72a-fc87-4224-a5f6-ef5cc73cdec6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:08.763712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 280/560] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:08.764534 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9c72a-fc87-4224-a5f6-ef5cc73cdec6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:08.784145 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4d7b6-938c-4e6c-9de8-4a1c0c865d51 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:08.818232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25718bf-3877-4fd7-b690-1a9ead596fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:08.819106 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25718bf-3877-4fd7-b690-1a9ead596fcb None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:08.819942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25718bf-3877-4fd7-b690-1a9ead596fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:08.820358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25718bf-3877-4fd7-b690-1a9ead596fcb None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:08.821515 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25718bf-3877-4fd7-b690-1a9ead596fcb None admin] RBAC: Adding query filter params (name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:08.822284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25718bf-3877-4fd7-b690-1a9ead596fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:08.824522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25718bf-3877-4fd7-b690-1a9ead596fcb None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:08.832870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 281/561] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:08.838321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a4a79-a116-41f9-aeec-6ae8d2cd32b3 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:08.838321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a4a79-a116-41f9-aeec-6ae8d2cd32b3 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:08.838321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a4a79-a116-41f9-aeec-6ae8d2cd32b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:08.853423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-841a4a79-a116-41f9-aeec-6ae8d2cd32b3 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:08.854826 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-841a4a79-a116-41f9-aeec-6ae8d2cd32b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:08.864286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9c72a-fc87-4224-a5f6-ef5cc73cdec6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:08.897248 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3f774-e5bb-4538-b014-41ed3bb29e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:08.898042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3f774-e5bb-4538-b014-41ed3bb29e36 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:08.898344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3f774-e5bb-4538-b014-41ed3bb29e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:08.898612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3f774-e5bb-4538-b014-41ed3bb29e36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:08.909903 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3f774-e5bb-4538-b014-41ed3bb29e36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:08.911397 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3f774-e5bb-4538-b014-41ed3bb29e36 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:08.921475 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 282/562] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:08.923229 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a4a79-a116-41f9-aeec-6ae8d2cd32b3 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:08.930452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-54f3f774-e5bb-4538-b014-41ed3bb29e36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:08.930452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:08.930452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:08.930452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:08.930452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:08.930452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:08.930452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:08.930452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:08.930452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:08.930452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:08.930452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:08.930452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:08.930452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:08.930452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:08.930452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:08.931375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:08.933413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:08.933413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:08.933413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:08.933413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:08.937151 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 281/563] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:08.938135 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3f774-e5bb-4538-b014-41ed3bb29e36 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:09.029685 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a4a79-a116-41f9-aeec-6ae8d2cd32b3 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:09.036888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3f774-e5bb-4538-b014-41ed3bb29e36 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:09.063878 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175a453-053f-47d4-ad69-d39f33a994db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:09.064675 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175a453-053f-47d4-ad69-d39f33a994db None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:09.064954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175a453-053f-47d4-ad69-d39f33a994db None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:09.065230 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175a453-053f-47d4-ad69-d39f33a994db None admin] PATH_INFO: `/v3/users/glance` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:09.070366 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e60de7-cb11-4574-8fe9-17004f7928a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:09.071158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e60de7-cb11-4574-8fe9-17004f7928a7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:09.071438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e60de7-cb11-4574-8fe9-17004f7928a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:09.071708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e60de7-cb11-4574-8fe9-17004f7928a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:09.073537 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175a453-053f-47d4-ad69-d39f33a994db None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:09.075724 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175a453-053f-47d4-ad69-d39f33a994db None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:09.082390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e60de7-cb11-4574-8fe9-17004f7928a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:09.083845 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e60de7-cb11-4574-8fe9-17004f7928a7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-f175a453-053f-47d4-ad69-d39f33a994db None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:09.093705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:09.095161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:09.096226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:09.096226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:09.096226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:09.096226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:09.096226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:09.096226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:09.096226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:09.096226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:09.096226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 05 15:29:09.096226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:09.096226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 283/564] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:29:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:09.097277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175a453-053f-47d4-ad69-d39f33a994db None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:09.106154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-97e60de7-cb11-4574-8fe9-17004f7928a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:09.106154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:09.106154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:09.106154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:09.106154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:09.106154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:09.106154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:09.106154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:09.106154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:09.106154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:09.106154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:09.106154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:09.106154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:09.106154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:09.106154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:09.107036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:09.107863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:09.107863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:09.107863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:09.107863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:09.111766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 282/565] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:09.112614 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e60de7-cb11-4574-8fe9-17004f7928a7 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:09.192679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175a453-053f-47d4-ad69-d39f33a994db None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:09.205945 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e60de7-cb11-4574-8fe9-17004f7928a7 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:09.225080 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11c6d8-614b-4346-88f3-78d594ca2566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:09.225732 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11c6d8-614b-4346-88f3-78d594ca2566 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:09.226006 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11c6d8-614b-4346-88f3-78d594ca2566 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:09.226313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11c6d8-614b-4346-88f3-78d594ca2566 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:09.227024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11c6d8-614b-4346-88f3-78d594ca2566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:09.227321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11c6d8-614b-4346-88f3-78d594ca2566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:09.228719 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11c6d8-614b-4346-88f3-78d594ca2566 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:09.238480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9fbda-d79d-493e-8828-4b2acd17a3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:09.239262 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9fbda-d79d-493e-8828-4b2acd17a3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:09.239391 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 284/566] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:09.239556 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9fbda-d79d-493e-8828-4b2acd17a3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:09.239813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9fbda-d79d-493e-8828-4b2acd17a3b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:09.240068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11c6d8-614b-4346-88f3-78d594ca2566 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:09.249904 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9fbda-d79d-493e-8828-4b2acd17a3b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-50c9fbda-d79d-493e-8828-4b2acd17a3b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:09.257514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:09.258512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:09.259331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:09.259331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:09.259331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:09.259331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:09.259331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:09.259331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:09.259331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:09.259331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:09.259331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:09.259331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:09.259331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:09.259331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:09.259331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 283/567] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:09.262287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e972600-3051-4cd8-8878-c58aa49bc782 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:09.262581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e972600-3051-4cd8-8878-c58aa49bc782 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:09.262860 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e972600-3051-4cd8-8878-c58aa49bc782 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:09.265505 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 284/568] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:09.265505 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e972600-3051-4cd8-8878-c58aa49bc782 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:09.335271 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11c6d8-614b-4346-88f3-78d594ca2566 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:09.361167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e972600-3051-4cd8-8878-c58aa49bc782 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:09.366640 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00370d40-36f6-44b2-9c40-28229b47a9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:09.367293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00370d40-36f6-44b2-9c40-28229b47a9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:09.367576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00370d40-36f6-44b2-9c40-28229b47a9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:09.367840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00370d40-36f6-44b2-9c40-28229b47a9e8 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:09.368648 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00370d40-36f6-44b2-9c40-28229b47a9e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:09.369525 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00370d40-36f6-44b2-9c40-28229b47a9e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:09.370957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00370d40-36f6-44b2-9c40-28229b47a9e8 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:09.387181 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 285/569] 10.222.0.58 () {56 vars in 1137 bytes} [Thu May 5 15:29:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:09.387959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00370d40-36f6-44b2-9c40-28229b47a9e8 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:09.393119 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda21aa-ec95-46e5-8a5c-a9b571fd3077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:09.393770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda21aa-ec95-46e5-8a5c-a9b571fd3077 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:09.394049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda21aa-ec95-46e5-8a5c-a9b571fd3077 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:09.394359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda21aa-ec95-46e5-8a5c-a9b571fd3077 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:09.395088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda21aa-ec95-46e5-8a5c-a9b571fd3077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:09.395392 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda21aa-ec95-46e5-8a5c-a9b571fd3077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:09.396735 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda21aa-ec95-46e5-8a5c-a9b571fd3077 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:09.408262 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 285/570] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:09.409040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda21aa-ec95-46e5-8a5c-a9b571fd3077 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:09.480237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00370d40-36f6-44b2-9c40-28229b47a9e8 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:09.504420 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda21aa-ec95-46e5-8a5c-a9b571fd3077 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:09.514512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657cbf1-b4d0-495d-8240-be70586b8c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:09.515305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657cbf1-b4d0-495d-8240-be70586b8c2d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:09.515592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657cbf1-b4d0-495d-8240-be70586b8c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:09.515867 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657cbf1-b4d0-495d-8240-be70586b8c2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:09.522657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657cbf1-b4d0-495d-8240-be70586b8c2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:09.524086 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657cbf1-b4d0-495d-8240-be70586b8c2d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:09.536587 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545e709-71c5-49e1-a3b2-49f3fdb74383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:09.537240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e709-71c5-49e1-a3b2-49f3fdb74383 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:09.537520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e709-71c5-49e1-a3b2-49f3fdb74383 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:09.537791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e709-71c5-49e1-a3b2-49f3fdb74383 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:09.538088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-4657cbf1-b4d0-495d-8240-be70586b8c2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:09.538088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:09.538088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:09.538088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:09.538088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:09.538088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:09.538088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:09.538088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:09.538088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:09.538088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:09.538088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:09.538088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:09.538088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:09.538088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:09.538088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:09.539020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:09.540340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:09.540340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:09.540340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:09.540340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:09.540340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:09.540340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:09.540340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:09.540340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:09.541276 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545e709-71c5-49e1-a3b2-49f3fdb74383 None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:09.541276 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545e709-71c5-49e1-a3b2-49f3fdb74383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:09.541407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 286/571] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:09.541472 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545e709-71c5-49e1-a3b2-49f3fdb74383 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:09.541546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acd846-712c-44f2-bf8a-c1f82d6cf820 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:09.541546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acd846-712c-44f2-bf8a-c1f82d6cf820 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:09.541546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acd846-712c-44f2-bf8a-c1f82d6cf820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:09.551725 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 286/572] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:09.552530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545e709-71c5-49e1-a3b2-49f3fdb74383 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:09.557585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-98acd846-712c-44f2-bf8a-c1f82d6cf820 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:09.558800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-98acd846-712c-44f2-bf8a-c1f82d6cf820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:09.623592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 287/573] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:09.624261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acd846-712c-44f2-bf8a-c1f82d6cf820 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:09.646851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545e709-71c5-49e1-a3b2-49f3fdb74383 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:09.679536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f596470-931b-45ec-9948-6fe1d3a1289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:09.680319 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f596470-931b-45ec-9948-6fe1d3a1289f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:09.680601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f596470-931b-45ec-9948-6fe1d3a1289f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:09.680873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f596470-931b-45ec-9948-6fe1d3a1289f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:09.691768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f596470-931b-45ec-9948-6fe1d3a1289f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:09.693186 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f596470-931b-45ec-9948-6fe1d3a1289f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:09.709343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-0f596470-931b-45ec-9948-6fe1d3a1289f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:09.709343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:09.709343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:09.709343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:09.709343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:09.709343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:09.709343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:09.709343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:09.709343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:09.709343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:09.709343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:09.709343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:09.709343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:09.709343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:09.709343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:09.710247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:09.711228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:09.711228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:09.711228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:09.711228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:09.711228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 287/574] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:09.711801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f596470-931b-45ec-9948-6fe1d3a1289f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:09.723162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acd846-712c-44f2-bf8a-c1f82d6cf820 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:09.755562 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f446f0-542b-496f-b481-30a7a5d4b6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:09.756338 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f446f0-542b-496f-b481-30a7a5d4b6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:09.756621 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f446f0-542b-496f-b481-30a7a5d4b6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:09.756897 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f446f0-542b-496f-b481-30a7a5d4b6e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:09.763735 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f446f0-542b-496f-b481-30a7a5d4b6e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:09.765174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f446f0-542b-496f-b481-30a7a5d4b6e7 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-22f446f0-542b-496f-b481-30a7a5d4b6e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:09.779613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:09.780540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:09.781466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:09.781466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:09.781466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:09.781466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:09.781466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:09.781466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:09.781466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:09.781466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:09.781466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:29:09.781466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:09.781466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 288/575] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 5 15:29:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:09.782117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f446f0-542b-496f-b481-30a7a5d4b6e7 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:09.805446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f596470-931b-45ec-9948-6fe1d3a1289f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:09.836140 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a1570-672b-4318-8675-09177aa6cb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:09.836783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a1570-672b-4318-8675-09177aa6cb57 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:09.837061 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a1570-672b-4318-8675-09177aa6cb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:09.837331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a1570-672b-4318-8675-09177aa6cb57 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:09.838658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a1570-672b-4318-8675-09177aa6cb57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:09.838961 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a1570-672b-4318-8675-09177aa6cb57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:09.840368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a1570-672b-4318-8675-09177aa6cb57 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:09.851861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 288/576] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:09.852639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a1570-672b-4318-8675-09177aa6cb57 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:09.877171 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f446f0-542b-496f-b481-30a7a5d4b6e7 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:09.909667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9eb2b-b52d-405e-9fc4-cc61380ed34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:09.910474 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9eb2b-b52d-405e-9fc4-cc61380ed34e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:09.910758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9eb2b-b52d-405e-9fc4-cc61380ed34e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:09.911032 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9eb2b-b52d-405e-9fc4-cc61380ed34e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:09.921589 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9eb2b-b52d-405e-9fc4-cc61380ed34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:09.923055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9eb2b-b52d-405e-9fc4-cc61380ed34e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:09.940746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-65a9eb2b-b52d-405e-9fc4-cc61380ed34e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:09.940746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:09.940746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:09.940746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:09.940746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:09.940746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:09.940746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:09.940746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:09.940746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:09.940746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:09.940746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:09.940746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:09.940746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:09.940746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:09.940746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:09.941628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:09.942884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:09.942884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:09.942884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:09.942884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:09.942884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 289/577] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:09.942884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9eb2b-b52d-405e-9fc4-cc61380ed34e None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:09.944814 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a1570-672b-4318-8675-09177aa6cb57 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:09.976754 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6d000-30e8-4a68-bc63-6cd752055c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:09.977531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6d000-30e8-4a68-bc63-6cd752055c90 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:09.977813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6d000-30e8-4a68-bc63-6cd752055c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:09.978086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6d000-30e8-4a68-bc63-6cd752055c90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:09.988469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6d000-30e8-4a68-bc63-6cd752055c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-37d6d000-30e8-4a68-bc63-6cd752055c90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:09.996625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:09.997724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:09.998634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:09.998634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:09.998634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:09.998634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:09.998634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:09.998634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:09.998634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:09.998634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:09.998634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:09.998634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:09.998634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:09.998634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:09.998634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 289/578] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:09.999316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6d000-30e8-4a68-bc63-6cd752055c90 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:10.034863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9eb2b-b52d-405e-9fc4-cc61380ed34e None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:10.067373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829de24-e596-4a4f-9b03-3ec5a48a9455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:10.068019 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829de24-e596-4a4f-9b03-3ec5a48a9455 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:10.068295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829de24-e596-4a4f-9b03-3ec5a48a9455 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:10.068563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829de24-e596-4a4f-9b03-3ec5a48a9455 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:10.069263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829de24-e596-4a4f-9b03-3ec5a48a9455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:10.069561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829de24-e596-4a4f-9b03-3ec5a48a9455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:10.070936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829de24-e596-4a4f-9b03-3ec5a48a9455 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:10.081613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 290/579] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:10.082413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829de24-e596-4a4f-9b03-3ec5a48a9455 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:10.091039 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6d000-30e8-4a68-bc63-6cd752055c90 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:10.129720 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c218a-574b-4001-a019-ff2aceec06d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:10.130338 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c218a-574b-4001-a019-ff2aceec06d0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:10.130618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c218a-574b-4001-a019-ff2aceec06d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:10.130890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c218a-574b-4001-a019-ff2aceec06d0 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:10.131718 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c218a-574b-4001-a019-ff2aceec06d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:10.132020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c218a-574b-4001-a019-ff2aceec06d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:10.133422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c218a-574b-4001-a019-ff2aceec06d0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:10.155703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 290/580] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 5 15:29:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:10.156515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c218a-574b-4001-a019-ff2aceec06d0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:10.177350 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829de24-e596-4a4f-9b03-3ec5a48a9455 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:10.208795 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d180c7-e003-45eb-a09f-5870435f93fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:10.209436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d180c7-e003-45eb-a09f-5870435f93fd None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:10.209714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d180c7-e003-45eb-a09f-5870435f93fd None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:10.209990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d180c7-e003-45eb-a09f-5870435f93fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:10.210823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d180c7-e003-45eb-a09f-5870435f93fd None admin] RBAC: Adding query filter params (role.id=0b37e8a909204679b705bf258b1cd8f1, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=a90b5737f2c345b08460d291ccf49466) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:10.211135 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d180c7-e003-45eb-a09f-5870435f93fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:10.212565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d180c7-e003-45eb-a09f-5870435f93fd None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:10.218291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 291/581] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:10 2022] GET /identity/v3/role_assignments?user.id=a90b5737f2c345b08460d291ccf49466&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=0b37e8a909204679b705bf258b1cd8f1 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:10.219048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d180c7-e003-45eb-a09f-5870435f93fd None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:10.255245 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c218a-574b-4001-a019-ff2aceec06d0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:10.290330 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546366f-3bb3-4b28-9f43-46fb314c2469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:10.291644 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546366f-3bb3-4b28-9f43-46fb314c2469 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:10.292104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546366f-3bb3-4b28-9f43-46fb314c2469 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:10.292374 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546366f-3bb3-4b28-9f43-46fb314c2469 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:10.293104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546366f-3bb3-4b28-9f43-46fb314c2469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:10.293410 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546366f-3bb3-4b28-9f43-46fb314c2469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:10.294824 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546366f-3bb3-4b28-9f43-46fb314c2469 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:10.307032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 291/582] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:10.307919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546366f-3bb3-4b28-9f43-46fb314c2469 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:10.331304 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d180c7-e003-45eb-a09f-5870435f93fd None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:10.372998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc28c12-8f1b-4ffb-beb9-d9d46d0bdad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:10.373680 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28c12-8f1b-4ffb-beb9-d9d46d0bdad6 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:10.373956 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28c12-8f1b-4ffb-beb9-d9d46d0bdad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:10.374259 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28c12-8f1b-4ffb-beb9-d9d46d0bdad6 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:10.375035 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc28c12-8f1b-4ffb-beb9-d9d46d0bdad6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:10.375337 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc28c12-8f1b-4ffb-beb9-d9d46d0bdad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:10.376731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc28c12-8f1b-4ffb-beb9-d9d46d0bdad6 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:10.386651 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 292/583] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:10.387253 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc28c12-8f1b-4ffb-beb9-d9d46d0bdad6 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:10.421078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546366f-3bb3-4b28-9f43-46fb314c2469 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:10.454768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7555645-efd0-4176-9990-fe23e0e158e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:10.455568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7555645-efd0-4176-9990-fe23e0e158e1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:10.455845 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7555645-efd0-4176-9990-fe23e0e158e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:10.456114 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7555645-efd0-4176-9990-fe23e0e158e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:10.462883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7555645-efd0-4176-9990-fe23e0e158e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:10.464324 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7555645-efd0-4176-9990-fe23e0e158e1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:10.478308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-f7555645-efd0-4176-9990-fe23e0e158e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:10.478308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:10.478308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:10.478308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:10.478308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:10.478308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:10.478308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:10.478308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:10.478308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:10.478308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:10.478308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:10.478308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:10.478308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:10.478308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:10.478308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:10.479384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:10.480265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:10.480265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:10.480265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:10.480265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:10.480265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:10.480265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:10.480265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:10.480265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:10.480265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 292/584] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:10.480265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7555645-efd0-4176-9990-fe23e0e158e1 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:10.491987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc28c12-8f1b-4ffb-beb9-d9d46d0bdad6 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:10.533552 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8c00c-b882-4a41-8e22-cdfe757f7166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:10.534404 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8c00c-b882-4a41-8e22-cdfe757f7166 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:10.534684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8c00c-b882-4a41-8e22-cdfe757f7166 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:10.534954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8c00c-b882-4a41-8e22-cdfe757f7166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:10.545061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8c00c-b882-4a41-8e22-cdfe757f7166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:10.546512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8c00c-b882-4a41-8e22-cdfe757f7166 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:10.563936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-bcb8c00c-b882-4a41-8e22-cdfe757f7166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:10.563936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:10.563936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:10.563936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:10.563936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:10.563936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:10.563936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:10.563936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:10.563936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:10.563936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:10.563936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:10.563936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:10.563936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:10.563936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:10.563936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:10.565110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:10.566255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:10.566255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:10.566255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:10.566255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:10.569603 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 293/585] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:10.570310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8c00c-b882-4a41-8e22-cdfe757f7166 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:10.585971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7555645-efd0-4176-9990-fe23e0e158e1 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:10.618469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b434e-13df-46d9-8f1d-ccdd009ff19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:10.620051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b434e-13df-46d9-8f1d-ccdd009ff19b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:10.620326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b434e-13df-46d9-8f1d-ccdd009ff19b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:10.620594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b434e-13df-46d9-8f1d-ccdd009ff19b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:10.627642 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b434e-13df-46d9-8f1d-ccdd009ff19b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:10.629069 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b434e-13df-46d9-8f1d-ccdd009ff19b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-c45b434e-13df-46d9-8f1d-ccdd009ff19b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:10.643857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:10.644755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:10.645697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:10.645697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:10.645697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:10.645697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:10.645697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:10.645697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:10.645697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:10.645697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:10.645697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:29:10.645697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:10.645697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 293/586] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:29:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:10.646296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b434e-13df-46d9-8f1d-ccdd009ff19b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:10.672740 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8c00c-b882-4a41-8e22-cdfe757f7166 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:10.705196 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de3d53-cb8e-4247-8c45-3f6fe3f29f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:10.706044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de3d53-cb8e-4247-8c45-3f6fe3f29f5e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:10.706398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de3d53-cb8e-4247-8c45-3f6fe3f29f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:10.706720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de3d53-cb8e-4247-8c45-3f6fe3f29f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:10.718069 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de3d53-cb8e-4247-8c45-3f6fe3f29f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:10.719592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de3d53-cb8e-4247-8c45-3f6fe3f29f5e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:10.738272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-77de3d53-cb8e-4247-8c45-3f6fe3f29f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:10.738272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:10.738272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:10.738272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:10.738272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:10.738272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:10.738272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:10.738272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:10.738272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:10.738272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:10.738272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:10.738272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:10.738272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:10.738272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:10.738272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:10.739241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:10.740147 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:10.740147 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:10.740147 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:10.740147 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:10.743342 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b434e-13df-46d9-8f1d-ccdd009ff19b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:10.744452 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 294/587] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:10.745134 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de3d53-cb8e-4247-8c45-3f6fe3f29f5e None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:10.779266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9200c-2375-4257-8c06-4ce15cd100b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:10.779910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9200c-2375-4257-8c06-4ce15cd100b6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:10.780298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9200c-2375-4257-8c06-4ce15cd100b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:10.780573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9200c-2375-4257-8c06-4ce15cd100b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:10.781350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9200c-2375-4257-8c06-4ce15cd100b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:10.781657 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9200c-2375-4257-8c06-4ce15cd100b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:10.783107 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9200c-2375-4257-8c06-4ce15cd100b6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:10.799955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 294/588] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:10.799955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9200c-2375-4257-8c06-4ce15cd100b6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:10.848847 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de3d53-cb8e-4247-8c45-3f6fe3f29f5e None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:10.882238 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867dd9aa-db23-4e77-aaab-aa6c3ef86dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:10.882889 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dd9aa-db23-4e77-aaab-aa6c3ef86dfe None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:10.883170 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dd9aa-db23-4e77-aaab-aa6c3ef86dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:10.883443 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dd9aa-db23-4e77-aaab-aa6c3ef86dfe None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:10.884157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867dd9aa-db23-4e77-aaab-aa6c3ef86dfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:10.885152 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867dd9aa-db23-4e77-aaab-aa6c3ef86dfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:10.886701 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867dd9aa-db23-4e77-aaab-aa6c3ef86dfe None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:10.891291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9200c-2375-4257-8c06-4ce15cd100b6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:10.902869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 295/589] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:10.902869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867dd9aa-db23-4e77-aaab-aa6c3ef86dfe None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:10.924493 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79032999-cb4e-49d5-bd05-75ddd913e970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:10.925163 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79032999-cb4e-49d5-bd05-75ddd913e970 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:10.925443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79032999-cb4e-49d5-bd05-75ddd913e970 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:10.925714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79032999-cb4e-49d5-bd05-75ddd913e970 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:10.926579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79032999-cb4e-49d5-bd05-75ddd913e970 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:10.926887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79032999-cb4e-49d5-bd05-75ddd913e970 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:10.928299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79032999-cb4e-49d5-bd05-75ddd913e970 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:10.945388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 295/590] 10.222.0.58 () {56 vars in 1137 bytes} [Thu May 5 15:29:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:10.946062 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79032999-cb4e-49d5-bd05-75ddd913e970 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:11.003951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867dd9aa-db23-4e77-aaab-aa6c3ef86dfe None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:11.042188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25f44a-3ad3-4e4c-82eb-d9093a338777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:11.042837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79032999-cb4e-49d5-bd05-75ddd913e970 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:11.042938 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25f44a-3ad3-4e4c-82eb-d9093a338777 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:11.043187 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25f44a-3ad3-4e4c-82eb-d9093a338777 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:11.043364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25f44a-3ad3-4e4c-82eb-d9093a338777 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:11.044079 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25f44a-3ad3-4e4c-82eb-d9093a338777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:11.044485 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25f44a-3ad3-4e4c-82eb-d9093a338777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:11.045854 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25f44a-3ad3-4e4c-82eb-d9093a338777 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:11.061804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 296/591] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:11.061804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25f44a-3ad3-4e4c-82eb-d9093a338777 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:11.087019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a75079-6caa-4edf-9588-5abf1b5d1b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:11.088172 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a75079-6caa-4edf-9588-5abf1b5d1b0e None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:11.088563 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a75079-6caa-4edf-9588-5abf1b5d1b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:11.088906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a75079-6caa-4edf-9588-5abf1b5d1b0e None admin] PATH_INFO: `/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/ab6c13dc02ba49d0be523fa9a73fdf5e/roles/0b37e8a909204679b705bf258b1cd8f1` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:11.104690 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a75079-6caa-4edf-9588-5abf1b5d1b0e None admin] RBAC: Authorizing `identity:create_grant(project_id=bdd58b84c6394504beb84d13d13d60a1, user_id=ab6c13dc02ba49d0be523fa9a73fdf5e, role_id=0b37e8a909204679b705bf258b1cd8f1)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:11.106201 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a75079-6caa-4edf-9588-5abf1b5d1b0e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:11.130264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 296/592] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:29:10 2022] PUT /identity/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/ab6c13dc02ba49d0be523fa9a73fdf5e/roles/0b37e8a909204679b705bf258b1cd8f1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:29:11.131308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a75079-6caa-4edf-9588-5abf1b5d1b0e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:11.163237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25f44a-3ad3-4e4c-82eb-d9093a338777 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:11.200998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa2ab5-a7ce-42a0-b230-2bfb00dedbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:11.201511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa2ab5-a7ce-42a0-b230-2bfb00dedbab None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:11.201791 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa2ab5-a7ce-42a0-b230-2bfb00dedbab None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:11.202065 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa2ab5-a7ce-42a0-b230-2bfb00dedbab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:11.209839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa2ab5-a7ce-42a0-b230-2bfb00dedbab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:11.211490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa2ab5-a7ce-42a0-b230-2bfb00dedbab None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:11.227424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-bbfa2ab5-a7ce-42a0-b230-2bfb00dedbab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:11.227424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:11.227424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:11.227424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:11.227424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:11.227424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:11.227424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:11.227424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:11.227424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:11.227424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:11.227424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:11.227424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:11.227424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:11.227424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:11.227424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:11.228714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:11.229614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:11.229614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:11.229614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:11.229614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:11.229614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:11.229614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:11.229614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:11.229614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:11.233507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 297/593] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:11.234487 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa2ab5-a7ce-42a0-b230-2bfb00dedbab None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:11.254279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a75079-6caa-4edf-9588-5abf1b5d1b0e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:11.292744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1baeabc-4d9e-4d0d-9f5f-a33df4cefc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:11.294033 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1baeabc-4d9e-4d0d-9f5f-a33df4cefc26 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:11.294569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1baeabc-4d9e-4d0d-9f5f-a33df4cefc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:11.295136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1baeabc-4d9e-4d0d-9f5f-a33df4cefc26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:11.307027 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1baeabc-4d9e-4d0d-9f5f-a33df4cefc26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:11.309052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1baeabc-4d9e-4d0d-9f5f-a33df4cefc26 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:11.328835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-a1baeabc-4d9e-4d0d-9f5f-a33df4cefc26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:11.328835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:11.328835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:11.328835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:11.328835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:11.328835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:11.328835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:11.328835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:11.328835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:11.328835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:11.328835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:11.328835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:11.328835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:11.328835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:11.328835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:11.329800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:11.330686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:11.330686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:11.330686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:11.330686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:11.332945 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 297/594] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:11.333936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1baeabc-4d9e-4d0d-9f5f-a33df4cefc26 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:11.341185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa2ab5-a7ce-42a0-b230-2bfb00dedbab None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:11.379227 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda0b70-4695-436a-948e-071accd8bf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:11.383047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda0b70-4695-436a-948e-071accd8bf58 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:11.383612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda0b70-4695-436a-948e-071accd8bf58 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:11.384101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda0b70-4695-436a-948e-071accd8bf58 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:11.395117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda0b70-4695-436a-948e-071accd8bf58 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:11.397200 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda0b70-4695-436a-948e-071accd8bf58 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-9cda0b70-4695-436a-948e-071accd8bf58 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:11.417507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:11.418652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:11.419805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:11.419805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:11.419805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:11.419805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:11.419805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:11.419805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:11.419805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:11.419805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:11.419805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:29:11.419805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:11.422009 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 298/595] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:11.422957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda0b70-4695-436a-948e-071accd8bf58 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:11.453158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1baeabc-4d9e-4d0d-9f5f-a33df4cefc26 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:11.497858 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17841194-1caa-4acc-9457-326743885e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:11.498539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17841194-1caa-4acc-9457-326743885e5a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:11.498815 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17841194-1caa-4acc-9457-326743885e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:11.499082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17841194-1caa-4acc-9457-326743885e5a None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:11.499892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17841194-1caa-4acc-9457-326743885e5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:11.500167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17841194-1caa-4acc-9457-326743885e5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:11.501578 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17841194-1caa-4acc-9457-326743885e5a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:11.518220 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 298/596] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:11.518220 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17841194-1caa-4acc-9457-326743885e5a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:11.569675 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda0b70-4695-436a-948e-071accd8bf58 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:11.613591 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d24423-52fa-4f1b-823f-631c55fb8e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:11.614796 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d24423-52fa-4f1b-823f-631c55fb8e71 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:11.615407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d24423-52fa-4f1b-823f-631c55fb8e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:11.615875 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d24423-52fa-4f1b-823f-631c55fb8e71 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:11.617278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d24423-52fa-4f1b-823f-631c55fb8e71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:11.617729 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d24423-52fa-4f1b-823f-631c55fb8e71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:11.619232 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17841194-1caa-4acc-9457-326743885e5a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:11.619710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d24423-52fa-4f1b-823f-631c55fb8e71 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:11.632372 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 299/597] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:11.633349 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d24423-52fa-4f1b-823f-631c55fb8e71 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:11.660215 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59e4b8-5329-4459-90f2-21c818ed4d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:11.661412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59e4b8-5329-4459-90f2-21c818ed4d48 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:11.661975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59e4b8-5329-4459-90f2-21c818ed4d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:11.662516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59e4b8-5329-4459-90f2-21c818ed4d48 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:11.663675 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59e4b8-5329-4459-90f2-21c818ed4d48 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:11.664426 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59e4b8-5329-4459-90f2-21c818ed4d48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:11.666847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59e4b8-5329-4459-90f2-21c818ed4d48 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:11.689003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 299/598] 10.222.0.58 () {56 vars in 1139 bytes} [Thu May 5 15:29:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:11.690184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59e4b8-5329-4459-90f2-21c818ed4d48 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:11.737471 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d24423-52fa-4f1b-823f-631c55fb8e71 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:11.771143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5024a-fa70-4192-80dd-355ce95e413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:11.772261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5024a-fa70-4192-80dd-355ce95e413d None admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:11.772636 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5024a-fa70-4192-80dd-355ce95e413d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:11.773000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5024a-fa70-4192-80dd-355ce95e413d None admin] PATH_INFO: `/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/2a29a4b1b1aa45aea2e466d8f8b79365/roles/0b37e8a909204679b705bf258b1cd8f1` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:11.787755 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5024a-fa70-4192-80dd-355ce95e413d None admin] RBAC: Authorizing `identity:create_grant(project_id=bdd58b84c6394504beb84d13d13d60a1, user_id=2a29a4b1b1aa45aea2e466d8f8b79365, role_id=0b37e8a909204679b705bf258b1cd8f1)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:11.789509 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5024a-fa70-4192-80dd-355ce95e413d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:11.806247 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 300/599] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:29:11 2022] PUT /identity/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/2a29a4b1b1aa45aea2e466d8f8b79365/roles/0b37e8a909204679b705bf258b1cd8f1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:29:11.807139 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5024a-fa70-4192-80dd-355ce95e413d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:11.827361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59e4b8-5329-4459-90f2-21c818ed4d48 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:11.913699 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386d104-bfde-41f7-840e-820de66b802e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:11.914537 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386d104-bfde-41f7-840e-820de66b802e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:11.914813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386d104-bfde-41f7-840e-820de66b802e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:11.915083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386d104-bfde-41f7-840e-820de66b802e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:11.931072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386d104-bfde-41f7-840e-820de66b802e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:11.933391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386d104-bfde-41f7-840e-820de66b802e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:11.959603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-4386d104-bfde-41f7-840e-820de66b802e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:11.959603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:11.959603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:11.959603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:11.959603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:11.959603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:11.959603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:11.959603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:11.959603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:11.959603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:11.959603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:11.959603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:11.959603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:11.959603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:11.959603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:11.960947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:11.963005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:11.963005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:11.963005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:11.963005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:11.963005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:11.963005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:11.963005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:11.963005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:11.964362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 300/600] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:11.974820 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386d104-bfde-41f7-840e-820de66b802e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:11.991036 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5024a-fa70-4192-80dd-355ce95e413d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:12.037679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56beba7-974b-4e86-8916-f52cad65850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:12.038563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56beba7-974b-4e86-8916-f52cad65850d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:12.038840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56beba7-974b-4e86-8916-f52cad65850d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:12.039113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56beba7-974b-4e86-8916-f52cad65850d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:12.051407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56beba7-974b-4e86-8916-f52cad65850d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:12.053750 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56beba7-974b-4e86-8916-f52cad65850d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:12.072799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-b56beba7-974b-4e86-8916-f52cad65850d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:12.072799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:12.072799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:12.072799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:12.072799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:12.072799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:12.072799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:12.072799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:12.072799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:12.072799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:12.072799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:12.072799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:12.072799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:12.072799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:12.072799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:12.074998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:12.077183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:12.077183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:12.077183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:12.077183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:12.077183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 301/601] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:12.086190 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56beba7-974b-4e86-8916-f52cad65850d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:12.107563 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386d104-bfde-41f7-840e-820de66b802e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:12.148402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfeeef-b2b6-49e0-946d-8555e4e9b5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:12.149077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfeeef-b2b6-49e0-946d-8555e4e9b5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:12.149356 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfeeef-b2b6-49e0-946d-8555e4e9b5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:12.149624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfeeef-b2b6-49e0-946d-8555e4e9b5d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:12.150958 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfeeef-b2b6-49e0-946d-8555e4e9b5d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:12.151267 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfeeef-b2b6-49e0-946d-8555e4e9b5d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:12.152691 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfeeef-b2b6-49e0-946d-8555e4e9b5d5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:12.165228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 301/602] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:12.172068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfeeef-b2b6-49e0-946d-8555e4e9b5d5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:12.182727 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56beba7-974b-4e86-8916-f52cad65850d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:12.220429 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775c5e3-f45f-4e5d-a8ab-5e4eac574841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:12.220982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775c5e3-f45f-4e5d-a8ab-5e4eac574841 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:12.222213 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775c5e3-f45f-4e5d-a8ab-5e4eac574841 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:12.222213 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775c5e3-f45f-4e5d-a8ab-5e4eac574841 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:12.222553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775c5e3-f45f-4e5d-a8ab-5e4eac574841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:12.224788 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775c5e3-f45f-4e5d-a8ab-5e4eac574841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:12.226821 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775c5e3-f45f-4e5d-a8ab-5e4eac574841 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:12.253020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 302/603] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:12.260084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775c5e3-f45f-4e5d-a8ab-5e4eac574841 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:12.358663 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfeeef-b2b6-49e0-946d-8555e4e9b5d5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:12.429531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ba36b-a1e5-4e11-a622-9bfed2b6d316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:12.430447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ba36b-a1e5-4e11-a622-9bfed2b6d316 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:12.430722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ba36b-a1e5-4e11-a622-9bfed2b6d316 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:12.430990 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ba36b-a1e5-4e11-a622-9bfed2b6d316 None admin] PATH_INFO: `/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/bb9a301df6534b499d60486060df7068/roles/0b37e8a909204679b705bf258b1cd8f1` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:12.454943 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775c5e3-f45f-4e5d-a8ab-5e4eac574841 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:12.463601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ba36b-a1e5-4e11-a622-9bfed2b6d316 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdd58b84c6394504beb84d13d13d60a1, user_id=bb9a301df6534b499d60486060df7068, role_id=0b37e8a909204679b705bf258b1cd8f1)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:12.465065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ba36b-a1e5-4e11-a622-9bfed2b6d316 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:12.489294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3917cd-652d-4332-b610-997a519bde81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:12.490102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3917cd-652d-4332-b610-997a519bde81 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:12.490410 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3917cd-652d-4332-b610-997a519bde81 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:12.490683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3917cd-652d-4332-b610-997a519bde81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:12.496253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 302/604] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:29:12 2022] PUT /identity/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/bb9a301df6534b499d60486060df7068/roles/0b37e8a909204679b705bf258b1cd8f1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:29:12.498403 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3917cd-652d-4332-b610-997a519bde81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:12.499982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3917cd-652d-4332-b610-997a519bde81 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:12.518217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-6c3917cd-652d-4332-b610-997a519bde81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:12.518217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:12.518217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:12.518217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:12.518217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:12.518217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:12.518217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:12.518217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:12.518217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:12.518217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:12.518217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:12.518217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:12.518217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:12.518217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:12.518217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:12.520413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:12.522607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:12.522607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:12.522607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:12.522607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:12.522607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:12.522607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:12.522607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:12.522607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:12.522607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 303/605] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:12.527517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ba36b-a1e5-4e11-a622-9bfed2b6d316 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:12.597683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4685c50-e96d-427d-8e51-bad298871786 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:12.597683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4685c50-e96d-427d-8e51-bad298871786 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:12.597683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4685c50-e96d-427d-8e51-bad298871786 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:12.600173 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 304/606] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:29:12.605094 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16aee7e-09ae-41c3-a8e7-c5956b1cb5eb None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:12.605677 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16aee7e-09ae-41c3-a8e7-c5956b1cb5eb None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:12.606203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16aee7e-09ae-41c3-a8e7-c5956b1cb5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:12.624467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-d16aee7e-09ae-41c3-a8e7-c5956b1cb5eb None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:12.626034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d16aee7e-09ae-41c3-a8e7-c5956b1cb5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:12.702324 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ba36b-a1e5-4e11-a622-9bfed2b6d316 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:12.733321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 305/607] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:29:12.755643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd53f7-3877-4735-b27b-2092daf5a039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:12.756243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd53f7-3877-4735-b27b-2092daf5a039 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:12.756525 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd53f7-3877-4735-b27b-2092daf5a039 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:12.756807 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd53f7-3877-4735-b27b-2092daf5a039 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:12.757597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd53f7-3877-4735-b27b-2092daf5a039 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:12.757906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd53f7-3877-4735-b27b-2092daf5a039 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:12.760934 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd53f7-3877-4735-b27b-2092daf5a039 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:12.762105 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16aee7e-09ae-41c3-a8e7-c5956b1cb5eb None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:12.773250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 303/608] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:12.779598 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd53f7-3877-4735-b27b-2092daf5a039 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:12.871679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16aee7e-09ae-41c3-a8e7-c5956b1cb5eb None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:12.879950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd53f7-3877-4735-b27b-2092daf5a039 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:12.907705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f90c5a-f52b-4703-bb80-d407a7c3e17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:12.908861 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f90c5a-f52b-4703-bb80-d407a7c3e17f None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:12.909348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f90c5a-f52b-4703-bb80-d407a7c3e17f None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:12.909848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f90c5a-f52b-4703-bb80-d407a7c3e17f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:12.914416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f5032-f52c-48bc-953c-f97830d86cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:12.915358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f5032-f52c-48bc-953c-f97830d86cc4 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:12.916252 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f5032-f52c-48bc-953c-f97830d86cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:12.916707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f5032-f52c-48bc-953c-f97830d86cc4 None admin] PATH_INFO: `/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/2fe9f8eb94c84c36ad7a49507b2c8360/roles/0b37e8a909204679b705bf258b1cd8f1` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:12.922634 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f90c5a-f52b-4703-bb80-d407a7c3e17f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-77f90c5a-f52b-4703-bb80-d407a7c3e17f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:12.930762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:12.932231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:12.933075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:12.933075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:12.933075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:12.933075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:12.933075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:12.933075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:12.933075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:12.933075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:12.933075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:12.933075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:12.933075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:12.933075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:12.933715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f5032-f52c-48bc-953c-f97830d86cc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdd58b84c6394504beb84d13d13d60a1, user_id=2fe9f8eb94c84c36ad7a49507b2c8360, role_id=0b37e8a909204679b705bf258b1cd8f1)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:12.933715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f5032-f52c-48bc-953c-f97830d86cc4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:12.940753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 306/609] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:12.942207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f90c5a-f52b-4703-bb80-d407a7c3e17f None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:12.956441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 304/610] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:29:12 2022] PUT /identity/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/2fe9f8eb94c84c36ad7a49507b2c8360/roles/0b37e8a909204679b705bf258b1cd8f1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:29:13.061158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f90c5a-f52b-4703-bb80-d407a7c3e17f None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:13.097912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860037d3-31b5-49fb-ae9d-ebdd9cafc42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:13.099231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860037d3-31b5-49fb-ae9d-ebdd9cafc42f None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:13.099700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860037d3-31b5-49fb-ae9d-ebdd9cafc42f None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:13.100155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860037d3-31b5-49fb-ae9d-ebdd9cafc42f None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:13.101107 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860037d3-31b5-49fb-ae9d-ebdd9cafc42f None admin] RBAC: Adding query filter params (name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:13.101594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860037d3-31b5-49fb-ae9d-ebdd9cafc42f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:13.103901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860037d3-31b5-49fb-ae9d-ebdd9cafc42f None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:13.114699 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 307/611] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:13.120435 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f5032-f52c-48bc-953c-f97830d86cc4 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:13.252357 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f5032-f52c-48bc-953c-f97830d86cc4 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:13.289690 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444359c-a1b0-4eda-9a57-840e0595976b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:13.291453 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444359c-a1b0-4eda-9a57-840e0595976b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:13.291921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444359c-a1b0-4eda-9a57-840e0595976b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:13.292427 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444359c-a1b0-4eda-9a57-840e0595976b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:13.303638 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444359c-a1b0-4eda-9a57-840e0595976b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:13.305400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444359c-a1b0-4eda-9a57-840e0595976b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:13.325370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-4444359c-a1b0-4eda-9a57-840e0595976b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:13.325370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:13.325370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:13.325370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:13.325370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:13.325370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:13.325370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:13.325370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:13.325370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:13.325370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:13.325370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:13.325370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:13.325370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:13.325370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:13.325370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:13.326442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:13.327578 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:13.327578 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:13.327578 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:13.327578 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:13.329515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 305/612] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:13.335182 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860037d3-31b5-49fb-ae9d-ebdd9cafc42f None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:13.465784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860037d3-31b5-49fb-ae9d-ebdd9cafc42f None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:13.506616 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e404b7-8b34-4c0d-9da2-e0867693fc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:13.507576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e404b7-8b34-4c0d-9da2-e0867693fc0a None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:13.508010 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e404b7-8b34-4c0d-9da2-e0867693fc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:13.508455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e404b7-8b34-4c0d-9da2-e0867693fc0a None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:13.510307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e404b7-8b34-4c0d-9da2-e0867693fc0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:13.510790 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e404b7-8b34-4c0d-9da2-e0867693fc0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:13.512325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e404b7-8b34-4c0d-9da2-e0867693fc0a None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:13.538197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 308/613] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:13.544013 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444359c-a1b0-4eda-9a57-840e0595976b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:13.647862 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444359c-a1b0-4eda-9a57-840e0595976b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:13.681293 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ccf6b-bc0c-4f26-a039-99ae79615029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:13.682278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ccf6b-bc0c-4f26-a039-99ae79615029 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:13.682541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ccf6b-bc0c-4f26-a039-99ae79615029 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:13.682812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ccf6b-bc0c-4f26-a039-99ae79615029 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:13.689997 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ccf6b-bc0c-4f26-a039-99ae79615029 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:13.691494 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ccf6b-bc0c-4f26-a039-99ae79615029 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-118ccf6b-bc0c-4f26-a039-99ae79615029 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:13.707026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:13.708228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:13.709251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:13.709251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:13.709251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:13.709251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:13.709251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:13.709251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:13.709251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:13.709251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:13.709251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:29:13.709251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:13.709251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 306/614] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:29:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:13.714947 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e404b7-8b34-4c0d-9da2-e0867693fc0a None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:13.782450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96771ae-3654-4c6b-93f8-ed9c390351c3 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:13.782792 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96771ae-3654-4c6b-93f8-ed9c390351c3 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:13.782988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96771ae-3654-4c6b-93f8-ed9c390351c3 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:13.784565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 307/615] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:13.789393 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7ada7-8206-4255-b120-336b25dd3f88 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:13.789677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7ada7-8206-4255-b120-336b25dd3f88 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:13.789950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7ada7-8206-4255-b120-336b25dd3f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:13.813335 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-9ad7ada7-8206-4255-b120-336b25dd3f88 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:13.814549 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9ad7ada7-8206-4255-b120-336b25dd3f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:13.843347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e404b7-8b34-4c0d-9da2-e0867693fc0a None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:13.883717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0569f96-0f30-4a89-942b-bb287013f332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:13.884962 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0569f96-0f30-4a89-942b-bb287013f332 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:13.885274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0569f96-0f30-4a89-942b-bb287013f332 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:13.885507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0569f96-0f30-4a89-942b-bb287013f332 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:13.886562 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0569f96-0f30-4a89-942b-bb287013f332 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:13.886916 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0569f96-0f30-4a89-942b-bb287013f332 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:13.888335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0569f96-0f30-4a89-942b-bb287013f332 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:13.906676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 309/616] 10.222.0.58 () {56 vars in 1135 bytes} [Thu May 5 15:29:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:13.912010 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0569f96-0f30-4a89-942b-bb287013f332 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:13.948191 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 308/617] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:29:13.983994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7ada7-8206-4255-b120-336b25dd3f88 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:14.011277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0569f96-0f30-4a89-942b-bb287013f332 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:14.046860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45c77f-6a24-48c6-9a62-6a9e363bdb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:14.047657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45c77f-6a24-48c6-9a62-6a9e363bdb8b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:14.047936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45c77f-6a24-48c6-9a62-6a9e363bdb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:14.048221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45c77f-6a24-48c6-9a62-6a9e363bdb8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:14.058622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45c77f-6a24-48c6-9a62-6a9e363bdb8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:14.060069 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45c77f-6a24-48c6-9a62-6a9e363bdb8b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:14.077428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-9f45c77f-6a24-48c6-9a62-6a9e363bdb8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:14.077428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:14.077428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:14.077428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:14.077428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:14.077428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:14.077428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:14.077428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:14.077428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:14.077428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:14.077428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:14.077428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:14.077428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:14.077428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:14.077428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:14.078793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:14.080250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:14.080250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:14.080250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:14.080250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:14.080250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 310/618] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:14.084233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45c77f-6a24-48c6-9a62-6a9e363bdb8b None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:14.181847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7ada7-8206-4255-b120-336b25dd3f88 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:14.218663 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45c77f-6a24-48c6-9a62-6a9e363bdb8b None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:14.225810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4aca8-6561-4e1c-8113-4bffb27e92d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:14.226695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4aca8-6561-4e1c-8113-4bffb27e92d9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:14.226983 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4aca8-6561-4e1c-8113-4bffb27e92d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:14.227258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4aca8-6561-4e1c-8113-4bffb27e92d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:14.252224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4aca8-6561-4e1c-8113-4bffb27e92d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:14.253000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db16f0-6625-44bb-a382-ffa108db447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:14.253657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db16f0-6625-44bb-a382-ffa108db447e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:14.253935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db16f0-6625-44bb-a382-ffa108db447e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:14.254229 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db16f0-6625-44bb-a382-ffa108db447e None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:14.254941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db16f0-6625-44bb-a382-ffa108db447e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:14.255239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db16f0-6625-44bb-a382-ffa108db447e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:14.256585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db16f0-6625-44bb-a382-ffa108db447e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d1e4aca8-6561-4e1c-8113-4bffb27e92d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:14.267080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:14.269565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:14.271588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:14.271588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:14.271588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:14.271588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:14.271588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:14.271588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:14.271588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:14.271588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:14.271588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:14.271588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:14.271588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:14.271588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:14.273743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 311/620] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:14.273895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 309/620] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:14.274043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db16f0-6625-44bb-a382-ffa108db447e None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:14.278369 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4aca8-6561-4e1c-8113-4bffb27e92d9 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:14.398447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db16f0-6625-44bb-a382-ffa108db447e None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:14.434501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc5feb-a053-472d-9cd8-8ff3505150ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:14.435217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc5feb-a053-472d-9cd8-8ff3505150ed None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:14.435495 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc5feb-a053-472d-9cd8-8ff3505150ed None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:14.435763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc5feb-a053-472d-9cd8-8ff3505150ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:14.442812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc5feb-a053-472d-9cd8-8ff3505150ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:14.444250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc5feb-a053-472d-9cd8-8ff3505150ed None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:14.458317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-cabc5feb-a053-472d-9cd8-8ff3505150ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:14.458317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:14.458317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:14.458317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:14.458317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:14.458317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:14.458317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:14.458317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:14.458317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:14.458317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:14.458317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:14.458317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:14.458317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:14.458317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:14.458317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:14.459282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:14.460584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:14.460584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:14.460584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:14.460584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:14.460584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:14.460584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:14.460584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:14.460584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:14.460584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 312/621] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:14.465275 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc5feb-a053-472d-9cd8-8ff3505150ed None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:14.470366 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4aca8-6561-4e1c-8113-4bffb27e92d9 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:14.551303 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d73b3-f254-45bc-a50e-4f45a732ac5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:14.551977 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d73b3-f254-45bc-a50e-4f45a732ac5d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:14.552255 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d73b3-f254-45bc-a50e-4f45a732ac5d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:14.552533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d73b3-f254-45bc-a50e-4f45a732ac5d None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:14.553275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d73b3-f254-45bc-a50e-4f45a732ac5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:14.553575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d73b3-f254-45bc-a50e-4f45a732ac5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:14.554952 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d73b3-f254-45bc-a50e-4f45a732ac5d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:14.575348 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 310/622] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:14.580437 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d73b3-f254-45bc-a50e-4f45a732ac5d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:14.630039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc5feb-a053-472d-9cd8-8ff3505150ed None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:14.664252 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee94bf-a434-4c73-a3b8-b41db4e5de46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:14.664914 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee94bf-a434-4c73-a3b8-b41db4e5de46 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:14.665193 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee94bf-a434-4c73-a3b8-b41db4e5de46 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:14.666004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee94bf-a434-4c73-a3b8-b41db4e5de46 None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:14.666794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee94bf-a434-4c73-a3b8-b41db4e5de46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:14.667117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee94bf-a434-4c73-a3b8-b41db4e5de46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:14.668517 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee94bf-a434-4c73-a3b8-b41db4e5de46 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:14.691618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 313/623] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:14.697595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee94bf-a434-4c73-a3b8-b41db4e5de46 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:14.724960 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d73b3-f254-45bc-a50e-4f45a732ac5d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:14.767029 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37faf50-0019-47a6-bcd6-ef7d1417fc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:14.768790 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37faf50-0019-47a6-bcd6-ef7d1417fc34 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:14.769302 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37faf50-0019-47a6-bcd6-ef7d1417fc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:14.769989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37faf50-0019-47a6-bcd6-ef7d1417fc34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:14.785670 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37faf50-0019-47a6-bcd6-ef7d1417fc34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:14.787502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37faf50-0019-47a6-bcd6-ef7d1417fc34 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:14.809974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-e37faf50-0019-47a6-bcd6-ef7d1417fc34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:14.809974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:14.809974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:14.809974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:14.809974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:14.809974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:14.809974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:14.809974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:14.809974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:14.809974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:14.809974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:14.809974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:14.809974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:14.809974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:14.809974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:14.811171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:14.812251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:14.812251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:14.812251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:14.812251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:14.814847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 311/624] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:14.816880 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f60e85-2df0-4a7c-91b8-0a7e2c75ee89 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:14.817446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f60e85-2df0-4a7c-91b8-0a7e2c75ee89 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:14.817986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f60e85-2df0-4a7c-91b8-0a7e2c75ee89 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:14.819996 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 312/625] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:14.820948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f60e85-2df0-4a7c-91b8-0a7e2c75ee89 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:14.829613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee94bf-a434-4c73-a3b8-b41db4e5de46 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:14.864288 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffef9a-6f6a-4c55-aa02-a6cd48e8347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:14.865311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffef9a-6f6a-4c55-aa02-a6cd48e8347b None admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:14.866378 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffef9a-6f6a-4c55-aa02-a6cd48e8347b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:14.866378 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffef9a-6f6a-4c55-aa02-a6cd48e8347b None admin] PATH_INFO: `/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/a90b5737f2c345b08460d291ccf49466/roles/0b37e8a909204679b705bf258b1cd8f1` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:14.882009 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffef9a-6f6a-4c55-aa02-a6cd48e8347b None admin] RBAC: Authorizing `identity:create_grant(project_id=bdd58b84c6394504beb84d13d13d60a1, user_id=a90b5737f2c345b08460d291ccf49466, role_id=0b37e8a909204679b705bf258b1cd8f1)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:14.883621 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffef9a-6f6a-4c55-aa02-a6cd48e8347b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:14.898381 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 314/626] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:29:14 2022] PUT /identity/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/a90b5737f2c345b08460d291ccf49466/roles/0b37e8a909204679b705bf258b1cd8f1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:29:14.900596 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96e5d9-565d-4b76-bd07-27336ebfa5b5 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:14.901035 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96e5d9-565d-4b76-bd07-27336ebfa5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:14.901457 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96e5d9-565d-4b76-bd07-27336ebfa5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:14.920749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-6d96e5d9-565d-4b76-bd07-27336ebfa5b5 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:14.922252 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6d96e5d9-565d-4b76-bd07-27336ebfa5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:14.951872 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f60e85-2df0-4a7c-91b8-0a7e2c75ee89 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:14.988719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8c88b-bf3f-49ff-b1a9-faca478e8876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:14.989603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8c88b-bf3f-49ff-b1a9-faca478e8876 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:14.990010 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8c88b-bf3f-49ff-b1a9-faca478e8876 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:14.990532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8c88b-bf3f-49ff-b1a9-faca478e8876 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:14.991421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8c88b-bf3f-49ff-b1a9-faca478e8876 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:14.991997 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8c88b-bf3f-49ff-b1a9-faca478e8876 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:14.993402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8c88b-bf3f-49ff-b1a9-faca478e8876 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:15.011624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 313/627] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:15.011845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 315/628] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:15.015364 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8c88b-bf3f-49ff-b1a9-faca478e8876 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:15.036991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96e5d9-565d-4b76-bd07-27336ebfa5b5 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:15.144031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8c88b-bf3f-49ff-b1a9-faca478e8876 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:15.144232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96e5d9-565d-4b76-bd07-27336ebfa5b5 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:15.188956 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075be27-f0ba-4993-8185-9c8aa6fd5d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:15.189834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075be27-f0ba-4993-8185-9c8aa6fd5d70 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:15.190123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075be27-f0ba-4993-8185-9c8aa6fd5d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:15.190481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075be27-f0ba-4993-8185-9c8aa6fd5d70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:15.204280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33b8a9-6e47-49ff-8c34-d85b98b411a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:15.205156 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33b8a9-6e47-49ff-8c34-d85b98b411a1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:15.205487 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33b8a9-6e47-49ff-8c34-d85b98b411a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:15.205769 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33b8a9-6e47-49ff-8c34-d85b98b411a1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:15.215368 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075be27-f0ba-4993-8185-9c8aa6fd5d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:15.221189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33b8a9-6e47-49ff-8c34-d85b98b411a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:15.222703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33b8a9-6e47-49ff-8c34-d85b98b411a1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-f075be27-f0ba-4993-8185-9c8aa6fd5d70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:15.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:15.232506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:15.233348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:15.233348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:15.233348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:15.233348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:15.233348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:15.233348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:15.233348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:15.233348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:15.233348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:15.233348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:15.233348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:15.233348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:15.236139 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 316/629] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:15.246553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075be27-f0ba-4993-8185-9c8aa6fd5d70 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-5b33b8a9-6e47-49ff-8c34-d85b98b411a1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:15.249861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:15.250813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:15.251910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:15.251910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:15.251910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:15.251910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:15.251910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:15.251910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:15.251910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:15.251910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:15.251910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 05 15:29:15.251910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:15.255597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 314/630] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:29:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:15.262318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33b8a9-6e47-49ff-8c34-d85b98b411a1 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:15.362052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075be27-f0ba-4993-8185-9c8aa6fd5d70 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:15.369866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33b8a9-6e47-49ff-8c34-d85b98b411a1 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:15.405402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095906a-314b-453a-b103-a5f52a00e8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:15.405633 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d3009-cb57-4b73-9b5a-a26de5ae45d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:15.406078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095906a-314b-453a-b103-a5f52a00e8ea None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:15.406399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095906a-314b-453a-b103-a5f52a00e8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:15.406674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095906a-314b-453a-b103-a5f52a00e8ea None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:15.407290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d3009-cb57-4b73-9b5a-a26de5ae45d9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:15.407511 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095906a-314b-453a-b103-a5f52a00e8ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:15.407819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095906a-314b-453a-b103-a5f52a00e8ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:15.408183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d3009-cb57-4b73-9b5a-a26de5ae45d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:15.408653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d3009-cb57-4b73-9b5a-a26de5ae45d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:15.409247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095906a-314b-453a-b103-a5f52a00e8ea None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:15.409828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d3009-cb57-4b73-9b5a-a26de5ae45d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:15.413375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d3009-cb57-4b73-9b5a-a26de5ae45d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:15.415047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d3009-cb57-4b73-9b5a-a26de5ae45d9 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:15.426042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 317/631] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:15.432956 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 315/632] 10.222.0.58 () {56 vars in 1137 bytes} [Thu May 5 15:29:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:15.434212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d3009-cb57-4b73-9b5a-a26de5ae45d9 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:15.440439 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095906a-314b-453a-b103-a5f52a00e8ea None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:15.558192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095906a-314b-453a-b103-a5f52a00e8ea None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:15.590207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2f3b7-4196-47bd-95b0-a19a03e4cf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:15.590207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2f3b7-4196-47bd-95b0-a19a03e4cf66 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:15.590207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2f3b7-4196-47bd-95b0-a19a03e4cf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:15.590207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2f3b7-4196-47bd-95b0-a19a03e4cf66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:15.633951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d3009-cb57-4b73-9b5a-a26de5ae45d9 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:15.680474 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2f3b7-4196-47bd-95b0-a19a03e4cf66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:15.682480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2f3b7-4196-47bd-95b0-a19a03e4cf66 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:15.705449 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6ec6d-c15e-43c9-8520-51a9b0d028f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:15.706271 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6ec6d-c15e-43c9-8520-51a9b0d028f9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:15.706551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6ec6d-c15e-43c9-8520-51a9b0d028f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:15.706820 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6ec6d-c15e-43c9-8520-51a9b0d028f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:15.728088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6ec6d-c15e-43c9-8520-51a9b0d028f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:15.729696 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6ec6d-c15e-43c9-8520-51a9b0d028f9 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:15.765863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-2de6ec6d-c15e-43c9-8520-51a9b0d028f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:15.765863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:15.765863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:15.765863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:15.765863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:15.765863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:15.765863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:15.765863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:15.765863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:15.765863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:15.765863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:15.765863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:15.765863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:15.765863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:15.765863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:15.766957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:15.767819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:15.767819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:15.767819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:15.767819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:15.774276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 318/633] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:15.774276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aa0a6-e4f8-4322-bfca-7671a0476cbf None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:15.774276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aa0a6-e4f8-4322-bfca-7671a0476cbf None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:15.774603 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aa0a6-e4f8-4322-bfca-7671a0476cbf None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:15.784602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 319/634] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:15.786070 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399ec8c-d4f7-4677-8cbc-81f8a1ef0a6e None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:15.786370 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399ec8c-d4f7-4677-8cbc-81f8a1ef0a6e None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:15.786646 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399ec8c-d4f7-4677-8cbc-81f8a1ef0a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:15.802619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 316/635] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:29:15.803594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2f3b7-4196-47bd-95b0-a19a03e4cf66 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:15.823155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-b399ec8c-d4f7-4677-8cbc-81f8a1ef0a6e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:15.824338 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b399ec8c-d4f7-4677-8cbc-81f8a1ef0a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:15.910767 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2f3b7-4196-47bd-95b0-a19a03e4cf66 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:15.949495 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d09033-56f4-48ca-9c5b-c5d475983b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:15.950183 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d09033-56f4-48ca-9c5b-c5d475983b33 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:15.950480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d09033-56f4-48ca-9c5b-c5d475983b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:15.951164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d09033-56f4-48ca-9c5b-c5d475983b33 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:15.951543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d09033-56f4-48ca-9c5b-c5d475983b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:15.951897 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d09033-56f4-48ca-9c5b-c5d475983b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:15.953274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d09033-56f4-48ca-9c5b-c5d475983b33 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:15.957993 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 320/636] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:15.958887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399ec8c-d4f7-4677-8cbc-81f8a1ef0a6e None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:15.974198 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 317/637] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:15.974198 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d09033-56f4-48ca-9c5b-c5d475983b33 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:16.084053 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d09033-56f4-48ca-9c5b-c5d475983b33 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:16.085130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399ec8c-d4f7-4677-8cbc-81f8a1ef0a6e None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:16.120577 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf78c4-b2c3-4f52-82f2-713315f3de1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:16.121374 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf78c4-b2c3-4f52-82f2-713315f3de1d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:16.121656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf78c4-b2c3-4f52-82f2-713315f3de1d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:16.121930 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf78c4-b2c3-4f52-82f2-713315f3de1d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:16.123730 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25434c5-33fe-486f-96e8-075a7fbf88a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:16.124537 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25434c5-33fe-486f-96e8-075a7fbf88a9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:16.124808 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25434c5-33fe-486f-96e8-075a7fbf88a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:16.124808 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25434c5-33fe-486f-96e8-075a7fbf88a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:16.133887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf78c4-b2c3-4f52-82f2-713315f3de1d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:16.135425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf78c4-b2c3-4f52-82f2-713315f3de1d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:16.142237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25434c5-33fe-486f-96e8-075a7fbf88a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:16.145370 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25434c5-33fe-486f-96e8-075a7fbf88a9 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-29cf78c4-b2c3-4f52-82f2-713315f3de1d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:16.149328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:16.150402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:16.156770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:16.156770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:16.156770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:16.156770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:16.156770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:16.156770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:16.156770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:16.156770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:16.156770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:29:16.156770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:16.156770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 318/638] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 5 15:29:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:16.156770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f26aa2-54a5-46ae-82d8-8a27d73f0fa8 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:16.156770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f26aa2-54a5-46ae-82d8-8a27d73f0fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:16.157517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f26aa2-54a5-46ae-82d8-8a27d73f0fa8 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:16.157517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 319/639] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:16.157517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f26aa2-54a5-46ae-82d8-8a27d73f0fa8 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:16.168451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-c25434c5-33fe-486f-96e8-075a7fbf88a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:16.168451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:16.168451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:16.168451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:16.168451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:16.168451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:16.168451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:16.168451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:16.168451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:16.168451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:16.168451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:16.168451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:16.168451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:16.168451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:16.168451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:16.175660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:16.179313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:16.179313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:16.179313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:16.179313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:16.179313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 321/640] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:16.179313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25434c5-33fe-486f-96e8-075a7fbf88a9 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:16.271651 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25434c5-33fe-486f-96e8-075a7fbf88a9 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:16.275363 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f26aa2-54a5-46ae-82d8-8a27d73f0fa8 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:16.307764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa43076-a3db-423e-a146-ce0ea937e5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:16.308439 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa43076-a3db-423e-a146-ce0ea937e5cf None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:16.308717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa43076-a3db-423e-a146-ce0ea937e5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:16.308992 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa43076-a3db-423e-a146-ce0ea937e5cf None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:16.309321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7ee61-cf6b-46ce-b6a0-bd865a535ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:16.309823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa43076-a3db-423e-a146-ce0ea937e5cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:16.310118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ee61-cf6b-46ce-b6a0-bd865a535ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:16.310317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa43076-a3db-423e-a146-ce0ea937e5cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:16.310461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ee61-cf6b-46ce-b6a0-bd865a535ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:16.310703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ee61-cf6b-46ce-b6a0-bd865a535ba4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:16.311583 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa43076-a3db-423e-a146-ce0ea937e5cf None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:16.320852 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7ee61-cf6b-46ce-b6a0-bd865a535ba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-71f7ee61-cf6b-46ce-b6a0-bd865a535ba4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:16.328686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:16.329687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:16.330649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:16.330649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:16.330649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:16.330649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:16.330649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:16.330649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:16.330649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:16.330649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:16.330649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:16.330649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:16.330649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:16.330649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:16.330649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 320/641] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:16.331348 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3eeec7-2724-4787-a63a-f21b003ed2a9 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:16.331904 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3eeec7-2724-4787-a63a-f21b003ed2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:16.331904 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3eeec7-2724-4787-a63a-f21b003ed2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:16.336572 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 322/642] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 5 15:29:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:16.338235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa43076-a3db-423e-a146-ce0ea937e5cf None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:16.353375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-9e3eeec7-2724-4787-a63a-f21b003ed2a9 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:16.354750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9e3eeec7-2724-4787-a63a-f21b003ed2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:16.423730 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 321/643] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:16.424550 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3eeec7-2724-4787-a63a-f21b003ed2a9 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:16.454130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa43076-a3db-423e-a146-ce0ea937e5cf None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:16.490125 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7f66f-88d1-4647-ae11-ef6242271856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:16.491030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7f66f-88d1-4647-ae11-ef6242271856 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:16.491458 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7f66f-88d1-4647-ae11-ef6242271856 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:16.491891 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7f66f-88d1-4647-ae11-ef6242271856 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:16.492763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7f66f-88d1-4647-ae11-ef6242271856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:16.493067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7f66f-88d1-4647-ae11-ef6242271856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:16.494487 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7f66f-88d1-4647-ae11-ef6242271856 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:16.510883 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 323/644] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:16.511809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7f66f-88d1-4647-ae11-ef6242271856 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:16.527201 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3eeec7-2724-4787-a63a-f21b003ed2a9 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:16.560465 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862a8a-7772-4931-8cfe-9c6f36c2d77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:16.561538 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862a8a-7772-4931-8cfe-9c6f36c2d77c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:16.561935 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862a8a-7772-4931-8cfe-9c6f36c2d77c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:16.562351 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862a8a-7772-4931-8cfe-9c6f36c2d77c None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:16.563215 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13862a8a-7772-4931-8cfe-9c6f36c2d77c None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:16.563588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13862a8a-7772-4931-8cfe-9c6f36c2d77c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:16.565080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13862a8a-7772-4931-8cfe-9c6f36c2d77c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:16.573294 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 322/645] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:16.578450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862a8a-7772-4931-8cfe-9c6f36c2d77c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:16.607755 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7f66f-88d1-4647-ae11-ef6242271856 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:16.641131 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045d9a8-3699-4e42-8ea3-c6faa0530263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:16.641865 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045d9a8-3699-4e42-8ea3-c6faa0530263 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:16.642244 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045d9a8-3699-4e42-8ea3-c6faa0530263 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:16.642586 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045d9a8-3699-4e42-8ea3-c6faa0530263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:16.674981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862a8a-7772-4931-8cfe-9c6f36c2d77c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:16.708201 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc66a9-0fcb-46e2-9041-443dc4ae7de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:16.709002 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc66a9-0fcb-46e2-9041-443dc4ae7de5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:16.709283 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc66a9-0fcb-46e2-9041-443dc4ae7de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:16.709560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc66a9-0fcb-46e2-9041-443dc4ae7de5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:16.710334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045d9a8-3699-4e42-8ea3-c6faa0530263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:16.711828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045d9a8-3699-4e42-8ea3-c6faa0530263 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:16.720986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc66a9-0fcb-46e2-9041-443dc4ae7de5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-35fc66a9-0fcb-46e2-9041-443dc4ae7de5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:16.729132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:16.730416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:16.731715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:16.731715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:16.731715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:16.731715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:16.731715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:16.731715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:16.731715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:16.731715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:16.731715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:16.731715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:16.731715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:16.731715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:16.735193 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 323/646] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:16.735817 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc66a9-0fcb-46e2-9041-443dc4ae7de5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:16.817526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 324/647] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:29:16.818506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045d9a8-3699-4e42-8ea3-c6faa0530263 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:16.838759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc66a9-0fcb-46e2-9041-443dc4ae7de5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:16.872426 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a71685-9abc-4c79-9656-9edc94e442a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:16.873143 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a71685-9abc-4c79-9656-9edc94e442a2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:16.873430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a71685-9abc-4c79-9656-9edc94e442a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:16.873705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a71685-9abc-4c79-9656-9edc94e442a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:16.880396 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a71685-9abc-4c79-9656-9edc94e442a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:16.881942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a71685-9abc-4c79-9656-9edc94e442a2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:16.896284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-22a71685-9abc-4c79-9656-9edc94e442a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:16.896284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:16.896284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:16.896284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:16.896284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:16.896284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:16.896284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:16.896284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:16.896284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:16.896284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:16.896284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:16.896284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:16.896284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:16.896284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:16.896284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:16.897416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:16.898603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:16.898603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:16.898603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:16.898603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:16.898603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:16.898603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:16.898603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:16.898603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:16.899533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 324/648] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:16.900202 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a71685-9abc-4c79-9656-9edc94e442a2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:16.924414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045d9a8-3699-4e42-8ea3-c6faa0530263 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:16.957737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c7833-a3f1-4497-b416-4e2fec17f301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:16.958557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c7833-a3f1-4497-b416-4e2fec17f301 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:16.958838 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c7833-a3f1-4497-b416-4e2fec17f301 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:16.959107 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c7833-a3f1-4497-b416-4e2fec17f301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:16.969108 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c7833-a3f1-4497-b416-4e2fec17f301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:16.970684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c7833-a3f1-4497-b416-4e2fec17f301 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:16.988373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-b79c7833-a3f1-4497-b416-4e2fec17f301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:16.988373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:16.988373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:16.988373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:16.988373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:16.988373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:16.988373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:16.988373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:16.988373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:16.988373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:16.988373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:16.988373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:16.988373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:16.988373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:16.988373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:16.989322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:16.990334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:16.990334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:16.990334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:16.990334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:16.994781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 325/649] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:16.995332 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c7833-a3f1-4497-b416-4e2fec17f301 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:17.001853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a71685-9abc-4c79-9656-9edc94e442a2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:17.034780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4129aa-b14f-4afb-bb15-ad15ac0ba80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:17.035471 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4129aa-b14f-4afb-bb15-ad15ac0ba80a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:17.035732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4129aa-b14f-4afb-bb15-ad15ac0ba80a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:17.036008 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4129aa-b14f-4afb-bb15-ad15ac0ba80a None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:17.036748 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4129aa-b14f-4afb-bb15-ad15ac0ba80a None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:17.037060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4129aa-b14f-4afb-bb15-ad15ac0ba80a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:17.038471 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4129aa-b14f-4afb-bb15-ad15ac0ba80a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:17.047342 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 325/650] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:17.048170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4129aa-b14f-4afb-bb15-ad15ac0ba80a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:17.103673 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c7833-a3f1-4497-b416-4e2fec17f301 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:17.138923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204e7bd-aa62-4c9b-bd85-a37d8a1bc535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:17.138923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204e7bd-aa62-4c9b-bd85-a37d8a1bc535 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:17.139209 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204e7bd-aa62-4c9b-bd85-a37d8a1bc535 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:17.139455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204e7bd-aa62-4c9b-bd85-a37d8a1bc535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:17.149437 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204e7bd-aa62-4c9b-bd85-a37d8a1bc535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:17.151882 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204e7bd-aa62-4c9b-bd85-a37d8a1bc535 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:17.160778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4129aa-b14f-4afb-bb15-ad15ac0ba80a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:17.173600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-b204e7bd-aa62-4c9b-bd85-a37d8a1bc535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:17.173600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:17.173600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:17.173600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:17.173600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:17.173600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:17.173600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:17.173600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:17.173600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:17.173600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:17.173600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:17.173600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:17.173600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:17.173600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:17.173600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:17.174561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:17.175466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:17.175466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:17.175466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:17.175466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:17.177248 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 326/651] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:17.178146 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204e7bd-aa62-4c9b-bd85-a37d8a1bc535 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:17.203597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af0ca2-272b-4276-a7c6-80bcb7105852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:17.204260 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af0ca2-272b-4276-a7c6-80bcb7105852 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:17.204546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af0ca2-272b-4276-a7c6-80bcb7105852 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:17.204822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af0ca2-272b-4276-a7c6-80bcb7105852 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:17.205600 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af0ca2-272b-4276-a7c6-80bcb7105852 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:17.205908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af0ca2-272b-4276-a7c6-80bcb7105852 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:17.207357 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af0ca2-272b-4276-a7c6-80bcb7105852 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:17.224399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 326/652] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:17.224399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af0ca2-272b-4276-a7c6-80bcb7105852 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:17.280827 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204e7bd-aa62-4c9b-bd85-a37d8a1bc535 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:17.314112 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57111f-25db-4f39-a57f-a8e6a2534dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:17.314812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57111f-25db-4f39-a57f-a8e6a2534dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:17.315095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57111f-25db-4f39-a57f-a8e6a2534dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:17.315371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57111f-25db-4f39-a57f-a8e6a2534dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:17.316110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57111f-25db-4f39-a57f-a8e6a2534dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:17.316421 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57111f-25db-4f39-a57f-a8e6a2534dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:17.317832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57111f-25db-4f39-a57f-a8e6a2534dd2 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:17.318853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af0ca2-272b-4276-a7c6-80bcb7105852 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:17.330749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 327/653] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:17.331424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57111f-25db-4f39-a57f-a8e6a2534dd2 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:17.360867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf3c1f-881b-4979-8ac6-e9632959b0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:17.361661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf3c1f-881b-4979-8ac6-e9632959b0aa None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:17.361938 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf3c1f-881b-4979-8ac6-e9632959b0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:17.362300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf3c1f-881b-4979-8ac6-e9632959b0aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:17.372889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf3c1f-881b-4979-8ac6-e9632959b0aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:17.374358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf3c1f-881b-4979-8ac6-e9632959b0aa None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:17.391791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-42bf3c1f-881b-4979-8ac6-e9632959b0aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:17.391791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:17.391791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:17.391791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:17.391791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:17.391791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:17.391791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:17.391791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:17.391791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:17.391791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:17.391791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:17.391791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:17.391791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:17.391791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:17.391791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:17.392709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:17.393611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:17.393611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:17.393611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:17.393611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:17.393611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 327/654] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:17.394582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf3c1f-881b-4979-8ac6-e9632959b0aa None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:17.453398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57111f-25db-4f39-a57f-a8e6a2534dd2 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:17.487479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec74c74-08a4-44b6-8ea2-85923a09747a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:17.488425 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec74c74-08a4-44b6-8ea2-85923a09747a None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:17.488702 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec74c74-08a4-44b6-8ea2-85923a09747a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:17.488975 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec74c74-08a4-44b6-8ea2-85923a09747a None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:17.489686 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec74c74-08a4-44b6-8ea2-85923a09747a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:17.489990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec74c74-08a4-44b6-8ea2-85923a09747a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:17.491447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec74c74-08a4-44b6-8ea2-85923a09747a None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:17.499282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf3c1f-881b-4979-8ac6-e9632959b0aa None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:17.507754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 328/655] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:17.507754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec74c74-08a4-44b6-8ea2-85923a09747a None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:17.534450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f42ba-5f00-4f51-ad18-e9ffcc7a6570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:17.535152 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f42ba-5f00-4f51-ad18-e9ffcc7a6570 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:17.535441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f42ba-5f00-4f51-ad18-e9ffcc7a6570 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:17.535710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f42ba-5f00-4f51-ad18-e9ffcc7a6570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:17.536529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f42ba-5f00-4f51-ad18-e9ffcc7a6570 None admin] RBAC: Adding query filter params (role.id=0b37e8a909204679b705bf258b1cd8f1, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=ab6c13dc02ba49d0be523fa9a73fdf5e) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:17.536838 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f42ba-5f00-4f51-ad18-e9ffcc7a6570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:17.538265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f42ba-5f00-4f51-ad18-e9ffcc7a6570 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:17.544006 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 328/656] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:17 2022] GET /identity/v3/role_assignments?user.id=ab6c13dc02ba49d0be523fa9a73fdf5e&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=0b37e8a909204679b705bf258b1cd8f1 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:17.544784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f42ba-5f00-4f51-ad18-e9ffcc7a6570 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:17.610625 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec74c74-08a4-44b6-8ea2-85923a09747a None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:17.645885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0234f-e067-4487-86a8-afcdf0746cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:17.646660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0234f-e067-4487-86a8-afcdf0746cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:17.646929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0234f-e067-4487-86a8-afcdf0746cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:17.647202 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0234f-e067-4487-86a8-afcdf0746cb9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:17.652602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f42ba-5f00-4f51-ad18-e9ffcc7a6570 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:17.654980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0234f-e067-4487-86a8-afcdf0746cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:17.656443 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0234f-e067-4487-86a8-afcdf0746cb9 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-95d0234f-e067-4487-86a8-afcdf0746cb9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:17.672254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:17.673274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:17.674276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:17.674276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:17.674276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:17.674276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:17.674276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:17.674276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:17.674276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:17.674276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:17.674276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:29:17.674276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:17.674276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 329/657] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:29:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:17.674866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef010e-7155-4869-91d8-0069ca630f56 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:17.675594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef010e-7155-4869-91d8-0069ca630f56 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:17.675594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef010e-7155-4869-91d8-0069ca630f56 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:17.680990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 330/658] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:17.680990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef010e-7155-4869-91d8-0069ca630f56 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:17.695517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcb8b4-ab44-4f71-90f6-dcc1db079fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:17.696203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcb8b4-ab44-4f71-90f6-dcc1db079fce None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:17.697044 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcb8b4-ab44-4f71-90f6-dcc1db079fce None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:17.697554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcb8b4-ab44-4f71-90f6-dcc1db079fce None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:17.698415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fcb8b4-ab44-4f71-90f6-dcc1db079fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:17.698724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fcb8b4-ab44-4f71-90f6-dcc1db079fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:17.700095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fcb8b4-ab44-4f71-90f6-dcc1db079fce None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:17.711854 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 329/659] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:17.712932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcb8b4-ab44-4f71-90f6-dcc1db079fce None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:17.798346 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef010e-7155-4869-91d8-0069ca630f56 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:17.828935 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcb8b4-ab44-4f71-90f6-dcc1db079fce None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:17.833125 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f55ad-a00a-452c-a110-dcd8ef2939d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:17.833915 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f55ad-a00a-452c-a110-dcd8ef2939d2 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:17.834222 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f55ad-a00a-452c-a110-dcd8ef2939d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:17.834504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f55ad-a00a-452c-a110-dcd8ef2939d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:17.841783 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f55ad-a00a-452c-a110-dcd8ef2939d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:17.843315 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f55ad-a00a-452c-a110-dcd8ef2939d2 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:17.857609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-636f55ad-a00a-452c-a110-dcd8ef2939d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:17.857609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:17.857609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:17.857609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:17.857609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:17.857609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:17.857609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:17.857609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:17.857609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:17.857609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:17.857609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:17.857609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:17.857609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:17.857609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:17.857609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:17.858579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:17.860068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:17.860068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:17.860068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:17.860068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:17.860068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:17.860068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:17.860068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:17.860068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:17.860068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 331/660] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:17.860556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37616-5915-4292-83e6-5d80acce7e21 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:17.860556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37616-5915-4292-83e6-5d80acce7e21 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:17.860897 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37616-5915-4292-83e6-5d80acce7e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:17.868310 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb88e7-ca5a-4b27-bf6a-920ae694b032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:17.869627 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb88e7-ca5a-4b27-bf6a-920ae694b032 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:17.870005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb88e7-ca5a-4b27-bf6a-920ae694b032 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:17.870404 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb88e7-ca5a-4b27-bf6a-920ae694b032 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:17.871340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb88e7-ca5a-4b27-bf6a-920ae694b032 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:17.871919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb88e7-ca5a-4b27-bf6a-920ae694b032 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:17.879546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb88e7-ca5a-4b27-bf6a-920ae694b032 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:17.884749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-62a37616-5915-4292-83e6-5d80acce7e21 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:17.885998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-62a37616-5915-4292-83e6-5d80acce7e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:17.891606 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 330/661] 10.222.0.58 () {56 vars in 1137 bytes} [Thu May 5 15:29:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:17.893170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb88e7-ca5a-4b27-bf6a-920ae694b032 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:17.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 332/662] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:17.962710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37616-5915-4292-83e6-5d80acce7e21 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:17.995882 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb88e7-ca5a-4b27-bf6a-920ae694b032 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:18.028398 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227f4a-3620-49db-b101-29dc567b2780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:18.029191 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227f4a-3620-49db-b101-29dc567b2780 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:18.029467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227f4a-3620-49db-b101-29dc567b2780 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:18.029739 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227f4a-3620-49db-b101-29dc567b2780 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:18.037254 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78227f4a-3620-49db-b101-29dc567b2780 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:18.038710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78227f4a-3620-49db-b101-29dc567b2780 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:18.051783 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37616-5915-4292-83e6-5d80acce7e21 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-78227f4a-3620-49db-b101-29dc567b2780 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:18.053932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:18.055072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:18.056994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:18.056994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:18.056994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:18.056994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:18.056994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:18.056994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:18.056994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:18.056994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:18.056994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 05 15:29:18.056994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:18.060051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 331/663] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:18.060866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227f4a-3620-49db-b101-29dc567b2780 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:18.088668 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed27263-d6d5-4ae5-8588-6958f4a295d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:18.089324 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed27263-d6d5-4ae5-8588-6958f4a295d2 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:18.089655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed27263-d6d5-4ae5-8588-6958f4a295d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:18.089931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed27263-d6d5-4ae5-8588-6958f4a295d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:18.090785 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed27263-d6d5-4ae5-8588-6958f4a295d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:18.091091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed27263-d6d5-4ae5-8588-6958f4a295d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:18.092550 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed27263-d6d5-4ae5-8588-6958f4a295d2 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:18.106334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 333/664] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:18.107411 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed27263-d6d5-4ae5-8588-6958f4a295d2 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:18.162696 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227f4a-3620-49db-b101-29dc567b2780 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:18.198050 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01cef7-a9bd-43f4-89b5-7dc02767ea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:18.198734 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01cef7-a9bd-43f4-89b5-7dc02767ea50 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:18.199020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01cef7-a9bd-43f4-89b5-7dc02767ea50 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:18.199296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01cef7-a9bd-43f4-89b5-7dc02767ea50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:18.209397 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed27263-d6d5-4ae5-8588-6958f4a295d2 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:18.243454 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a25ec4-3cd3-4c57-a52c-8e87d03342d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:18.244972 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a25ec4-3cd3-4c57-a52c-8e87d03342d9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:18.245419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a25ec4-3cd3-4c57-a52c-8e87d03342d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:18.245690 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a25ec4-3cd3-4c57-a52c-8e87d03342d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:18.255691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a25ec4-3cd3-4c57-a52c-8e87d03342d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-69a25ec4-3cd3-4c57-a52c-8e87d03342d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:18.263606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:18.264588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:18.265480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:18.265480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:18.265480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:18.265480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:18.265480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:18.265480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:18.265480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:18.265480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:18.265480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:18.265480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:18.265480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:18.265480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:18.266155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01cef7-a9bd-43f4-89b5-7dc02767ea50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:18.266155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01cef7-a9bd-43f4-89b5-7dc02767ea50 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:18.269746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 334/665] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:18.270627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a25ec4-3cd3-4c57-a52c-8e87d03342d9 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:18.367145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 332/666] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:29:18.367145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01cef7-a9bd-43f4-89b5-7dc02767ea50 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:18.369694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a25ec4-3cd3-4c57-a52c-8e87d03342d9 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:18.402728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec26be1-33a1-44af-85e1-9114f5b6cce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:18.403409 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec26be1-33a1-44af-85e1-9114f5b6cce6 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:18.403682 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec26be1-33a1-44af-85e1-9114f5b6cce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:18.403954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec26be1-33a1-44af-85e1-9114f5b6cce6 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:18.404785 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec26be1-33a1-44af-85e1-9114f5b6cce6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:18.405092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec26be1-33a1-44af-85e1-9114f5b6cce6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:18.406536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec26be1-33a1-44af-85e1-9114f5b6cce6 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:18.424152 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 335/667] 10.222.0.58 () {56 vars in 1139 bytes} [Thu May 5 15:29:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:18.424775 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec26be1-33a1-44af-85e1-9114f5b6cce6 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:18.475334 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01cef7-a9bd-43f4-89b5-7dc02767ea50 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:18.523695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27879e94-9d5f-4524-bf7f-ab9393ca7265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:18.524347 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879e94-9d5f-4524-bf7f-ab9393ca7265 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:18.524653 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879e94-9d5f-4524-bf7f-ab9393ca7265 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:18.525465 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879e94-9d5f-4524-bf7f-ab9393ca7265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:18.526411 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27879e94-9d5f-4524-bf7f-ab9393ca7265 None admin] RBAC: Adding query filter params (role.id=0b37e8a909204679b705bf258b1cd8f1, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=2a29a4b1b1aa45aea2e466d8f8b79365) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:18.526720 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27879e94-9d5f-4524-bf7f-ab9393ca7265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:18.528129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27879e94-9d5f-4524-bf7f-ab9393ca7265 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:18.529652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec26be1-33a1-44af-85e1-9114f5b6cce6 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:18.542570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 333/668] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:18 2022] GET /identity/v3/role_assignments?user.id=2a29a4b1b1aa45aea2e466d8f8b79365&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=0b37e8a909204679b705bf258b1cd8f1 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:18.542570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27879e94-9d5f-4524-bf7f-ab9393ca7265 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:18.575044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891bdc5-214a-478f-870c-246b23135f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:18.576350 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891bdc5-214a-478f-870c-246b23135f1b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:18.576760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891bdc5-214a-478f-870c-246b23135f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:18.577034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891bdc5-214a-478f-870c-246b23135f1b None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:18.577955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891bdc5-214a-478f-870c-246b23135f1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:18.578289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891bdc5-214a-478f-870c-246b23135f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:18.580342 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891bdc5-214a-478f-870c-246b23135f1b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:18.593351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 336/669] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:18.594444 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891bdc5-214a-478f-870c-246b23135f1b None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:18.654291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27879e94-9d5f-4524-bf7f-ab9393ca7265 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:18.693655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbc135-92b5-4165-a5bd-98975b791fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:18.694490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbc135-92b5-4165-a5bd-98975b791fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:18.694767 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbc135-92b5-4165-a5bd-98975b791fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:18.695033 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbc135-92b5-4165-a5bd-98975b791fa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:18.706443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbc135-92b5-4165-a5bd-98975b791fa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:18.707904 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbc135-92b5-4165-a5bd-98975b791fa5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:18.727383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-a4cbc135-92b5-4165-a5bd-98975b791fa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:18.727383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:18.727383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:18.727383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:18.727383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:18.727383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:18.727383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:18.727383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:18.727383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:18.727383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:18.727383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:18.727383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:18.727383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:18.727383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:18.727383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:18.728458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:18.729731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:18.729731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:18.729731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:18.729731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:18.729731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 334/670] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:18.730214 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbc135-92b5-4165-a5bd-98975b791fa5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:18.734085 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891bdc5-214a-478f-870c-246b23135f1b None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:18.781822 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039999d-8c73-486e-bd7d-d1deb83b2880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:18.782887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039999d-8c73-486e-bd7d-d1deb83b2880 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:18.783406 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039999d-8c73-486e-bd7d-d1deb83b2880 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:18.783885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039999d-8c73-486e-bd7d-d1deb83b2880 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:18.848341 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbc135-92b5-4165-a5bd-98975b791fa5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:18.860568 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039999d-8c73-486e-bd7d-d1deb83b2880 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:18.862303 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039999d-8c73-486e-bd7d-d1deb83b2880 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:18.887195 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f9740-9b26-4389-aba5-505c7d4178f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:18.888225 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f9740-9b26-4389-aba5-505c7d4178f5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:18.888652 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f9740-9b26-4389-aba5-505c7d4178f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:18.889086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f9740-9b26-4389-aba5-505c7d4178f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:18.899722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f9740-9b26-4389-aba5-505c7d4178f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:18.901323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f9740-9b26-4389-aba5-505c7d4178f5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:18.919640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9b6f9740-9b26-4389-aba5-505c7d4178f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:18.919640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:18.919640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:18.919640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:18.919640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:18.919640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:18.919640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:18.919640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:18.919640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:18.919640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:18.919640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:18.919640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:18.919640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:18.919640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:18.919640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:18.920557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:18.921466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:18.921466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:18.921466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:18.921466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:18.925372 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 335/671] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:18.926249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f9740-9b26-4389-aba5-505c7d4178f5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:18.969544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 337/672] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:29:18.970431 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039999d-8c73-486e-bd7d-d1deb83b2880 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:19.025805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f9740-9b26-4389-aba5-505c7d4178f5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:19.064072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521e87f-536c-47b4-832f-a8ba548d3cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:19.064742 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521e87f-536c-47b4-832f-a8ba548d3cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:19.065021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521e87f-536c-47b4-832f-a8ba548d3cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:19.065296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521e87f-536c-47b4-832f-a8ba548d3cf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:19.066016 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521e87f-536c-47b4-832f-a8ba548d3cf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:19.066364 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521e87f-536c-47b4-832f-a8ba548d3cf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:19.068077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521e87f-536c-47b4-832f-a8ba548d3cf9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:19.069485 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039999d-8c73-486e-bd7d-d1deb83b2880 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:19.086378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 336/673] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:19.087946 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521e87f-536c-47b4-832f-a8ba548d3cf9 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:19.106582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1be07-bfe6-4c86-85f0-55e2f4c5e0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:19.107246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1be07-bfe6-4c86-85f0-55e2f4c5e0bb None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:19.107523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1be07-bfe6-4c86-85f0-55e2f4c5e0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:19.107791 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1be07-bfe6-4c86-85f0-55e2f4c5e0bb None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:19.108896 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1be07-bfe6-4c86-85f0-55e2f4c5e0bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:19.109608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1be07-bfe6-4c86-85f0-55e2f4c5e0bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:19.111052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1be07-bfe6-4c86-85f0-55e2f4c5e0bb None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:19.124859 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 338/674] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:19.125736 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1be07-bfe6-4c86-85f0-55e2f4c5e0bb None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:19.202996 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521e87f-536c-47b4-832f-a8ba548d3cf9 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:19.225217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1be07-bfe6-4c86-85f0-55e2f4c5e0bb None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:19.236873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbbd89-a20a-4e90-a982-510ce3fe9711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:19.237667 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbbd89-a20a-4e90-a982-510ce3fe9711 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:19.237948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbbd89-a20a-4e90-a982-510ce3fe9711 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:19.238260 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbbd89-a20a-4e90-a982-510ce3fe9711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:19.249527 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbbd89-a20a-4e90-a982-510ce3fe9711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:19.251085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbbd89-a20a-4e90-a982-510ce3fe9711 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:19.259352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4ac5f-39c0-409a-91a0-8f770c8a7c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:19.260187 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4ac5f-39c0-409a-91a0-8f770c8a7c73 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:19.260471 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4ac5f-39c0-409a-91a0-8f770c8a7c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:19.260740 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4ac5f-39c0-409a-91a0-8f770c8a7c73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:19.267586 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4ac5f-39c0-409a-91a0-8f770c8a7c73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:19.268199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-bedbbd89-a20a-4e90-a982-510ce3fe9711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:19.268199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:19.268199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:19.268199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:19.268199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:19.268199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:19.268199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:19.268199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:19.268199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:19.268199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:19.268199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:19.268199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:19.268199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:19.268199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:19.268199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:19.270102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:19.272284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:19.272284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:19.272284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:19.272284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:19.272788 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4ac5f-39c0-409a-91a0-8f770c8a7c73 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:19.272942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 337/675] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:19.272942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbbd89-a20a-4e90-a982-510ce3fe9711 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:19.283601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-0ff4ac5f-39c0-409a-91a0-8f770c8a7c73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:19.283601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:19.283601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:19.283601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:19.283601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:19.283601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:19.283601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:19.283601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:19.283601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:19.283601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:19.283601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:19.283601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:19.283601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:19.283601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:19.283601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:19.285614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:19.287934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:19.287934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:19.287934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:19.287934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:19.287934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:19.287934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:19.287934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:19.287934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:19.287934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 339/676] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:19.287934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4ac5f-39c0-409a-91a0-8f770c8a7c73 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:19.371131 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbbd89-a20a-4e90-a982-510ce3fe9711 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:19.386385 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4ac5f-39c0-409a-91a0-8f770c8a7c73 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:19.414487 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe850c0-5dda-430c-8811-374503bc783e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:19.415715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe850c0-5dda-430c-8811-374503bc783e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:19.416147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe850c0-5dda-430c-8811-374503bc783e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:19.416555 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe850c0-5dda-430c-8811-374503bc783e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:19.421985 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f75c31-b832-49e5-9f5f-bec80ab7af98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:19.422715 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f75c31-b832-49e5-9f5f-bec80ab7af98 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:19.422996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f75c31-b832-49e5-9f5f-bec80ab7af98 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:19.423265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f75c31-b832-49e5-9f5f-bec80ab7af98 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:19.424184 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f75c31-b832-49e5-9f5f-bec80ab7af98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:19.424493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f75c31-b832-49e5-9f5f-bec80ab7af98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:19.425869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f75c31-b832-49e5-9f5f-bec80ab7af98 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:19.428093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe850c0-5dda-430c-8811-374503bc783e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:19.430408 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe850c0-5dda-430c-8811-374503bc783e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:19.439565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 340/677] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:19.440491 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f75c31-b832-49e5-9f5f-bec80ab7af98 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-abe850c0-5dda-430c-8811-374503bc783e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:19.454488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:19.456682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:19.458898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:19.458898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:19.458898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:19.458898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:19.458898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:19.458898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:19.458898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:19.458898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:19.458898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:29:19.458898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:19.466202 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 338/678] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:29:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:19.466202 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe850c0-5dda-430c-8811-374503bc783e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:19.565788 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f75c31-b832-49e5-9f5f-bec80ab7af98 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:19.578862 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe850c0-5dda-430c-8811-374503bc783e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:19.599910 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3b168-4bd3-40fd-a10e-17036749d8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:19.600691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3b168-4bd3-40fd-a10e-17036749d8ba None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:19.601032 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3b168-4bd3-40fd-a10e-17036749d8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:19.601499 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3b168-4bd3-40fd-a10e-17036749d8ba None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:19.602230 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3b168-4bd3-40fd-a10e-17036749d8ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:19.602608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3b168-4bd3-40fd-a10e-17036749d8ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:19.604213 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3b168-4bd3-40fd-a10e-17036749d8ba None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:19.616344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 341/679] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:19.618205 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3b168-4bd3-40fd-a10e-17036749d8ba None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:19.624922 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958609a0-25db-4937-86ad-72d61313f816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:19.626706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958609a0-25db-4937-86ad-72d61313f816 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:19.627095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958609a0-25db-4937-86ad-72d61313f816 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:19.627474 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958609a0-25db-4937-86ad-72d61313f816 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:19.636955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958609a0-25db-4937-86ad-72d61313f816 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:19.638732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958609a0-25db-4937-86ad-72d61313f816 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:19.657296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-958609a0-25db-4937-86ad-72d61313f816 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:19.657296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:19.657296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:19.657296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:19.657296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:19.657296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:19.657296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:19.657296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:19.657296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:19.657296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:19.657296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:19.657296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:19.657296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:19.657296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:19.657296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:19.658454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:19.659540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:19.659540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:19.659540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:19.659540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:19.659540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:19.659540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:19.659540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:19.659540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:19.661603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 339/680] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:19.662701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958609a0-25db-4937-86ad-72d61313f816 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:19.740988 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3b168-4bd3-40fd-a10e-17036749d8ba None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:19.779658 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e330c-c190-43c5-acea-95c8983215af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:19.780500 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e330c-c190-43c5-acea-95c8983215af None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:19.780902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e330c-c190-43c5-acea-95c8983215af None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:19.781277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e330c-c190-43c5-acea-95c8983215af None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:19.782240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e330c-c190-43c5-acea-95c8983215af None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:19.782342 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958609a0-25db-4937-86ad-72d61313f816 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:19.782724 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e330c-c190-43c5-acea-95c8983215af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:19.784458 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e330c-c190-43c5-acea-95c8983215af None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:19.808177 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 342/681] 10.222.0.58 () {56 vars in 1135 bytes} [Thu May 5 15:29:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:19.809248 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e330c-c190-43c5-acea-95c8983215af None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:19.817935 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9701f-f02a-41b5-a04c-9b798fa09115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:19.818618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9701f-f02a-41b5-a04c-9b798fa09115 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:19.818899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9701f-f02a-41b5-a04c-9b798fa09115 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:19.819172 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9701f-f02a-41b5-a04c-9b798fa09115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:19.819992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9701f-f02a-41b5-a04c-9b798fa09115 None admin] RBAC: Adding query filter params (role.id=0b37e8a909204679b705bf258b1cd8f1, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=bb9a301df6534b499d60486060df7068) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:19.820299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9701f-f02a-41b5-a04c-9b798fa09115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:19.822288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9701f-f02a-41b5-a04c-9b798fa09115 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:19.828588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 340/682] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:19 2022] GET /identity/v3/role_assignments?user.id=bb9a301df6534b499d60486060df7068&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=0b37e8a909204679b705bf258b1cd8f1 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:19.829401 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9701f-f02a-41b5-a04c-9b798fa09115 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:19.949783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9701f-f02a-41b5-a04c-9b798fa09115 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:19.993469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e3e04-bd4a-471e-b557-5942d8d33c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:19.994486 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e3e04-bd4a-471e-b557-5942d8d33c34 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:19.994486 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e3e04-bd4a-471e-b557-5942d8d33c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:19.994761 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e3e04-bd4a-471e-b557-5942d8d33c34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:20.038734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e330c-c190-43c5-acea-95c8983215af None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:20.078354 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39c1fc-e6bc-4af3-81fc-b68150e6d69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:20.079033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39c1fc-e6bc-4af3-81fc-b68150e6d69c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:20.079310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39c1fc-e6bc-4af3-81fc-b68150e6d69c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:20.079583 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39c1fc-e6bc-4af3-81fc-b68150e6d69c None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:20.080376 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39c1fc-e6bc-4af3-81fc-b68150e6d69c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:20.080765 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39c1fc-e6bc-4af3-81fc-b68150e6d69c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:20.082094 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39c1fc-e6bc-4af3-81fc-b68150e6d69c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:20.087547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e3e04-bd4a-471e-b557-5942d8d33c34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:20.088979 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e3e04-bd4a-471e-b557-5942d8d33c34 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:20.098363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 343/683] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:20.098363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e2015-04db-415e-b115-0acf3b5c67fa None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:20.098631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e2015-04db-415e-b115-0acf3b5c67fa None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:20.098893 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e2015-04db-415e-b115-0acf3b5c67fa None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:20.100391 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 344/684] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:20.104017 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e2015-04db-415e-b115-0acf3b5c67fa None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:20.219936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 341/685] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:29:20.219936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae386d-dabb-495c-a379-e302cbd7ede0 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:20.219936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae386d-dabb-495c-a379-e302cbd7ede0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:20.219936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae386d-dabb-495c-a379-e302cbd7ede0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:20.241025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e2015-04db-415e-b115-0acf3b5c67fa None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:20.243043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8bae386d-dabb-495c-a379-e302cbd7ede0 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:20.245821 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8bae386d-dabb-495c-a379-e302cbd7ede0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:20.276924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f26e72-601f-40e9-800d-a29661189b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:20.277721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f26e72-601f-40e9-800d-a29661189b01 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:20.278099 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f26e72-601f-40e9-800d-a29661189b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:20.278488 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f26e72-601f-40e9-800d-a29661189b01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:20.279310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f26e72-601f-40e9-800d-a29661189b01 None admin] RBAC: Adding query filter params (role.id=0b37e8a909204679b705bf258b1cd8f1, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=2fe9f8eb94c84c36ad7a49507b2c8360) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:20.279618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f26e72-601f-40e9-800d-a29661189b01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:20.281038 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f26e72-601f-40e9-800d-a29661189b01 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:20.292602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 345/686] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:20 2022] GET /identity/v3/role_assignments?user.id=2fe9f8eb94c84c36ad7a49507b2c8360&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=0b37e8a909204679b705bf258b1cd8f1 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:20.293995 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f26e72-601f-40e9-800d-a29661189b01 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:20.369877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 342/687] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:20.395494 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae386d-dabb-495c-a379-e302cbd7ede0 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:20.457002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f26e72-601f-40e9-800d-a29661189b01 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:20.502258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cd850-2d05-447f-8bea-d7c41cc4ee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:20.502989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cd850-2d05-447f-8bea-d7c41cc4ee67 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:20.503274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cd850-2d05-447f-8bea-d7c41cc4ee67 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:20.503552 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cd850-2d05-447f-8bea-d7c41cc4ee67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:20.529040 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cd850-2d05-447f-8bea-d7c41cc4ee67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:20.532239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cd850-2d05-447f-8bea-d7c41cc4ee67 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:20.564622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-598cd850-2d05-447f-8bea-d7c41cc4ee67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:20.564622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:20.564622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:20.564622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:20.564622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:20.564622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:20.564622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:20.564622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:20.564622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:20.564622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:20.564622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:20.564622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:20.564622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:20.564622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:20.564622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:20.565555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:20.566465 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:20.566465 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:20.566465 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:20.566465 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:20.566465 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 346/688] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:20.575133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cd850-2d05-447f-8bea-d7c41cc4ee67 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:20.585496 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae386d-dabb-495c-a379-e302cbd7ede0 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:20.629131 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574f438-cb7f-4ce2-ad3c-7230033b4399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:20.630340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574f438-cb7f-4ce2-ad3c-7230033b4399 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:20.630815 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574f438-cb7f-4ce2-ad3c-7230033b4399 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:20.631329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574f438-cb7f-4ce2-ad3c-7230033b4399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:20.642795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574f438-cb7f-4ce2-ad3c-7230033b4399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:20.644235 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574f438-cb7f-4ce2-ad3c-7230033b4399 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:20.663125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-b574f438-cb7f-4ce2-ad3c-7230033b4399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:20.663125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:20.663125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:20.663125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:20.663125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:20.663125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:20.663125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:20.663125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:20.663125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:20.663125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:20.663125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:20.663125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:20.663125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:20.663125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:20.663125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:20.664167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:20.665060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:20.665060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:20.665060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:20.665060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:20.665060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 343/689] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:20.670853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574f438-cb7f-4ce2-ad3c-7230033b4399 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:20.706041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cd850-2d05-447f-8bea-d7c41cc4ee67 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:20.742561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4a1f1-d680-4a61-9216-24332b77690a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:20.744263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4a1f1-d680-4a61-9216-24332b77690a None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:20.744747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4a1f1-d680-4a61-9216-24332b77690a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:20.745221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4a1f1-d680-4a61-9216-24332b77690a None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:20.746137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4a1f1-d680-4a61-9216-24332b77690a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:20.746653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4a1f1-d680-4a61-9216-24332b77690a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:20.748235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4a1f1-d680-4a61-9216-24332b77690a None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:20.762195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 347/690] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:20.768888 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4a1f1-d680-4a61-9216-24332b77690a None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:20.783268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574f438-cb7f-4ce2-ad3c-7230033b4399 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:20.820565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45f735-a17e-4055-a4dc-ead3a5a02d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:20.821263 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45f735-a17e-4055-a4dc-ead3a5a02d7b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:20.821587 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45f735-a17e-4055-a4dc-ead3a5a02d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:20.822537 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45f735-a17e-4055-a4dc-ead3a5a02d7b None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:20.823331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45f735-a17e-4055-a4dc-ead3a5a02d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:20.823641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45f735-a17e-4055-a4dc-ead3a5a02d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:20.825084 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45f735-a17e-4055-a4dc-ead3a5a02d7b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:20.838591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 344/691] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:20.845182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45f735-a17e-4055-a4dc-ead3a5a02d7b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:20.893871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4a1f1-d680-4a61-9216-24332b77690a None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:20.930582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daaee92-5374-48d3-baeb-8d6c2d691731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:20.932381 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daaee92-5374-48d3-baeb-8d6c2d691731 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:20.932977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daaee92-5374-48d3-baeb-8d6c2d691731 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:20.933424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daaee92-5374-48d3-baeb-8d6c2d691731 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:20.940991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daaee92-5374-48d3-baeb-8d6c2d691731 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:20.943015 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daaee92-5374-48d3-baeb-8d6c2d691731 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:20.958707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-5daaee92-5374-48d3-baeb-8d6c2d691731 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:20.958707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:20.958707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:20.958707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:20.958707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:20.958707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:20.958707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:20.958707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:20.958707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:20.958707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:20.958707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:20.958707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:20.958707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:20.958707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:20.958707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:20.959611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:20.960482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:20.960482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:20.960482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:20.960482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:20.960482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:20.960482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:20.960482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:20.960482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:20.964066 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 348/692] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:20.970094 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daaee92-5374-48d3-baeb-8d6c2d691731 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:21.080711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daaee92-5374-48d3-baeb-8d6c2d691731 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:21.117850 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29fa13-5b28-4f23-9f25-9f290a74a7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:21.119261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29fa13-5b28-4f23-9f25-9f290a74a7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:21.119895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29fa13-5b28-4f23-9f25-9f290a74a7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:21.119895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29fa13-5b28-4f23-9f25-9f290a74a7f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:21.120639 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29fa13-5b28-4f23-9f25-9f290a74a7f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:21.120993 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29fa13-5b28-4f23-9f25-9f290a74a7f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:21.122652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29fa13-5b28-4f23-9f25-9f290a74a7f8 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:21.136369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 349/693] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:21.142215 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29fa13-5b28-4f23-9f25-9f290a74a7f8 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:21.180336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45f735-a17e-4055-a4dc-ead3a5a02d7b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:21.238939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc84bb-2aee-4546-befe-96278f02f005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:21.239963 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc84bb-2aee-4546-befe-96278f02f005 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:21.240243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc84bb-2aee-4546-befe-96278f02f005 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:21.240517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc84bb-2aee-4546-befe-96278f02f005 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:21.241246 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc84bb-2aee-4546-befe-96278f02f005 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:21.243865 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc84bb-2aee-4546-befe-96278f02f005 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:21.256633 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29fa13-5b28-4f23-9f25-9f290a74a7f8 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:21.268960 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 345/694] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:29:20 2022] POST /identity/v3/users => generated 254 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:29:21.271189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1430d-3946-4973-9384-c1c84a76ac0b None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:21.271647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1430d-3946-4973-9384-c1c84a76ac0b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:21.272104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1430d-3946-4973-9384-c1c84a76ac0b None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:21.274606 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 346/695] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:21.287720 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d48d2-9339-433b-a93d-bace30df6f25 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:21.288091 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d48d2-9339-433b-a93d-bace30df6f25 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:21.288473 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d48d2-9339-433b-a93d-bace30df6f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:21.303365 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c875672-fdf3-4ebc-97a3-04dec7d8424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:21.304280 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c875672-fdf3-4ebc-97a3-04dec7d8424d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:21.304614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c875672-fdf3-4ebc-97a3-04dec7d8424d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:21.304896 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c875672-fdf3-4ebc-97a3-04dec7d8424d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:21.307148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c875672-fdf3-4ebc-97a3-04dec7d8424d None admin] RBAC: Adding query filter params (role.id=0b37e8a909204679b705bf258b1cd8f1, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=a90b5737f2c345b08460d291ccf49466) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:21.307513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c875672-fdf3-4ebc-97a3-04dec7d8424d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:21.309115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c875672-fdf3-4ebc-97a3-04dec7d8424d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:21.316821 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 350/696] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:21 2022] GET /identity/v3/role_assignments?user.id=a90b5737f2c345b08460d291ccf49466&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=0b37e8a909204679b705bf258b1cd8f1 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:21.335722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-625d48d2-9339-433b-a93d-bace30df6f25 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:21.337042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-625d48d2-9339-433b-a93d-bace30df6f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:21.411862 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 347/697] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:21.448537 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c875672-fdf3-4ebc-97a3-04dec7d8424d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:21.608020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c875672-fdf3-4ebc-97a3-04dec7d8424d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:21.647214 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdd541-f4a2-4c86-9559-16417de5d74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:21.648007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdd541-f4a2-4c86-9559-16417de5d74d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:21.648285 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdd541-f4a2-4c86-9559-16417de5d74d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:21.648556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdd541-f4a2-4c86-9559-16417de5d74d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:21.659970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdd541-f4a2-4c86-9559-16417de5d74d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-47bdd541-f4a2-4c86-9559-16417de5d74d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:21.668423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:21.669558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:21.670565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:21.670565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:21.670565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:21.670565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:21.670565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:21.670565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:21.670565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:21.670565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:21.670565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:21.670565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:21.670565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:29:21.670565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:21.674198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 351/698] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:29:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:21.677636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d48d2-9339-433b-a93d-bace30df6f25 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:21.785631 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d48d2-9339-433b-a93d-bace30df6f25 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:21.822551 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997be28-aaa2-40ea-80b0-6e75ef3de2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:21.823226 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997be28-aaa2-40ea-80b0-6e75ef3de2ff None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:21.823505 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997be28-aaa2-40ea-80b0-6e75ef3de2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:21.823776 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997be28-aaa2-40ea-80b0-6e75ef3de2ff None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:21.824523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997be28-aaa2-40ea-80b0-6e75ef3de2ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:21.824825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997be28-aaa2-40ea-80b0-6e75ef3de2ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:21.826197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997be28-aaa2-40ea-80b0-6e75ef3de2ff None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:21.834988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 348/699] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:29:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:21.842811 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdd541-f4a2-4c86-9559-16417de5d74d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:22.005854 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdd541-f4a2-4c86-9559-16417de5d74d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:22.047776 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd2dfd-828d-400a-a5ce-0890cad1e020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:22.048571 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd2dfd-828d-400a-a5ce-0890cad1e020 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:22.048845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd2dfd-828d-400a-a5ce-0890cad1e020 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:22.049163 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd2dfd-828d-400a-a5ce-0890cad1e020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:22.063225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd2dfd-828d-400a-a5ce-0890cad1e020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:22.064658 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd2dfd-828d-400a-a5ce-0890cad1e020 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:22.086034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-fadd2dfd-828d-400a-a5ce-0890cad1e020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:22.086034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:22.086034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:22.086034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:22.086034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:22.086034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:22.086034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:22.086034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:22.086034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:22.086034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:22.086034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:22.086034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:22.086034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:22.086034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:22.086034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:22.087493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:22.088725 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:22.088725 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:22.088725 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:22.088725 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:22.088725 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 352/700] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:22.093185 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997be28-aaa2-40ea-80b0-6e75ef3de2ff None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:22.228799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997be28-aaa2-40ea-80b0-6e75ef3de2ff None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:22.263204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fb0fe-efec-4564-9613-0165a01e7cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:22.263794 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fb0fe-efec-4564-9613-0165a01e7cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:22.264072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fb0fe-efec-4564-9613-0165a01e7cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:22.264345 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fb0fe-efec-4564-9613-0165a01e7cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:22.265060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fb0fe-efec-4564-9613-0165a01e7cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:22.265363 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fb0fe-efec-4564-9613-0165a01e7cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:22.266797 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fb0fe-efec-4564-9613-0165a01e7cf4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:22.279971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 349/701] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:22.285423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd2dfd-828d-400a-a5ce-0890cad1e020 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:22.402857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd2dfd-828d-400a-a5ce-0890cad1e020 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:22.438912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60782fa5-54fa-4bb8-8c03-9e2fed29e198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:22.439702 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60782fa5-54fa-4bb8-8c03-9e2fed29e198 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:22.439979 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60782fa5-54fa-4bb8-8c03-9e2fed29e198 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:22.440251 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60782fa5-54fa-4bb8-8c03-9e2fed29e198 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:22.448189 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60782fa5-54fa-4bb8-8c03-9e2fed29e198 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:22.449625 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60782fa5-54fa-4bb8-8c03-9e2fed29e198 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-60782fa5-54fa-4bb8-8c03-9e2fed29e198 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:22.464156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:22.465126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:22.466531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:22.466531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:22.466531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:22.466531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:22.466531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:22.466531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:22.466531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:22.466531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:22.466531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:29:22.466531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:22.466531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 353/702] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 5 15:29:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:22.471555 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fb0fe-efec-4564-9613-0165a01e7cf4 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:22.575249 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6df888-e9bb-4616-a45e-294d7f824258 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:22.575594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6df888-e9bb-4616-a45e-294d7f824258 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:22.575791 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6df888-e9bb-4616-a45e-294d7f824258 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:22.577471 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 354/703] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:29:22.582238 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8aa971-5c81-4dd2-b6d7-c39c18ecb9e9 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:22.582526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8aa971-5c81-4dd2-b6d7-c39c18ecb9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:22.582806 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8aa971-5c81-4dd2-b6d7-c39c18ecb9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:22.601885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-4e8aa971-5c81-4dd2-b6d7-c39c18ecb9e9 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:22.604188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4e8aa971-5c81-4dd2-b6d7-c39c18ecb9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:22.650326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fb0fe-efec-4564-9613-0165a01e7cf4 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:22.711727 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 355/704] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:29:22.721137 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a2445-dba2-48e1-aae0-f44c1173c7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:22.721712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a2445-dba2-48e1-aae0-f44c1173c7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:22.721994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a2445-dba2-48e1-aae0-f44c1173c7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:22.722291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a2445-dba2-48e1-aae0-f44c1173c7a0 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:22.723388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a2445-dba2-48e1-aae0-f44c1173c7a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:22.723693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a2445-dba2-48e1-aae0-f44c1173c7a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:22.725174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a2445-dba2-48e1-aae0-f44c1173c7a0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:22.743898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 350/705] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 5 15:29:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:22.749245 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8aa971-5c81-4dd2-b6d7-c39c18ecb9e9 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:22.771429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a2445-dba2-48e1-aae0-f44c1173c7a0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:22.879747 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a2445-dba2-48e1-aae0-f44c1173c7a0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:22.909123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8aa971-5c81-4dd2-b6d7-c39c18ecb9e9 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:22.926140 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f04bd-fc9f-46ae-b27a-494c328bf1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:22.927172 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f04bd-fc9f-46ae-b27a-494c328bf1df None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:22.927739 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f04bd-fc9f-46ae-b27a-494c328bf1df None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:22.928025 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f04bd-fc9f-46ae-b27a-494c328bf1df None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:22.928683 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f04bd-fc9f-46ae-b27a-494c328bf1df None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:22.930059 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f04bd-fc9f-46ae-b27a-494c328bf1df None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-8d5f04bd-fc9f-46ae-b27a-494c328bf1df None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:22.948326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:22.949360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:22.950251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 351/706] 10.222.0.58 () {56 vars in 1129 bytes} [Thu May 5 15:29:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:22.957337 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f04bd-fc9f-46ae-b27a-494c328bf1df None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:22.962981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7be48-c420-4626-b090-8bd437a90718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:22.963662 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7be48-c420-4626-b090-8bd437a90718 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:22.963943 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7be48-c420-4626-b090-8bd437a90718 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:22.964219 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7be48-c420-4626-b090-8bd437a90718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:23.068364 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f04bd-fc9f-46ae-b27a-494c328bf1df None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:23.111103 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9d405-ed78-49f8-9c60-9d66fa7ad9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:23.111435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7be48-c420-4626-b090-8bd437a90718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:23.111811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9d405-ed78-49f8-9c60-9d66fa7ad9ae None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:23.112095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9d405-ed78-49f8-9c60-9d66fa7ad9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:23.112368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9d405-ed78-49f8-9c60-9d66fa7ad9ae None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:23.112610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7be48-c420-4626-b090-8bd437a90718 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:23.113065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9d405-ed78-49f8-9c60-9d66fa7ad9ae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:23.113370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9d405-ed78-49f8-9c60-9d66fa7ad9ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:23.114933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9d405-ed78-49f8-9c60-9d66fa7ad9ae None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:23.120478 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 352/707] 10.222.0.58 () {56 vars in 1124 bytes} [Thu May 5 15:29:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:23.122155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942239a-3465-47ef-a7ba-ed0bb8d2f414 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:23.122471 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942239a-3465-47ef-a7ba-ed0bb8d2f414 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:23.122745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942239a-3465-47ef-a7ba-ed0bb8d2f414 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:23.126251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 353/708] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:23.127013 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942239a-3465-47ef-a7ba-ed0bb8d2f414 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:23.235329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942239a-3465-47ef-a7ba-ed0bb8d2f414 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:23.246272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 356/709] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:29:23.247749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d772d-b106-4d0a-8459-27d4df838e85 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:23.248037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d772d-b106-4d0a-8459-27d4df838e85 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:23.248313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d772d-b106-4d0a-8459-27d4df838e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:23.269539 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-006d772d-b106-4d0a-8459-27d4df838e85 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:23.271524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-006d772d-b106-4d0a-8459-27d4df838e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:23.275916 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89ce2b-8f42-4170-a050-21cb2dae5ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:23.276584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89ce2b-8f42-4170-a050-21cb2dae5ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:23.276867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89ce2b-8f42-4170-a050-21cb2dae5ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:23.277140 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89ce2b-8f42-4170-a050-21cb2dae5ef8 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:23.277846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89ce2b-8f42-4170-a050-21cb2dae5ef8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:23.278148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89ce2b-8f42-4170-a050-21cb2dae5ef8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:23.279528 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89ce2b-8f42-4170-a050-21cb2dae5ef8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:23.285605 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 354/710] 10.222.0.58 () {56 vars in 1124 bytes} [Thu May 5 15:29:23 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:23.286454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89ce2b-8f42-4170-a050-21cb2dae5ef8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:23.350309 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 357/711] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:23.375403 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d772d-b106-4d0a-8459-27d4df838e85 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:23.451689 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89ce2b-8f42-4170-a050-21cb2dae5ef8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:23.492775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae5ffa-8d03-496f-890f-3f4747818df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:23.495557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae5ffa-8d03-496f-890f-3f4747818df1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:23.495848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae5ffa-8d03-496f-890f-3f4747818df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:23.496129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae5ffa-8d03-496f-890f-3f4747818df1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:23.509683 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae5ffa-8d03-496f-890f-3f4747818df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:23.510797 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae5ffa-8d03-496f-890f-3f4747818df1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:23.533295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-a2ae5ffa-8d03-496f-890f-3f4747818df1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:23.533295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:23.533295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:23.533295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:23.533295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:23.533295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:23.533295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:23.533295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:23.533295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:23.533295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:23.533295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:23.533295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:23.533295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:23.533295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:23.533295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:23.534382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:23.535275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:23.535275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:23.535275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:23.535275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:23.535275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 355/712] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:23.550193 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae5ffa-8d03-496f-890f-3f4747818df1 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:23.597645 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d772d-b106-4d0a-8459-27d4df838e85 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:23.635224 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe94868-fdba-4752-8774-c68051c532df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:23.636871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe94868-fdba-4752-8774-c68051c532df None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:23.637393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe94868-fdba-4752-8774-c68051c532df None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:23.638212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe94868-fdba-4752-8774-c68051c532df None admin] PATH_INFO: `/v3/services/network` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:23.639372 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe94868-fdba-4752-8774-c68051c532df None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:23.641506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe94868-fdba-4752-8774-c68051c532df None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:23.658961 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae5ffa-8d03-496f-890f-3f4747818df1 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-bfe94868-fdba-4752-8774-c68051c532df None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:23.659959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:23.660963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:23.661824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:23.661824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:23.661824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:23.661824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:23.661824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:23.661824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:23.661824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:23.661824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:23.661824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:23.661824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:23.661824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:23.661824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:23.661824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:29:23.661824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:23.663642 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 358/713] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:23 2022] GET /identity/v3/services/network => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:23.670305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe94868-fdba-4752-8774-c68051c532df None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:23.699403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dfa74-3a0c-45d6-9dc1-106e84c22eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:23.700464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dfa74-3a0c-45d6-9dc1-106e84c22eea None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:23.700948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dfa74-3a0c-45d6-9dc1-106e84c22eea None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:23.701420 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dfa74-3a0c-45d6-9dc1-106e84c22eea None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:23.702382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dfa74-3a0c-45d6-9dc1-106e84c22eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:23.702901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dfa74-3a0c-45d6-9dc1-106e84c22eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:23.704565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dfa74-3a0c-45d6-9dc1-106e84c22eea None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:23.717065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 356/714] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:23.726510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dfa74-3a0c-45d6-9dc1-106e84c22eea None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:23.801137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe94868-fdba-4752-8774-c68051c532df None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:23.839118 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f902-0298-4705-801a-dda8ca57ae7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:23.840178 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f902-0298-4705-801a-dda8ca57ae7c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:23.840677 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f902-0298-4705-801a-dda8ca57ae7c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:23.841154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f902-0298-4705-801a-dda8ca57ae7c None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:23.842064 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3f902-0298-4705-801a-dda8ca57ae7c None admin] RBAC: Adding query filter params (name=network) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:23.842763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3f902-0298-4705-801a-dda8ca57ae7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:23.844453 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3f902-0298-4705-801a-dda8ca57ae7c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:23.850456 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 359/715] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 5 15:29:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:23.859140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f902-0298-4705-801a-dda8ca57ae7c None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:23.941713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dfa74-3a0c-45d6-9dc1-106e84c22eea None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:24.015013 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f75dbb-95a3-4799-9148-8b87be648e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:24.015850 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f75dbb-95a3-4799-9148-8b87be648e23 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:24.016128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f75dbb-95a3-4799-9148-8b87be648e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:24.016402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f75dbb-95a3-4799-9148-8b87be648e23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:24.020196 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f902-0298-4705-801a-dda8ca57ae7c None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:24.024249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f75dbb-95a3-4799-9148-8b87be648e23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:24.026637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f75dbb-95a3-4799-9148-8b87be648e23 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:24.055083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d8f75dbb-95a3-4799-9148-8b87be648e23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:24.055083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:24.055083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:24.055083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:24.055083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:24.055083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:24.055083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:24.055083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:24.055083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:24.055083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:24.055083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:24.055083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:24.055083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:24.055083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:24.055083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:24.056521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:24.057524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:24.057524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:24.057524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:24.057524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:24.057524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:24.057524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:24.057524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:24.057524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:24.063463 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 357/716] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:24.064098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430c810-8a76-46eb-a704-3c9cd37453fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:24.064765 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430c810-8a76-46eb-a704-3c9cd37453fc None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:24.065045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430c810-8a76-46eb-a704-3c9cd37453fc None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:24.065319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430c810-8a76-46eb-a704-3c9cd37453fc None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:24.066081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430c810-8a76-46eb-a704-3c9cd37453fc None admin] RBAC: Adding query filter params (type=network) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:24.066409 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430c810-8a76-46eb-a704-3c9cd37453fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:24.067901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430c810-8a76-46eb-a704-3c9cd37453fc None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:24.079655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f75dbb-95a3-4799-9148-8b87be648e23 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:24.080079 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 360/717] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 5 15:29:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:24.190105 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6137e2-01c6-47aa-94bc-7428a4c1f512 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:24.190473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6137e2-01c6-47aa-94bc-7428a4c1f512 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:24.190687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6137e2-01c6-47aa-94bc-7428a4c1f512 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:24.193442 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 361/718] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:29:24.198501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98778a13-80a1-4b4b-ba4e-5aa43ab9634b None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:24.198792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98778a13-80a1-4b4b-ba4e-5aa43ab9634b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:24.199054 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98778a13-80a1-4b4b-ba4e-5aa43ab9634b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:24.217925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-98778a13-80a1-4b4b-ba4e-5aa43ab9634b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:24.219175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-98778a13-80a1-4b4b-ba4e-5aa43ab9634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:24.235881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f75dbb-95a3-4799-9148-8b87be648e23 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:24.295542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7207a7-f856-4478-b5c4-b2c649b8a71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:24.296596 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7207a7-f856-4478-b5c4-b2c649b8a71a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:24.297107 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7207a7-f856-4478-b5c4-b2c649b8a71a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:24.297583 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7207a7-f856-4478-b5c4-b2c649b8a71a None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:24.298620 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7207a7-f856-4478-b5c4-b2c649b8a71a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:24.299147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7207a7-f856-4478-b5c4-b2c649b8a71a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:24.300786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7207a7-f856-4478-b5c4-b2c649b8a71a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:24.318398 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 358/719] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:24.324597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7207a7-f856-4478-b5c4-b2c649b8a71a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:24.338636 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 362/720] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 05 15:29:24.368850 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98778a13-80a1-4b4b-ba4e-5aa43ab9634b None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:24.480745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7207a7-f856-4478-b5c4-b2c649b8a71a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:24.540521 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98778a13-80a1-4b4b-ba4e-5aa43ab9634b None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:24.548294 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e69e9-bc5a-4901-88b4-3a33b531447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:24.548966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e69e9-bc5a-4901-88b4-3a33b531447d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:24.549242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e69e9-bc5a-4901-88b4-3a33b531447d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:24.549514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e69e9-bc5a-4901-88b4-3a33b531447d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:24.550430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e69e9-bc5a-4901-88b4-3a33b531447d None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=2a29a4b1b1aa45aea2e466d8f8b79365) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:24.550745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e69e9-bc5a-4901-88b4-3a33b531447d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:24.552170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e69e9-bc5a-4901-88b4-3a33b531447d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:24.564376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 359/721] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:24 2022] GET /identity/v3/role_assignments?user.id=2a29a4b1b1aa45aea2e466d8f8b79365&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=70f81a43849a47f7bf393b354a46d048 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:24.591118 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9c4bc-25d4-43bf-b53b-96f85fda7652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:24.591906 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9c4bc-25d4-43bf-b53b-96f85fda7652 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:24.592189 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9c4bc-25d4-43bf-b53b-96f85fda7652 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:24.592459 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9c4bc-25d4-43bf-b53b-96f85fda7652 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:24.605156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9c4bc-25d4-43bf-b53b-96f85fda7652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-3fa9c4bc-25d4-43bf-b53b-96f85fda7652 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:24.613191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:24.614340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:24.615167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:24.615167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:24.615167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:24.615167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:24.615167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:24.615167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:24.615167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:24.615167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:24.615167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:24.615167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:24.615167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:29:24.615167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:24.615167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 363/722] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:29:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:24.621484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e69e9-bc5a-4901-88b4-3a33b531447d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:24.734336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e69e9-bc5a-4901-88b4-3a33b531447d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:24.769919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0070950-9886-45f3-8e76-0bf56e22eb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:24.770631 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0070950-9886-45f3-8e76-0bf56e22eb3f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:24.770908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0070950-9886-45f3-8e76-0bf56e22eb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:24.771178 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0070950-9886-45f3-8e76-0bf56e22eb3f None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:24.771929 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0070950-9886-45f3-8e76-0bf56e22eb3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:24.772227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0070950-9886-45f3-8e76-0bf56e22eb3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:24.773713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0070950-9886-45f3-8e76-0bf56e22eb3f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:24.783793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 360/723] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:29:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:24.789901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9c4bc-25d4-43bf-b53b-96f85fda7652 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:24.836597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4578a-eaa6-4063-b1df-f1aae4fad5b5 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:24.837823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4578a-eaa6-4063-b1df-f1aae4fad5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:24.838114 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4578a-eaa6-4063-b1df-f1aae4fad5b5 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:24.839854 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 361/724] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:24.852113 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df5d84-b13b-420f-aa67-9be88d4e5734 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:24.852463 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df5d84-b13b-420f-aa67-9be88d4e5734 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:24.852775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df5d84-b13b-420f-aa67-9be88d4e5734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:24.887126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-60df5d84-b13b-420f-aa67-9be88d4e5734 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:24.888300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-60df5d84-b13b-420f-aa67-9be88d4e5734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:24.907899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9c4bc-25d4-43bf-b53b-96f85fda7652 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:24.949950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac96a6-fcce-49eb-8a09-ce1f72c9ad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:24.950792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac96a6-fcce-49eb-8a09-ce1f72c9ad97 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:24.951073 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac96a6-fcce-49eb-8a09-ce1f72c9ad97 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:24.951347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac96a6-fcce-49eb-8a09-ce1f72c9ad97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:24.967064 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac96a6-fcce-49eb-8a09-ce1f72c9ad97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:24.968444 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac96a6-fcce-49eb-8a09-ce1f72c9ad97 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:24.987423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-d6ac96a6-fcce-49eb-8a09-ce1f72c9ad97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:24.987423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:24.987423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:24.987423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:24.987423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:24.987423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:24.987423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:24.987423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:24.987423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:24.987423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:24.987423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:24.987423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:24.987423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:24.987423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:24.987423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:24.988426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:24.989361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:24.989361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:24.989361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:24.989361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:24.989361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 364/725] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:24.996185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac96a6-fcce-49eb-8a09-ce1f72c9ad97 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:25.042414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 362/726] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:25.062547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df5d84-b13b-420f-aa67-9be88d4e5734 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:25.205621 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac96a6-fcce-49eb-8a09-ce1f72c9ad97 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:25.221714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df5d84-b13b-420f-aa67-9be88d4e5734 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:25.239809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475346f7-011b-45b2-85bd-e9fb08faa65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:25.240560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475346f7-011b-45b2-85bd-e9fb08faa65b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:25.240841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475346f7-011b-45b2-85bd-e9fb08faa65b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:25.241164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475346f7-011b-45b2-85bd-e9fb08faa65b None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:25.241885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475346f7-011b-45b2-85bd-e9fb08faa65b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:25.242231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475346f7-011b-45b2-85bd-e9fb08faa65b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:25.243906 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475346f7-011b-45b2-85bd-e9fb08faa65b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:25.256237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 365/727] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:25.262304 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475346f7-011b-45b2-85bd-e9fb08faa65b None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:25.295778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dc7f8-3e0a-4c7c-937a-6012120fba7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:25.296589 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dc7f8-3e0a-4c7c-937a-6012120fba7a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:25.296875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dc7f8-3e0a-4c7c-937a-6012120fba7a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:25.297148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dc7f8-3e0a-4c7c-937a-6012120fba7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:25.327097 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dc7f8-3e0a-4c7c-937a-6012120fba7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-776dc7f8-3e0a-4c7c-937a-6012120fba7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:25.334770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:25.335693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:25.336531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:25.336531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:25.336531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:25.336531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:25.336531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:25.336531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:25.336531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:25.336531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:25.336531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:25.336531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:25.336531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:25.336531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:25.342644 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 363/728] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:25.348326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dc7f8-3e0a-4c7c-937a-6012120fba7a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:25.364341 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475346f7-011b-45b2-85bd-e9fb08faa65b None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:25.399856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e7c2f-a755-4881-9111-ff73b6b7f522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:25.400700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e7c2f-a755-4881-9111-ff73b6b7f522 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:25.400990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e7c2f-a755-4881-9111-ff73b6b7f522 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:25.401265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e7c2f-a755-4881-9111-ff73b6b7f522 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:25.408821 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e7c2f-a755-4881-9111-ff73b6b7f522 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:25.410291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e7c2f-a755-4881-9111-ff73b6b7f522 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-820e7c2f-a755-4881-9111-ff73b6b7f522 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:25.425115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:25.427463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:25.429711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:25.429711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:25.429711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:25.429711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:25.429711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:25.429711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:25.429711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:25.429711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:25.429711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:29:25.429711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:25.429711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 366/729] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:29:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:25.434205 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e7c2f-a755-4881-9111-ff73b6b7f522 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:25.548007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e7c2f-a755-4881-9111-ff73b6b7f522 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:25.589960 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dc7f8-3e0a-4c7c-937a-6012120fba7a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:25.622281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71030894-f0fd-49b9-a708-17392dd51aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:25.623328 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71030894-f0fd-49b9-a708-17392dd51aba None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:25.623827 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71030894-f0fd-49b9-a708-17392dd51aba None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:25.624319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71030894-f0fd-49b9-a708-17392dd51aba None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:25.625350 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71030894-f0fd-49b9-a708-17392dd51aba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:25.625872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71030894-f0fd-49b9-a708-17392dd51aba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:25.627610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71030894-f0fd-49b9-a708-17392dd51aba None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:25.648444 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 367/730] 10.222.0.58 () {56 vars in 1135 bytes} [Thu May 5 15:29:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:25.654156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71030894-f0fd-49b9-a708-17392dd51aba None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:25.655360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2e88d-00bb-4a33-aaec-6fd99d0ef581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:25.656044 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2e88d-00bb-4a33-aaec-6fd99d0ef581 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:25.656328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2e88d-00bb-4a33-aaec-6fd99d0ef581 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:25.656607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2e88d-00bb-4a33-aaec-6fd99d0ef581 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:25.657356 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2e88d-00bb-4a33-aaec-6fd99d0ef581 None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:25.657662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2e88d-00bb-4a33-aaec-6fd99d0ef581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:25.659049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2e88d-00bb-4a33-aaec-6fd99d0ef581 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:25.673785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 364/731] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:25.679342 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2e88d-00bb-4a33-aaec-6fd99d0ef581 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:25.759433 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71030894-f0fd-49b9-a708-17392dd51aba None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:25.808891 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5b4f9-1fd1-40a9-91c4-11835c84487a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:25.810544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5b4f9-1fd1-40a9-91c4-11835c84487a None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:25.811292 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5b4f9-1fd1-40a9-91c4-11835c84487a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:25.812503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5b4f9-1fd1-40a9-91c4-11835c84487a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:25.891893 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2e88d-00bb-4a33-aaec-6fd99d0ef581 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:25.941464 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5b4f9-1fd1-40a9-91c4-11835c84487a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:25.944607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5b4f9-1fd1-40a9-91c4-11835c84487a None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:25.965340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f768b0c-1911-4226-82dc-46e104b5cdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:25.966560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f768b0c-1911-4226-82dc-46e104b5cdef None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:25.967067 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f768b0c-1911-4226-82dc-46e104b5cdef None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:25.967569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f768b0c-1911-4226-82dc-46e104b5cdef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:25.984394 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f768b0c-1911-4226-82dc-46e104b5cdef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:25.986403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f768b0c-1911-4226-82dc-46e104b5cdef None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:26.026476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-7f768b0c-1911-4226-82dc-46e104b5cdef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:26.026476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:26.026476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:26.026476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:26.026476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:26.026476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:26.026476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:26.026476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:26.026476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:26.026476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:26.026476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:26.026476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:26.026476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:26.026476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:26.026476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:26.027432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:26.028316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:26.028316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:26.028316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:26.028316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:26.031857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 365/732] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:26.037001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f768b0c-1911-4226-82dc-46e104b5cdef None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:26.131023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 368/733] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 05 15:29:26.138892 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0ca41-e703-44b1-a815-8b922950df42 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:26.139481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0ca41-e703-44b1-a815-8b922950df42 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:26.139952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0ca41-e703-44b1-a815-8b922950df42 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:26.141931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 369/734] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:29:26.142860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0ca41-e703-44b1-a815-8b922950df42 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:26.199071 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f768b0c-1911-4226-82dc-46e104b5cdef None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:26.239345 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20a1f5-ed1f-44bc-a784-7fe205dc6388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:26.240315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20a1f5-ed1f-44bc-a784-7fe205dc6388 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:26.240806 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20a1f5-ed1f-44bc-a784-7fe205dc6388 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:26.241354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20a1f5-ed1f-44bc-a784-7fe205dc6388 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:26.242315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20a1f5-ed1f-44bc-a784-7fe205dc6388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:26.242848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20a1f5-ed1f-44bc-a784-7fe205dc6388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:26.245014 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20a1f5-ed1f-44bc-a784-7fe205dc6388 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:26.259370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 366/735] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:26.261691 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1a6fd-3bab-42a3-a5ad-97999d6bf2dd None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:26.262375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1a6fd-3bab-42a3-a5ad-97999d6bf2dd None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:26.262855 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1a6fd-3bab-42a3-a5ad-97999d6bf2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:26.264826 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0ca41-e703-44b1-a815-8b922950df42 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:26.281266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b7d1a6fd-3bab-42a3-a5ad-97999d6bf2dd None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:26.282931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b7d1a6fd-3bab-42a3-a5ad-97999d6bf2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:26.299973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70bcb3-03c3-49d3-aba2-145c5dd3c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:26.300790 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70bcb3-03c3-49d3-aba2-145c5dd3c171 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:26.301074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70bcb3-03c3-49d3-aba2-145c5dd3c171 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:26.301350 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70bcb3-03c3-49d3-aba2-145c5dd3c171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:26.312865 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70bcb3-03c3-49d3-aba2-145c5dd3c171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:26.314356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70bcb3-03c3-49d3-aba2-145c5dd3c171 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:26.333096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-9f70bcb3-03c3-49d3-aba2-145c5dd3c171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:26.333096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:26.333096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:26.333096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:26.333096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:26.333096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:26.333096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:26.333096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:26.333096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:26.333096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:26.333096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:26.333096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:26.333096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:26.333096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:26.333096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:26.334092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:26.334998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:26.334998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:26.334998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:26.334998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:26.334998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 370/736] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:26.335291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70bcb3-03c3-49d3-aba2-145c5dd3c171 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:26.451407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70bcb3-03c3-49d3-aba2-145c5dd3c171 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:26.493666 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020754e-29f6-4433-9965-9b0a3a04eac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:26.493666 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020754e-29f6-4433-9965-9b0a3a04eac0 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:26.493666 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020754e-29f6-4433-9965-9b0a3a04eac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:26.493666 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020754e-29f6-4433-9965-9b0a3a04eac0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:26.494528 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 367/737] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:26.495694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1a6fd-3bab-42a3-a5ad-97999d6bf2dd None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:26.496391 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020754e-29f6-4433-9965-9b0a3a04eac0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:26.497800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020754e-29f6-4433-9965-9b0a3a04eac0 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-5020754e-29f6-4433-9965-9b0a3a04eac0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:26.513766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:26.515072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:26.516043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:26.516043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:26.516043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:26.516043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:26.516043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:26.516043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:26.516043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:26.516043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:26.516043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:29:26.516043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:26.516043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 371/738] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 5 15:29:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:26.521352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020754e-29f6-4433-9965-9b0a3a04eac0 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:26.628029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020754e-29f6-4433-9965-9b0a3a04eac0 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:26.635151 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1a6fd-3bab-42a3-a5ad-97999d6bf2dd None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:26.663137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcb7b5-1952-4879-bee2-e0ee49271141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:26.663834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcb7b5-1952-4879-bee2-e0ee49271141 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:26.664071 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcb7b5-1952-4879-bee2-e0ee49271141 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:26.664344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcb7b5-1952-4879-bee2-e0ee49271141 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:26.665790 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcb7b5-1952-4879-bee2-e0ee49271141 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:26.666098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcb7b5-1952-4879-bee2-e0ee49271141 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:26.667865 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcb7b5-1952-4879-bee2-e0ee49271141 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:26.673139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947bf6b-6f12-4aa1-b82b-cf47cff35b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:26.674082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947bf6b-6f12-4aa1-b82b-cf47cff35b08 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:26.674610 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947bf6b-6f12-4aa1-b82b-cf47cff35b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:26.675082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947bf6b-6f12-4aa1-b82b-cf47cff35b08 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:26.676022 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947bf6b-6f12-4aa1-b82b-cf47cff35b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:26.676542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947bf6b-6f12-4aa1-b82b-cf47cff35b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:26.678106 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947bf6b-6f12-4aa1-b82b-cf47cff35b08 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:26.693138 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 368/739] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:26.694412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947bf6b-6f12-4aa1-b82b-cf47cff35b08 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:26.807787 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947bf6b-6f12-4aa1-b82b-cf47cff35b08 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:26.841190 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 372/740] 10.222.0.58 () {56 vars in 1149 bytes} [Thu May 5 15:29:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:26.841912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcb7b5-1952-4879-bee2-e0ee49271141 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:26.844999 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67569b8e-87d1-43a2-8b33-292d04e064a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:26.845978 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67569b8e-87d1-43a2-8b33-292d04e064a8 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:26.845978 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67569b8e-87d1-43a2-8b33-292d04e064a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:26.846317 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67569b8e-87d1-43a2-8b33-292d04e064a8 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:26.846969 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67569b8e-87d1-43a2-8b33-292d04e064a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:26.848580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67569b8e-87d1-43a2-8b33-292d04e064a8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:26.863898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 369/741] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 5 15:29:26 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:29:26.865284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fae4f-396a-460a-9fc1-6bd95490d3b1 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:26.865562 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fae4f-396a-460a-9fc1-6bd95490d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:26.865835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fae4f-396a-460a-9fc1-6bd95490d3b1 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:26.867270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 370/742] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:26.871149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fae4f-396a-460a-9fc1-6bd95490d3b1 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:26.967074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcb7b5-1952-4879-bee2-e0ee49271141 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:27.026962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fae4f-396a-460a-9fc1-6bd95490d3b1 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:27.034617 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbcd01-2768-437a-9155-703d76ebbe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:27.035971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbcd01-2768-437a-9155-703d76ebbe33 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:27.036269 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbcd01-2768-437a-9155-703d76ebbe33 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:27.036546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbcd01-2768-437a-9155-703d76ebbe33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:27.047939 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbcd01-2768-437a-9155-703d76ebbe33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:27.049493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbcd01-2768-437a-9155-703d76ebbe33 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:27.066606 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20cdf6-d358-40ca-a388-83d09ace0bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:27.067675 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20cdf6-d358-40ca-a388-83d09ace0bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:27.067962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20cdf6-d358-40ca-a388-83d09ace0bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:27.068287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20cdf6-d358-40ca-a388-83d09ace0bb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:27.068386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-14cbcd01-2768-437a-9155-703d76ebbe33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:27.068386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:27.068386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:27.068386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:27.068386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:27.068386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:27.068386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:27.068386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:27.068386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:27.068386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:27.068386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:27.068386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:27.068386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:27.068386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:27.068386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:27.069260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:27.070161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:27.070161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:27.070161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:27.070161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:27.070161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:27.070161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:27.070161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:27.070161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:27.070161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 373/743] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:27.071292 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808128a3-5fd1-48fc-9b3c-2e879ed6617e None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:27.071292 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808128a3-5fd1-48fc-9b3c-2e879ed6617e None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:27.072178 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808128a3-5fd1-48fc-9b3c-2e879ed6617e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:27.091101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-808128a3-5fd1-48fc-9b3c-2e879ed6617e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:27.092306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-808128a3-5fd1-48fc-9b3c-2e879ed6617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:27.150736 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20cdf6-d358-40ca-a388-83d09ace0bb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:27.152184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20cdf6-d358-40ca-a388-83d09ace0bb4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:27.162223 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 374/744] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 05 15:29:27.162223 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808128a3-5fd1-48fc-9b3c-2e879ed6617e None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:27.264764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808128a3-5fd1-48fc-9b3c-2e879ed6617e None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:27.266355 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 371/745] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:26 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 05 15:29:27.267642 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdccd8-254f-4aca-9f86-437035404ea7 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:27.267936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdccd8-254f-4aca-9f86-437035404ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:27.268216 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdccd8-254f-4aca-9f86-437035404ea7 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:27.269670 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 372/746] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:27.270194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdccd8-254f-4aca-9f86-437035404ea7 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:27.302697 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47133319-a71d-461b-bfe5-e1f776eb2eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:27.303356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47133319-a71d-461b-bfe5-e1f776eb2eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:27.303635 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47133319-a71d-461b-bfe5-e1f776eb2eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:27.303908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47133319-a71d-461b-bfe5-e1f776eb2eb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:27.304679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47133319-a71d-461b-bfe5-e1f776eb2eb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:27.304981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47133319-a71d-461b-bfe5-e1f776eb2eb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:27.306794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47133319-a71d-461b-bfe5-e1f776eb2eb2 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:27.322554 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 375/747] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:27.322554 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47133319-a71d-461b-bfe5-e1f776eb2eb2 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:27.377171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdccd8-254f-4aca-9f86-437035404ea7 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:27.409520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dcfda-1730-4eb8-8b7b-5e1d18709f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:27.410210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dcfda-1730-4eb8-8b7b-5e1d18709f3a None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:27.410568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dcfda-1730-4eb8-8b7b-5e1d18709f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:27.410852 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dcfda-1730-4eb8-8b7b-5e1d18709f3a None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:27.411569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1dcfda-1730-4eb8-8b7b-5e1d18709f3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:27.412929 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1dcfda-1730-4eb8-8b7b-5e1d18709f3a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:27.420920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47133319-a71d-461b-bfe5-e1f776eb2eb2 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:27.438431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 373/748] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 5 15:29:27 2022] POST /identity/v3/services => generated 240 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:29:27.438431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded9856-6c6f-4b62-9309-3b2a8f30f51d None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:27.438431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded9856-6c6f-4b62-9309-3b2a8f30f51d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:27.438431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded9856-6c6f-4b62-9309-3b2a8f30f51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:27.448286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-0ded9856-6c6f-4b62-9309-3b2a8f30f51d None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:27.449501 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0ded9856-6c6f-4b62-9309-3b2a8f30f51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:27.480163 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c04a2-b3f2-4657-acdc-89622313871e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:27.481057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c04a2-b3f2-4657-acdc-89622313871e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:27.481339 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c04a2-b3f2-4657-acdc-89622313871e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:27.481610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c04a2-b3f2-4657-acdc-89622313871e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:27.492968 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c04a2-b3f2-4657-acdc-89622313871e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:27.494908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c04a2-b3f2-4657-acdc-89622313871e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:27.525507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-4d8c04a2-b3f2-4657-acdc-89622313871e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:27.525507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:27.525507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:27.525507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:27.525507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:27.525507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:27.525507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:27.525507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:27.525507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:27.525507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:27.525507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:27.525507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:27.525507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:27.525507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:27.525507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:27.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:27.527411 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:27.527411 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:27.527411 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:27.527411 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:27.531535 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 376/749] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:27.532578 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c04a2-b3f2-4657-acdc-89622313871e None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:27.558545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 374/750] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:27.558545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded9856-6c6f-4b62-9309-3b2a8f30f51d None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:27.690512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c04a2-b3f2-4657-acdc-89622313871e None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:27.695416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded9856-6c6f-4b62-9309-3b2a8f30f51d None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:27.724418 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a22803-0456-4453-a0b9-a25c532a84a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:27.725152 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a22803-0456-4453-a0b9-a25c532a84a1 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:27.725362 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a22803-0456-4453-a0b9-a25c532a84a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:27.725612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a22803-0456-4453-a0b9-a25c532a84a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:27.726652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a22803-0456-4453-a0b9-a25c532a84a1 None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=a90b5737f2c345b08460d291ccf49466) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:27.726776 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a22803-0456-4453-a0b9-a25c532a84a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:27.728542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a22803-0456-4453-a0b9-a25c532a84a1 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:27.734012 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 377/751] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:27 2022] GET /identity/v3/role_assignments?user.id=a90b5737f2c345b08460d291ccf49466&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=70f81a43849a47f7bf393b354a46d048 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:27.734917 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a22803-0456-4453-a0b9-a25c532a84a1 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:27.739942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedd6eb-990c-4abf-96f0-3ee082c90031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:27.740978 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedd6eb-990c-4abf-96f0-3ee082c90031 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:27.741477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedd6eb-990c-4abf-96f0-3ee082c90031 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:27.741963 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedd6eb-990c-4abf-96f0-3ee082c90031 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:27.743468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedd6eb-990c-4abf-96f0-3ee082c90031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:27.743978 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedd6eb-990c-4abf-96f0-3ee082c90031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:27.746184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedd6eb-990c-4abf-96f0-3ee082c90031 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:27.763326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 375/752] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:27.770202 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedd6eb-990c-4abf-96f0-3ee082c90031 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:27.932504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a22803-0456-4453-a0b9-a25c532a84a1 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:27.969839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efccfc-9a20-442a-b736-73bcc7d1de21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:27.970580 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efccfc-9a20-442a-b736-73bcc7d1de21 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:27.970870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efccfc-9a20-442a-b736-73bcc7d1de21 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:27.971123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efccfc-9a20-442a-b736-73bcc7d1de21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:27.984042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efccfc-9a20-442a-b736-73bcc7d1de21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:27.986085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedd6eb-990c-4abf-96f0-3ee082c90031 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-e4efccfc-9a20-442a-b736-73bcc7d1de21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:27.991866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:27.992804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:27.993695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:27.993695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:27.993695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:27.993695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:27.993695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:27.993695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:27.993695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:27.993695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:27.993695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:27.993695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:27.993695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:29:27.993695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:27.993695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 378/753] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:29:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:28.005983 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efccfc-9a20-442a-b736-73bcc7d1de21 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:28.062902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99186868-874c-4334-97bb-e2b33c5f0350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:28.064095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99186868-874c-4334-97bb-e2b33c5f0350 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:28.064568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99186868-874c-4334-97bb-e2b33c5f0350 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:28.065050 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99186868-874c-4334-97bb-e2b33c5f0350 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:28.078643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99186868-874c-4334-97bb-e2b33c5f0350 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:28.080360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99186868-874c-4334-97bb-e2b33c5f0350 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:28.113285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-99186868-874c-4334-97bb-e2b33c5f0350 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:28.113285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:28.113285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:28.113285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:28.113285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:28.113285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:28.113285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:28.113285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:28.113285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:28.113285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:28.113285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:28.113285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:28.113285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:28.113285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:28.113285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:28.114240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:28.115101 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:28.115101 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:28.115101 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:28.115101 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:28.115101 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:28.115101 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:28.115101 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:28.115101 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:28.115594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efccfc-9a20-442a-b736-73bcc7d1de21 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:28.117757 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 376/754] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:28.123367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99186868-874c-4334-97bb-e2b33c5f0350 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:28.151038 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9358a0a-07cf-4931-be31-6b031d614be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:28.151709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9358a0a-07cf-4931-be31-6b031d614be6 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:28.151988 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9358a0a-07cf-4931-be31-6b031d614be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:28.152260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9358a0a-07cf-4931-be31-6b031d614be6 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:28.153003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9358a0a-07cf-4931-be31-6b031d614be6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:28.153303 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9358a0a-07cf-4931-be31-6b031d614be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:28.154691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9358a0a-07cf-4931-be31-6b031d614be6 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:28.163409 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 379/755] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:28.175213 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9358a0a-07cf-4931-be31-6b031d614be6 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:28.324649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99186868-874c-4334-97bb-e2b33c5f0350 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:28.346030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9358a0a-07cf-4931-be31-6b031d614be6 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:28.359792 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22998674-502a-44cc-8ead-cbdc0bf44011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:28.361656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22998674-502a-44cc-8ead-cbdc0bf44011 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:28.361656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22998674-502a-44cc-8ead-cbdc0bf44011 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:28.361656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22998674-502a-44cc-8ead-cbdc0bf44011 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:28.362128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22998674-502a-44cc-8ead-cbdc0bf44011 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:28.362555 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22998674-502a-44cc-8ead-cbdc0bf44011 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:28.364147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22998674-502a-44cc-8ead-cbdc0bf44011 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:28.376778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 377/756] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:28.382258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22998674-502a-44cc-8ead-cbdc0bf44011 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:28.396175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78e856-1c7a-49e9-8111-bc01c6e91894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:28.397174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78e856-1c7a-49e9-8111-bc01c6e91894 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:28.397596 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78e856-1c7a-49e9-8111-bc01c6e91894 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:28.398027 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78e856-1c7a-49e9-8111-bc01c6e91894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:28.418901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78e856-1c7a-49e9-8111-bc01c6e91894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:28.420614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78e856-1c7a-49e9-8111-bc01c6e91894 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:28.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-ce78e856-1c7a-49e9-8111-bc01c6e91894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:28.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:28.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:28.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:28.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:28.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:28.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:28.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:28.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:28.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:28.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:28.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:28.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:28.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:28.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:28.464556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:28.465623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:28.465623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:28.465623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:28.465623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:28.467575 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 380/757] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:28.473299 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78e856-1c7a-49e9-8111-bc01c6e91894 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:28.492366 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22998674-502a-44cc-8ead-cbdc0bf44011 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:28.528321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8970d9d-c19d-4e68-8c9d-24cdd6907e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:28.529056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8970d9d-c19d-4e68-8c9d-24cdd6907e72 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:28.529422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8970d9d-c19d-4e68-8c9d-24cdd6907e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:28.529762 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8970d9d-c19d-4e68-8c9d-24cdd6907e72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:28.530817 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8970d9d-c19d-4e68-8c9d-24cdd6907e72 None admin] RBAC: Adding query filter params (role.id=0b37e8a909204679b705bf258b1cd8f1, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=a44a128e68d94e34ac3463eb7f1d8f4f) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:28.531195 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8970d9d-c19d-4e68-8c9d-24cdd6907e72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:28.532679 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8970d9d-c19d-4e68-8c9d-24cdd6907e72 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:28.538819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 378/758] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:28 2022] GET /identity/v3/role_assignments?user.id=a44a128e68d94e34ac3463eb7f1d8f4f&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=0b37e8a909204679b705bf258b1cd8f1 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:28.629662 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78e856-1c7a-49e9-8111-bc01c6e91894 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:28.669868 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cae7a-3f9e-4133-bfed-3aba0be4a826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:28.670580 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cae7a-3f9e-4133-bfed-3aba0be4a826 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:28.670896 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cae7a-3f9e-4133-bfed-3aba0be4a826 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:28.671141 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cae7a-3f9e-4133-bfed-3aba0be4a826 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:28.671877 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063cae7a-3f9e-4133-bfed-3aba0be4a826 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:28.672189 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063cae7a-3f9e-4133-bfed-3aba0be4a826 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:28.673615 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063cae7a-3f9e-4133-bfed-3aba0be4a826 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:28.687710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 381/759] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:28.699331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8970d9d-c19d-4e68-8c9d-24cdd6907e72 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:28.832386 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8970d9d-c19d-4e68-8c9d-24cdd6907e72 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:28.870488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857fbe9-3c2e-409a-882d-8968ab96a8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:28.871307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857fbe9-3c2e-409a-882d-8968ab96a8bc None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:28.871590 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857fbe9-3c2e-409a-882d-8968ab96a8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:28.871867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857fbe9-3c2e-409a-882d-8968ab96a8bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:28.881239 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857fbe9-3c2e-409a-882d-8968ab96a8bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:28.882657 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857fbe9-3c2e-409a-882d-8968ab96a8bc None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-f857fbe9-3c2e-409a-882d-8968ab96a8bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:28.900023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:28.902188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:28.904360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:28.904360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:28.904360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:28.904360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:28.904360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:28.904360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:28.904360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:28.904360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:28.904360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:29:28.904360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:28.904360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 379/760] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 5 15:29:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:28.911408 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cae7a-3f9e-4133-bfed-3aba0be4a826 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:29.051539 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cae7a-3f9e-4133-bfed-3aba0be4a826 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:29.095449 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193b391-3cae-4082-901d-0bb3330692cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:29.096118 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193b391-3cae-4082-901d-0bb3330692cb None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:29.096397 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193b391-3cae-4082-901d-0bb3330692cb None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:29.096672 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193b391-3cae-4082-901d-0bb3330692cb None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:29.097504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193b391-3cae-4082-901d-0bb3330692cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:29.098053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193b391-3cae-4082-901d-0bb3330692cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:29.099501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193b391-3cae-4082-901d-0bb3330692cb None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:29.123833 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 382/761] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 5 15:29:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:29.129265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857fbe9-3c2e-409a-882d-8968ab96a8bc None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:29.271743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857fbe9-3c2e-409a-882d-8968ab96a8bc None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:29.317377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8fe93-db4b-4b24-ad85-33d5b8cb00dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:29.318178 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8fe93-db4b-4b24-ad85-33d5b8cb00dc None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:29.318461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8fe93-db4b-4b24-ad85-33d5b8cb00dc None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:29.318729 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8fe93-db4b-4b24-ad85-33d5b8cb00dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:29.331746 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8fe93-db4b-4b24-ad85-33d5b8cb00dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:29.333433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8fe93-db4b-4b24-ad85-33d5b8cb00dc None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:29.355645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-c9d8fe93-db4b-4b24-ad85-33d5b8cb00dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:29.355645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:29.355645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:29.355645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:29.355645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:29.355645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:29.355645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:29.355645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:29.355645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:29.355645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:29.355645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:29.355645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:29.355645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:29.355645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:29.355645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:29.356566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:29.357433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:29.357433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:29.357433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:29.357433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:29.359678 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 380/762] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:29.365424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193b391-3cae-4082-901d-0bb3330692cb None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:29.492902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193b391-3cae-4082-901d-0bb3330692cb None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:29.556315 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585916b-de1d-47eb-8080-4de0e9e1e02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:29.556906 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585916b-de1d-47eb-8080-4de0e9e1e02c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:29.557183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585916b-de1d-47eb-8080-4de0e9e1e02c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:29.557450 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585916b-de1d-47eb-8080-4de0e9e1e02c None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:29.558188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585916b-de1d-47eb-8080-4de0e9e1e02c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:29.558486 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585916b-de1d-47eb-8080-4de0e9e1e02c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:29.559836 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585916b-de1d-47eb-8080-4de0e9e1e02c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:29.576887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 383/763] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:29.582123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8fe93-db4b-4b24-ad85-33d5b8cb00dc None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:29.715641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8fe93-db4b-4b24-ad85-33d5b8cb00dc None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:29.764863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881fb17-8721-4e6b-b4bf-a79ede166092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:29.765719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881fb17-8721-4e6b-b4bf-a79ede166092 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:29.766003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881fb17-8721-4e6b-b4bf-a79ede166092 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:29.766108 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509aca-67c4-4eba-8ed4-8717940353f8 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:29.766531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881fb17-8721-4e6b-b4bf-a79ede166092 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:29.766621 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509aca-67c4-4eba-8ed4-8717940353f8 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:29.766694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509aca-67c4-4eba-8ed4-8717940353f8 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:29.768307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 384/764] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:29:29.773493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4bb94-8005-4e69-af1a-e19647df12cc None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:29.773779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4bb94-8005-4e69-af1a-e19647df12cc None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:29.774123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4bb94-8005-4e69-af1a-e19647df12cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:29.776609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881fb17-8721-4e6b-b4bf-a79ede166092 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:29.778054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881fb17-8721-4e6b-b4bf-a79ede166092 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:29.801405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-1881fb17-8721-4e6b-b4bf-a79ede166092 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:29.801405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:29.801405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:29.801405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:29.801405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:29.801405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:29.801405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:29.801405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:29.801405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:29.801405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:29.801405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:29.801405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:29.801405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:29.801405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:29.801405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:29.802375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:29.803273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:29.803273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:29.803273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:29.803273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:29.803273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:29.803273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:29.803273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:29.803273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:29.812332 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-dbb4bb94-8005-4e69-af1a-e19647df12cc None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:29.813511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-dbb4bb94-8005-4e69-af1a-e19647df12cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:29.814529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 381/765] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:29.817347 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881fb17-8721-4e6b-b4bf-a79ede166092 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:29.943743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 385/766] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:29.974937 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4bb94-8005-4e69-af1a-e19647df12cc None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:29.988949 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881fb17-8721-4e6b-b4bf-a79ede166092 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:30.033401 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154e10b-cb5b-4a11-a83d-93a8ea81b73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:30.034086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154e10b-cb5b-4a11-a83d-93a8ea81b73f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:30.034393 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154e10b-cb5b-4a11-a83d-93a8ea81b73f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:30.034672 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154e10b-cb5b-4a11-a83d-93a8ea81b73f None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:30.035476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154e10b-cb5b-4a11-a83d-93a8ea81b73f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:30.035786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154e10b-cb5b-4a11-a83d-93a8ea81b73f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:30.037242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154e10b-cb5b-4a11-a83d-93a8ea81b73f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:30.064665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 382/767] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:30.070409 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154e10b-cb5b-4a11-a83d-93a8ea81b73f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:30.168803 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4bb94-8005-4e69-af1a-e19647df12cc None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:30.215101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fda96c-7075-46ce-b839-355fbdfd0e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:30.216008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fda96c-7075-46ce-b839-355fbdfd0e51 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:30.216293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fda96c-7075-46ce-b839-355fbdfd0e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:30.216560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fda96c-7075-46ce-b839-355fbdfd0e51 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:30.217209 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fda96c-7075-46ce-b839-355fbdfd0e51 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:30.218598 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fda96c-7075-46ce-b839-355fbdfd0e51 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-a5fda96c-7075-46ce-b839-355fbdfd0e51 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:30.235074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:30.236058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:30.236895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 386/768] 10.222.0.58 () {56 vars in 1129 bytes} [Thu May 5 15:29:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:30.238286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afacfb3-d391-49f2-800e-3db9fe20aa2c None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:30.238286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afacfb3-d391-49f2-800e-3db9fe20aa2c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:30.238541 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afacfb3-d391-49f2-800e-3db9fe20aa2c None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:30.244491 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 387/769] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:30.244491 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afacfb3-d391-49f2-800e-3db9fe20aa2c None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:30.260178 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154e10b-cb5b-4a11-a83d-93a8ea81b73f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:30.301773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5aec42-ae24-4aed-bf01-ad95495a5e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:30.302968 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5aec42-ae24-4aed-bf01-ad95495a5e03 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:30.303256 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5aec42-ae24-4aed-bf01-ad95495a5e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:30.303528 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5aec42-ae24-4aed-bf01-ad95495a5e03 None admin] PATH_INFO: `/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/2a29a4b1b1aa45aea2e466d8f8b79365/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:30.305577 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5aec42-ae24-4aed-bf01-ad95495a5e03 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdd58b84c6394504beb84d13d13d60a1, user_id=2a29a4b1b1aa45aea2e466d8f8b79365, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:30.307472 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5aec42-ae24-4aed-bf01-ad95495a5e03 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:30.334275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 383/770] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:29:30 2022] PUT /identity/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/2a29a4b1b1aa45aea2e466d8f8b79365/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:29:30.334275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b499b9-1442-48ce-9419-28fbdc16335d None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:30.334275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b499b9-1442-48ce-9419-28fbdc16335d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:30.334275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b499b9-1442-48ce-9419-28fbdc16335d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:30.351101 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-30b499b9-1442-48ce-9419-28fbdc16335d None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:30.353068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-30b499b9-1442-48ce-9419-28fbdc16335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:30.381297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afacfb3-d391-49f2-800e-3db9fe20aa2c None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:30.429144 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbfaa3-2838-4d73-b5ac-60011735002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:30.429821 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbfaa3-2838-4d73-b5ac-60011735002c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:30.430099 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbfaa3-2838-4d73-b5ac-60011735002c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:30.430845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbfaa3-2838-4d73-b5ac-60011735002c None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:30.432006 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbfaa3-2838-4d73-b5ac-60011735002c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:30.432365 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbfaa3-2838-4d73-b5ac-60011735002c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:30.434142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbfaa3-2838-4d73-b5ac-60011735002c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:30.437530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 384/771] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:30.442356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 388/772] 10.222.0.58 () {56 vars in 1124 bytes} [Thu May 5 15:29:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:30.442356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee79b2a-30d0-4dab-bf96-eda5fe41dc03 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:30.442356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee79b2a-30d0-4dab-bf96-eda5fe41dc03 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:30.442356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee79b2a-30d0-4dab-bf96-eda5fe41dc03 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:30.443687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 389/773] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:30.449726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caae91-8434-44b3-b398-15a27a8ae6ef None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:30.449892 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee79b2a-30d0-4dab-bf96-eda5fe41dc03 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:30.450368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caae91-8434-44b3-b398-15a27a8ae6ef None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:30.450774 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caae91-8434-44b3-b398-15a27a8ae6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:30.471896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b3caae91-8434-44b3-b398-15a27a8ae6ef None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:30.473674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b3caae91-8434-44b3-b398-15a27a8ae6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:30.572883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 385/774] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:30.574446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caae91-8434-44b3-b398-15a27a8ae6ef None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:30.592525 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee79b2a-30d0-4dab-bf96-eda5fe41dc03 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:30.639169 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64b485-1086-49ef-92db-bbfceff740bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:30.640138 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64b485-1086-49ef-92db-bbfceff740bc None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:30.640436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64b485-1086-49ef-92db-bbfceff740bc None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:30.640712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64b485-1086-49ef-92db-bbfceff740bc None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:30.641431 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64b485-1086-49ef-92db-bbfceff740bc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:30.641741 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64b485-1086-49ef-92db-bbfceff740bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:30.643591 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64b485-1086-49ef-92db-bbfceff740bc None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:30.651615 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 390/775] 10.222.0.58 () {56 vars in 1124 bytes} [Thu May 5 15:29:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:30.654250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64b485-1086-49ef-92db-bbfceff740bc None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:30.708635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caae91-8434-44b3-b398-15a27a8ae6ef None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:30.749042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f0a2c-8f73-43d5-b8c2-33a5ec58e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:30.749862 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f0a2c-8f73-43d5-b8c2-33a5ec58e67c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:30.750145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f0a2c-8f73-43d5-b8c2-33a5ec58e67c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:30.750516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f0a2c-8f73-43d5-b8c2-33a5ec58e67c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:30.761965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f0a2c-8f73-43d5-b8c2-33a5ec58e67c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-831f0a2c-8f73-43d5-b8c2-33a5ec58e67c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:30.769723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:30.771826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:30.773756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:30.773756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:30.773756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:30.773756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:30.773756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:30.773756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:30.773756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:30.773756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:30.773756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:30.773756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:30.773756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:29:30.773756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:30.773756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 386/776] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:29:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:30.775623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64b485-1086-49ef-92db-bbfceff740bc None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:30.776030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f0a2c-8f73-43d5-b8c2-33a5ec58e67c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:30.814389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f798061-1e56-4658-9acc-2de3639d38b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:30.815250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f798061-1e56-4658-9acc-2de3639d38b5 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:30.815531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f798061-1e56-4658-9acc-2de3639d38b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:30.815802 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f798061-1e56-4658-9acc-2de3639d38b5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:30.816449 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f798061-1e56-4658-9acc-2de3639d38b5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:30.817814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f798061-1e56-4658-9acc-2de3639d38b5 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-3f798061-1e56-4658-9acc-2de3639d38b5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:30.831561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:30.833823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:30.835709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:30.835709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:30.835709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:30.835709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:30.835709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:30.835709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:30.835709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:30.835709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:30.835709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:30.835709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:30.835709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:30.835709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:30.835709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:29:30.835709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:30.835709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 391/777] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:30 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:30.846354 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f798061-1e56-4658-9acc-2de3639d38b5 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:30.888520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f0a2c-8f73-43d5-b8c2-33a5ec58e67c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:30.932153 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a3143-d1d0-4f05-8b0f-6b36b2d73227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:30.933085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a3143-d1d0-4f05-8b0f-6b36b2d73227 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:30.933371 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a3143-d1d0-4f05-8b0f-6b36b2d73227 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:30.933652 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a3143-d1d0-4f05-8b0f-6b36b2d73227 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:30.934642 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a3143-d1d0-4f05-8b0f-6b36b2d73227 None admin] RBAC: Adding query filter params (interface=public, service_id=de65ca84ed2b4f09bd67b42f5ce44a04, region_id=RegionOne) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:30.935251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a3143-d1d0-4f05-8b0f-6b36b2d73227 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:30.936622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a3143-d1d0-4f05-8b0f-6b36b2d73227 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:30.947328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 387/778] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 5 15:29:30 2022] GET /identity/v3/endpoints?service_id=de65ca84ed2b4f09bd67b42f5ce44a04&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:30.948248 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a3143-d1d0-4f05-8b0f-6b36b2d73227 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:30.954625 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f798061-1e56-4658-9acc-2de3639d38b5 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:30.997235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fde998-ff25-4abb-8ff6-5cdce16429b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:30.997930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fde998-ff25-4abb-8ff6-5cdce16429b1 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:30.998259 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fde998-ff25-4abb-8ff6-5cdce16429b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:30.998987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fde998-ff25-4abb-8ff6-5cdce16429b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:30.999768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fde998-ff25-4abb-8ff6-5cdce16429b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:31.000079 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fde998-ff25-4abb-8ff6-5cdce16429b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:31.002185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fde998-ff25-4abb-8ff6-5cdce16429b1 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:31.014660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 392/779] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:29:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:31.016013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fde998-ff25-4abb-8ff6-5cdce16429b1 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:31.065749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a3143-d1d0-4f05-8b0f-6b36b2d73227 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:31.108344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc75930-711a-478f-827a-dc88bb3e3a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:31.108932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc75930-711a-478f-827a-dc88bb3e3a07 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:31.109404 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc75930-711a-478f-827a-dc88bb3e3a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:31.109517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc75930-711a-478f-827a-dc88bb3e3a07 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:31.110718 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc75930-711a-478f-827a-dc88bb3e3a07 None admin] RBAC: Adding query filter params (name=network) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:31.111082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc75930-711a-478f-827a-dc88bb3e3a07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:31.112823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc75930-711a-478f-827a-dc88bb3e3a07 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:31.122260 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 388/780] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 5 15:29:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:31.123316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc75930-711a-478f-827a-dc88bb3e3a07 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:31.142821 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fde998-ff25-4abb-8ff6-5cdce16429b1 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:31.180441 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb83c8-364d-43a1-830d-8d2abc392904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:31.181192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb83c8-364d-43a1-830d-8d2abc392904 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:31.181481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb83c8-364d-43a1-830d-8d2abc392904 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:31.181758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb83c8-364d-43a1-830d-8d2abc392904 None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:31.182477 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb83c8-364d-43a1-830d-8d2abc392904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:31.183908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb83c8-364d-43a1-830d-8d2abc392904 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:31.189550 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 393/781] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 5 15:29:31 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:31.190410 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb83c8-364d-43a1-830d-8d2abc392904 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:31.276299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc75930-711a-478f-827a-dc88bb3e3a07 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:31.310903 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb83c8-364d-43a1-830d-8d2abc392904 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:31.325623 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af92a1-0675-449c-9c18-41d8b9299ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:31.327012 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af92a1-0675-449c-9c18-41d8b9299ccf None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:31.327297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af92a1-0675-449c-9c18-41d8b9299ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:31.327570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af92a1-0675-449c-9c18-41d8b9299ccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:31.345336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af92a1-0675-449c-9c18-41d8b9299ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:31.347221 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af92a1-0675-449c-9c18-41d8b9299ccf None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:31.349026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f079a-c259-4d85-b6c3-8720837c0d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:31.349952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f079a-c259-4d85-b6c3-8720837c0d85 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:31.350113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f079a-c259-4d85-b6c3-8720837c0d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:31.350533 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f079a-c259-4d85-b6c3-8720837c0d85 None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:31.351555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f079a-c259-4d85-b6c3-8720837c0d85 None admin] RBAC: Adding query filter params (type=network) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:31.351663 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f079a-c259-4d85-b6c3-8720837c0d85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:31.353626 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f079a-c259-4d85-b6c3-8720837c0d85 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:31.360162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 394/782] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 5 15:29:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:31.361610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d38ea8-3e12-46be-9cd4-180b5970f7cd None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:31.362034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d38ea8-3e12-46be-9cd4-180b5970f7cd None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:31.362403 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d38ea8-3e12-46be-9cd4-180b5970f7cd None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:31.368441 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 395/783] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:31.368441 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d38ea8-3e12-46be-9cd4-180b5970f7cd None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:31.376756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-b1af92a1-0675-449c-9c18-41d8b9299ccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:31.376756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:31.376756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:31.376756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:31.376756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:31.376756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:31.376756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:31.376756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:31.376756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:31.376756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:31.376756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:31.376756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:31.376756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:31.376756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:31.376756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:31.377698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:31.378607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:31.378607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:31.378607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:31.378607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:31.379984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 389/784] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:31.385498 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece3908-79ca-48e7-bca4-9992a1ad0895 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:31.385498 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece3908-79ca-48e7-bca4-9992a1ad0895 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:31.385498 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece3908-79ca-48e7-bca4-9992a1ad0895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:31.407389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-9ece3908-79ca-48e7-bca4-9992a1ad0895 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:31.408986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9ece3908-79ca-48e7-bca4-9992a1ad0895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:31.481909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 390/785] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:31.483193 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece3908-79ca-48e7-bca4-9992a1ad0895 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:31.490743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d38ea8-3e12-46be-9cd4-180b5970f7cd None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:31.527501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1824d34-2509-42f8-afec-dd7ada3fc5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:31.527821 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1824d34-2509-42f8-afec-dd7ada3fc5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:31.528110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1824d34-2509-42f8-afec-dd7ada3fc5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:31.528387 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1824d34-2509-42f8-afec-dd7ada3fc5b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:31.529182 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1824d34-2509-42f8-afec-dd7ada3fc5b8 None admin] RBAC: Adding query filter params (interface=public, service_id=ab4602b3fe1c46439b12452e69c7dc5a, region_id=RegionOne) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:31.529493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1824d34-2509-42f8-afec-dd7ada3fc5b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:31.530888 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1824d34-2509-42f8-afec-dd7ada3fc5b8 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:31.540333 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 396/786] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 5 15:29:31 2022] GET /identity/v3/endpoints?service_id=ab4602b3fe1c46439b12452e69c7dc5a&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:31.541166 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1824d34-2509-42f8-afec-dd7ada3fc5b8 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:31.589477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece3908-79ca-48e7-bca4-9992a1ad0895 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:31.624956 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453eaf85-0b2c-46be-913a-1d2d51239868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:31.625993 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eaf85-0b2c-46be-913a-1d2d51239868 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:31.626495 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eaf85-0b2c-46be-913a-1d2d51239868 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:31.626964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eaf85-0b2c-46be-913a-1d2d51239868 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:31.627871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453eaf85-0b2c-46be-913a-1d2d51239868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:31.628386 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453eaf85-0b2c-46be-913a-1d2d51239868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:31.629942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453eaf85-0b2c-46be-913a-1d2d51239868 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:31.641812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 391/787] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:31.642922 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453eaf85-0b2c-46be-913a-1d2d51239868 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:31.658021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1824d34-2509-42f8-afec-dd7ada3fc5b8 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:31.698930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca70f6-4b36-41f5-837e-a48dbfdc8b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:31.699728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca70f6-4b36-41f5-837e-a48dbfdc8b81 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:31.700007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca70f6-4b36-41f5-837e-a48dbfdc8b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:31.700283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca70f6-4b36-41f5-837e-a48dbfdc8b81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:31.710504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca70f6-4b36-41f5-837e-a48dbfdc8b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-c4ca70f6-4b36-41f5-837e-a48dbfdc8b81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:31.718857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:31.719768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:31.720605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:31.720605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:31.720605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:31.720605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:31.720605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:31.720605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:31.720605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:31.720605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:31.720605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:31.720605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:31.720605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:31.720605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:31.720605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 397/788] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:31.721382 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca70f6-4b36-41f5-837e-a48dbfdc8b81 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:31.773357 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453eaf85-0b2c-46be-913a-1d2d51239868 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:31.808921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a023d94-0a0f-4e84-a56a-1097c93421c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:31.809581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a023d94-0a0f-4e84-a56a-1097c93421c3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:31.809868 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a023d94-0a0f-4e84-a56a-1097c93421c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:31.810144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a023d94-0a0f-4e84-a56a-1097c93421c3 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:31.810860 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a023d94-0a0f-4e84-a56a-1097c93421c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:31.812242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a023d94-0a0f-4e84-a56a-1097c93421c3 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:31.822587 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 392/789] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 5 15:29:31 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:31.823569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a023d94-0a0f-4e84-a56a-1097c93421c3 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:31.834582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca70f6-4b36-41f5-837e-a48dbfdc8b81 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:31.875508 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028958f-f031-4eff-9c54-de5da5c6ab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:31.876852 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028958f-f031-4eff-9c54-de5da5c6ab90 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:31.877337 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028958f-f031-4eff-9c54-de5da5c6ab90 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:31.877807 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028958f-f031-4eff-9c54-de5da5c6ab90 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:31.888293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028958f-f031-4eff-9c54-de5da5c6ab90 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:31.890094 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028958f-f031-4eff-9c54-de5da5c6ab90 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-a028958f-f031-4eff-9c54-de5da5c6ab90 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:31.907559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:31.908558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:31.909510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:31.909510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:31.909510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:31.909510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:31.909510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:31.909510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:31.909510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:31.909510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:31.909510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:29:31.909510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:31.912457 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 398/790] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:29:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:31.919846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028958f-f031-4eff-9c54-de5da5c6ab90 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:32.040356 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a023d94-0a0f-4e84-a56a-1097c93421c3 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:32.102192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca192a6-2266-4af2-a5e4-2ea8f59e2084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:32.102192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca192a6-2266-4af2-a5e4-2ea8f59e2084 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:32.102192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca192a6-2266-4af2-a5e4-2ea8f59e2084 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:32.102192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca192a6-2266-4af2-a5e4-2ea8f59e2084 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:32.102700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca192a6-2266-4af2-a5e4-2ea8f59e2084 None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:32.102700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca192a6-2266-4af2-a5e4-2ea8f59e2084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:32.103455 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca192a6-2266-4af2-a5e4-2ea8f59e2084 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:32.112308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 393/791] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:32.118240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028958f-f031-4eff-9c54-de5da5c6ab90 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:32.120651 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca192a6-2266-4af2-a5e4-2ea8f59e2084 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:32.150450 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7bd31-731f-4b66-b39d-68b4d57f581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:32.151064 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7bd31-731f-4b66-b39d-68b4d57f581f None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:32.151361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7bd31-731f-4b66-b39d-68b4d57f581f None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:32.151611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7bd31-731f-4b66-b39d-68b4d57f581f None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:32.152671 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7bd31-731f-4b66-b39d-68b4d57f581f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:32.152778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7bd31-731f-4b66-b39d-68b4d57f581f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:32.154190 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7bd31-731f-4b66-b39d-68b4d57f581f None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:32.174849 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 399/792] 10.222.0.58 () {56 vars in 1135 bytes} [Thu May 5 15:29:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:32.181028 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7bd31-731f-4b66-b39d-68b4d57f581f None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:32.238916 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca192a6-2266-4af2-a5e4-2ea8f59e2084 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:32.280710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91b94f-876f-49a8-9a72-7f575a763895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:32.281580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91b94f-876f-49a8-9a72-7f575a763895 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:32.281862 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91b94f-876f-49a8-9a72-7f575a763895 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:32.282132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91b94f-876f-49a8-9a72-7f575a763895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:32.293443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91b94f-876f-49a8-9a72-7f575a763895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:32.294913 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91b94f-876f-49a8-9a72-7f575a763895 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:32.310008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7bd31-731f-4b66-b39d-68b4d57f581f None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:32.313063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-0f91b94f-876f-49a8-9a72-7f575a763895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:32.313063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:32.313063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:32.313063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:32.313063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:32.313063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:32.313063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:32.313063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:32.313063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:32.313063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:32.313063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:32.313063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:32.313063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:32.313063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:32.313063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:32.314377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:32.315238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:32.315238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:32.315238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:32.315238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:32.315238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 394/793] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:32.319341 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91b94f-876f-49a8-9a72-7f575a763895 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:32.356498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f1a05-6dfb-4e6e-b602-b2e37aac425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:32.358343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f1a05-6dfb-4e6e-b602-b2e37aac425c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:32.358798 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f1a05-6dfb-4e6e-b602-b2e37aac425c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:32.359221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f1a05-6dfb-4e6e-b602-b2e37aac425c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:32.370496 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f1a05-6dfb-4e6e-b602-b2e37aac425c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:32.372150 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f1a05-6dfb-4e6e-b602-b2e37aac425c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:32.391426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-940f1a05-6dfb-4e6e-b602-b2e37aac425c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:32.391426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:32.391426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:32.391426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:32.391426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:32.391426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:32.391426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:32.391426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:32.391426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:32.391426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:32.391426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:32.391426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:32.391426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:32.391426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:32.391426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:32.392523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:32.393416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:32.393416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:32.393416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:32.393416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:32.395553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 400/794] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:32.403292 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f1a05-6dfb-4e6e-b602-b2e37aac425c None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:32.426713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91b94f-876f-49a8-9a72-7f575a763895 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:32.463468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178177b-d3b5-450c-ab89-a74804e596d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:32.464247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178177b-d3b5-450c-ab89-a74804e596d0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:32.464594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178177b-d3b5-450c-ab89-a74804e596d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:32.464937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178177b-d3b5-450c-ab89-a74804e596d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:32.470188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178177b-d3b5-450c-ab89-a74804e596d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:32.470188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178177b-d3b5-450c-ab89-a74804e596d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:32.470188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178177b-d3b5-450c-ab89-a74804e596d0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:32.482357 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 395/795] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:32.487889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178177b-d3b5-450c-ab89-a74804e596d0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:32.587381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178177b-d3b5-450c-ab89-a74804e596d0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:32.625266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868a256-11af-41e9-bb38-8a1a23b87992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:32.626089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868a256-11af-41e9-bb38-8a1a23b87992 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:32.626401 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868a256-11af-41e9-bb38-8a1a23b87992 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:32.626673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868a256-11af-41e9-bb38-8a1a23b87992 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:32.635817 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868a256-11af-41e9-bb38-8a1a23b87992 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:32.638497 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868a256-11af-41e9-bb38-8a1a23b87992 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-3868a256-11af-41e9-bb38-8a1a23b87992 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:32.655090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:32.656051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:32.657468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:32.657468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:32.657468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:32.657468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:32.657468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:32.657468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:32.657468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:32.657468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:32.657468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:29:32.657468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:32.657468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 396/796] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 5 15:29:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:32.658534 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f1a05-6dfb-4e6e-b602-b2e37aac425c None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:32.662359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868a256-11af-41e9-bb38-8a1a23b87992 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:32.716703 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92186e-caa9-4761-8e72-0e0232b27240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:32.717679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92186e-caa9-4761-8e72-0e0232b27240 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:32.718104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92186e-caa9-4761-8e72-0e0232b27240 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:32.718578 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92186e-caa9-4761-8e72-0e0232b27240 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:32.719739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92186e-caa9-4761-8e72-0e0232b27240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:32.720049 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92186e-caa9-4761-8e72-0e0232b27240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:32.721424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92186e-caa9-4761-8e72-0e0232b27240 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:32.733998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 401/797] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:32.739337 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92186e-caa9-4761-8e72-0e0232b27240 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:32.778936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868a256-11af-41e9-bb38-8a1a23b87992 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:32.830069 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcaf60-6ce7-42e0-b1f0-e8cc748e6868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:32.831272 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcaf60-6ce7-42e0-b1f0-e8cc748e6868 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:32.832071 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcaf60-6ce7-42e0-b1f0-e8cc748e6868 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:32.832839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcaf60-6ce7-42e0-b1f0-e8cc748e6868 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:32.834023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcaf60-6ce7-42e0-b1f0-e8cc748e6868 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:32.834889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcaf60-6ce7-42e0-b1f0-e8cc748e6868 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:32.837457 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcaf60-6ce7-42e0-b1f0-e8cc748e6868 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:32.840669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92186e-caa9-4761-8e72-0e0232b27240 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:32.859438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 397/798] 10.222.0.58 () {56 vars in 1149 bytes} [Thu May 5 15:29:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:32.860935 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fae8a-2d67-4221-a2f7-39577e83d5f6 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:32.861224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fae8a-2d67-4221-a2f7-39577e83d5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:32.861504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fae8a-2d67-4221-a2f7-39577e83d5f6 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:32.866721 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 398/799] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:32.866721 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fae8a-2d67-4221-a2f7-39577e83d5f6 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:32.884868 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1382cd-b10b-4eed-83ff-a52578ce31ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:32.886104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1382cd-b10b-4eed-83ff-a52578ce31ac None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:32.886610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1382cd-b10b-4eed-83ff-a52578ce31ac None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:32.887508 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1382cd-b10b-4eed-83ff-a52578ce31ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:32.896364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1382cd-b10b-4eed-83ff-a52578ce31ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:32.899295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1382cd-b10b-4eed-83ff-a52578ce31ac None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:32.917335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-4c1382cd-b10b-4eed-83ff-a52578ce31ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:32.917335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:32.917335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:32.917335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:32.917335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:32.917335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:32.917335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:32.917335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:32.917335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:32.917335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:32.917335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:32.917335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:32.917335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:32.917335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:32.917335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:32.918305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:32.919221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:32.919221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:32.919221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:32.919221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:32.919221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:32.919221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:32.919221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:32.919221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:32.921748 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 402/800] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:32.923144 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32fdae-af8c-4c63-bb97-7238b29bc6bc None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:32.923573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32fdae-af8c-4c63-bb97-7238b29bc6bc None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:32.923993 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32fdae-af8c-4c63-bb97-7238b29bc6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:32.944993 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-7e32fdae-af8c-4c63-bb97-7238b29bc6bc None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:32.947429 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7e32fdae-af8c-4c63-bb97-7238b29bc6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:32.980279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fae8a-2d67-4221-a2f7-39577e83d5f6 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:33.023581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cac6f8-f0dc-4945-b482-02b478ac7ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:33.025195 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cac6f8-f0dc-4945-b482-02b478ac7ada None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:33.025612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cac6f8-f0dc-4945-b482-02b478ac7ada None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:33.025874 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cac6f8-f0dc-4945-b482-02b478ac7ada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:33.027479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 403/801] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:33.028336 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32fdae-af8c-4c63-bb97-7238b29bc6bc None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:33.041028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cac6f8-f0dc-4945-b482-02b478ac7ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:33.043477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cac6f8-f0dc-4945-b482-02b478ac7ada None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:33.067141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-b7cac6f8-f0dc-4945-b482-02b478ac7ada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:33.067141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:33.067141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:33.067141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:33.067141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:33.067141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:33.067141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:33.067141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:33.067141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:33.067141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:33.067141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:33.067141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:33.067141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:33.067141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:33.067141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:33.068074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:33.068942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:33.068942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:33.068942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:33.068942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:33.068942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 399/802] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:33.079257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cac6f8-f0dc-4945-b482-02b478ac7ada None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:33.143286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32fdae-af8c-4c63-bb97-7238b29bc6bc None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:33.188156 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cac6f8-f0dc-4945-b482-02b478ac7ada None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:33.189270 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9044eb-3509-4bdf-8b76-e2659a0b14ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:33.190915 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9044eb-3509-4bdf-8b76-e2659a0b14ae None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:33.191217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9044eb-3509-4bdf-8b76-e2659a0b14ae None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:33.191502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9044eb-3509-4bdf-8b76-e2659a0b14ae None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:33.192299 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9044eb-3509-4bdf-8b76-e2659a0b14ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:33.192612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9044eb-3509-4bdf-8b76-e2659a0b14ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:33.194097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9044eb-3509-4bdf-8b76-e2659a0b14ae None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:33.210330 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 404/803] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:33.211169 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9044eb-3509-4bdf-8b76-e2659a0b14ae None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:33.233529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41d381-bbb1-477c-9755-5f6607e5c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:33.234212 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41d381-bbb1-477c-9755-5f6607e5c487 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:33.234492 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41d381-bbb1-477c-9755-5f6607e5c487 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:33.234762 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41d381-bbb1-477c-9755-5f6607e5c487 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:33.235481 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41d381-bbb1-477c-9755-5f6607e5c487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:33.235787 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41d381-bbb1-477c-9755-5f6607e5c487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:33.237139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41d381-bbb1-477c-9755-5f6607e5c487 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:33.249521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 400/804] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:33.250522 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41d381-bbb1-477c-9755-5f6607e5c487 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:33.348276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9044eb-3509-4bdf-8b76-e2659a0b14ae None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:33.357423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41d381-bbb1-477c-9755-5f6607e5c487 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:33.391655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f70de2-21e8-439f-bf8c-8d30262399ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:33.392610 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f70de2-21e8-439f-bf8c-8d30262399ea None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:33.392893 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f70de2-21e8-439f-bf8c-8d30262399ea None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:33.393168 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f70de2-21e8-439f-bf8c-8d30262399ea None admin] PATH_INFO: `/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/a90b5737f2c345b08460d291ccf49466/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:33.393722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c96d4-dd85-4f14-ad94-930649be32f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:33.394988 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c96d4-dd85-4f14-ad94-930649be32f8 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:33.395308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f70de2-21e8-439f-bf8c-8d30262399ea None admin] RBAC: Authorizing `identity:create_grant(project_id=bdd58b84c6394504beb84d13d13d60a1, user_id=a90b5737f2c345b08460d291ccf49466, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:33.395731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c96d4-dd85-4f14-ad94-930649be32f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:33.396221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c96d4-dd85-4f14-ad94-930649be32f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:33.396760 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f70de2-21e8-439f-bf8c-8d30262399ea None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:33.410845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c96d4-dd85-4f14-ad94-930649be32f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:33.422196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 401/805] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:29:33 2022] PUT /identity/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/a90b5737f2c345b08460d291ccf49466/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:29:33.422196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f70de2-21e8-439f-bf8c-8d30262399ea None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-9f6c96d4-dd85-4f14-ad94-930649be32f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:33.428544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:33.429502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:33.430507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:33.430507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:33.430507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:33.430507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:33.430507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:33.430507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:33.430507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:33.430507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:33.430507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:33.430507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:33.430507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:29:33.430507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:33.433402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 405/806] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:29:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:33.439023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c96d4-dd85-4f14-ad94-930649be32f8 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:33.544077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f70de2-21e8-439f-bf8c-8d30262399ea None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:33.584098 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efbeda-da5c-4b78-8bb2-a2566affc5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:33.585432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efbeda-da5c-4b78-8bb2-a2566affc5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:33.585717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efbeda-da5c-4b78-8bb2-a2566affc5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:33.587493 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efbeda-da5c-4b78-8bb2-a2566affc5f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:33.599792 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efbeda-da5c-4b78-8bb2-a2566affc5f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:33.601322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efbeda-da5c-4b78-8bb2-a2566affc5f9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:33.617118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-18efbeda-da5c-4b78-8bb2-a2566affc5f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:33.617118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:33.617118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:33.617118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:33.617118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:33.617118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:33.617118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:33.617118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:33.617118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:33.617118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:33.617118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:33.617118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:33.617118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:33.617118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:33.617118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:33.618873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:33.619763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:33.619763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:33.619763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:33.619763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:33.619763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:33.619763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:33.619763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:33.619763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:33.619763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 402/807] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:33.625525 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efbeda-da5c-4b78-8bb2-a2566affc5f9 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:33.654356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c96d4-dd85-4f14-ad94-930649be32f8 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:33.692145 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2981e-31d3-4bae-a887-7e057962d880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:33.692145 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2981e-31d3-4bae-a887-7e057962d880 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:33.692615 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2981e-31d3-4bae-a887-7e057962d880 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:33.692615 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2981e-31d3-4bae-a887-7e057962d880 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:33.693308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2981e-31d3-4bae-a887-7e057962d880 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:33.693612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2981e-31d3-4bae-a887-7e057962d880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:33.695048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2981e-31d3-4bae-a887-7e057962d880 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:33.705731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 406/808] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:29:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:33.710980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2981e-31d3-4bae-a887-7e057962d880 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:33.765908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efbeda-da5c-4b78-8bb2-a2566affc5f9 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:33.810104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c32cde-66d5-49eb-9a89-abf63bd6263b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:33.811966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c32cde-66d5-49eb-9a89-abf63bd6263b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:33.812713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c32cde-66d5-49eb-9a89-abf63bd6263b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:33.813151 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c32cde-66d5-49eb-9a89-abf63bd6263b None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:33.814277 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c32cde-66d5-49eb-9a89-abf63bd6263b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:33.815063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c32cde-66d5-49eb-9a89-abf63bd6263b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:33.817107 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c32cde-66d5-49eb-9a89-abf63bd6263b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:33.823408 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2981e-31d3-4bae-a887-7e057962d880 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:33.837410 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 403/809] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:33.839384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad413f-71d5-45db-8aee-25c1f7e98baa None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:33.839817 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad413f-71d5-45db-8aee-25c1f7e98baa None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:33.840244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad413f-71d5-45db-8aee-25c1f7e98baa None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:33.841870 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 404/810] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:33.846989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad413f-71d5-45db-8aee-25c1f7e98baa None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:33.865968 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d0f58-d8a9-4064-8ed0-d94073a60ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:33.866975 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d0f58-d8a9-4064-8ed0-d94073a60ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:33.867352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d0f58-d8a9-4064-8ed0-d94073a60ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:33.868289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d0f58-d8a9-4064-8ed0-d94073a60ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:33.879848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d0f58-d8a9-4064-8ed0-d94073a60ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:33.881569 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d0f58-d8a9-4064-8ed0-d94073a60ca7 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:33.902123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-8b4d0f58-d8a9-4064-8ed0-d94073a60ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:33.902123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:33.902123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:33.902123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:33.902123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:33.902123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:33.902123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:33.902123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:33.902123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:33.902123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:33.902123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:33.902123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:33.902123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:33.902123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:33.902123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:33.903284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:33.904294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:33.904294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:33.904294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:33.904294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:33.906096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 407/811] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:33.907609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dada0-f910-40d2-be0f-f129c3da8574 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:33.908055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dada0-f910-40d2-be0f-f129c3da8574 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:33.908477 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dada0-f910-40d2-be0f-f129c3da8574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:33.925753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-a95dada0-f910-40d2-be0f-f129c3da8574 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:33.927217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-a95dada0-f910-40d2-be0f-f129c3da8574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:33.974733 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad413f-71d5-45db-8aee-25c1f7e98baa None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:34.006396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 408/812] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:34.007542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dada0-f910-40d2-be0f-f129c3da8574 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:34.010618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e17c3-364a-487a-b204-98c8909cf39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:34.011791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e17c3-364a-487a-b204-98c8909cf39f None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:34.012251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e17c3-364a-487a-b204-98c8909cf39f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:34.012701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e17c3-364a-487a-b204-98c8909cf39f None admin] PATH_INFO: `/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/a44a128e68d94e34ac3463eb7f1d8f4f/roles/0b37e8a909204679b705bf258b1cd8f1` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:34.028278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e17c3-364a-487a-b204-98c8909cf39f None admin] RBAC: Authorizing `identity:create_grant(project_id=bdd58b84c6394504beb84d13d13d60a1, user_id=a44a128e68d94e34ac3463eb7f1d8f4f, role_id=0b37e8a909204679b705bf258b1cd8f1)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:34.030043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e17c3-364a-487a-b204-98c8909cf39f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:34.050639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 405/813] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:29:33 2022] PUT /identity/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/a44a128e68d94e34ac3463eb7f1d8f4f/roles/0b37e8a909204679b705bf258b1cd8f1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:29:34.051855 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e17c3-364a-487a-b204-98c8909cf39f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:34.135429 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dada0-f910-40d2-be0f-f129c3da8574 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:34.160485 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e17c3-364a-487a-b204-98c8909cf39f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:34.191056 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888624b-31a7-445c-9069-ae58e5412111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:34.193241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888624b-31a7-445c-9069-ae58e5412111 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:34.194034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888624b-31a7-445c-9069-ae58e5412111 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:34.196754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888624b-31a7-445c-9069-ae58e5412111 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:34.201735 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888624b-31a7-445c-9069-ae58e5412111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:34.202499 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888624b-31a7-445c-9069-ae58e5412111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:34.204121 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888624b-31a7-445c-9069-ae58e5412111 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:34.225261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 409/814] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:34.232680 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888624b-31a7-445c-9069-ae58e5412111 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:34.236417 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eaf5ae-c4a9-42a3-b9b3-d63c6d829010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:34.237611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaf5ae-c4a9-42a3-b9b3-d63c6d829010 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:34.238372 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaf5ae-c4a9-42a3-b9b3-d63c6d829010 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:34.239642 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaf5ae-c4a9-42a3-b9b3-d63c6d829010 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:34.240562 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eaf5ae-c4a9-42a3-b9b3-d63c6d829010 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:34.246115 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eaf5ae-c4a9-42a3-b9b3-d63c6d829010 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-c3eaf5ae-c4a9-42a3-b9b3-d63c6d829010 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:34.270403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:34.271402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:34.272268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:34.272268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:34.272268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:34.272268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:34.272268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:34.272268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:34.272268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:34.272268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:34.272268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:34.272268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:34.272268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:34.272268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:34.272268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:34.272268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 05 15:29:34.272268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:34.276910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 406/815] 10.222.0.58 () {56 vars in 1129 bytes} [Thu May 5 15:29:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:34.283583 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eaf5ae-c4a9-42a3-b9b3-d63c6d829010 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:34.387394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888624b-31a7-445c-9069-ae58e5412111 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:34.401120 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eaf5ae-c4a9-42a3-b9b3-d63c6d829010 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:34.423355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e8219-25c1-4262-9633-54050b9d0f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:34.424574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e8219-25c1-4262-9633-54050b9d0f73 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:34.425129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e8219-25c1-4262-9633-54050b9d0f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:34.425606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e8219-25c1-4262-9633-54050b9d0f73 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:34.434409 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e8219-25c1-4262-9633-54050b9d0f73 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:34.436152 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e8219-25c1-4262-9633-54050b9d0f73 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:34.444887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0c953-7b83-4d84-980b-ce3806a7b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:34.445558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0c953-7b83-4d84-980b-ce3806a7b0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:34.445929 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0c953-7b83-4d84-980b-ce3806a7b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:34.446193 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0c953-7b83-4d84-980b-ce3806a7b0d3 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:34.447007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0c953-7b83-4d84-980b-ce3806a7b0d3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:34.447315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0c953-7b83-4d84-980b-ce3806a7b0d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:34.448672 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0c953-7b83-4d84-980b-ce3806a7b0d3 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-a79e8219-25c1-4262-9633-54050b9d0f73 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:34.453081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:34.454047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:34.455030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:34.455030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:34.455030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:34.455030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:34.455030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:34.455030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:34.455030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:34.455030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:34.455030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:29:34.455030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:34.455660 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 407/816] 10.222.0.58 () {56 vars in 1124 bytes} [Thu May 5 15:29:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:34.457817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 410/817] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 5 15:29:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:34.459725 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0c953-7b83-4d84-980b-ce3806a7b0d3 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:34.463970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e8219-25c1-4262-9633-54050b9d0f73 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:34.613417 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e8219-25c1-4262-9633-54050b9d0f73 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:34.648920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7b90-389a-419c-ba4a-18f9d51dbdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:34.649651 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7b90-389a-419c-ba4a-18f9d51dbdbd None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:34.649987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7b90-389a-419c-ba4a-18f9d51dbdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:34.650296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7b90-389a-419c-ba4a-18f9d51dbdbd None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:34.651193 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c7b90-389a-419c-ba4a-18f9d51dbdbd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:34.651508 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c7b90-389a-419c-ba4a-18f9d51dbdbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:34.652937 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c7b90-389a-419c-ba4a-18f9d51dbdbd None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:34.666978 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0c953-7b83-4d84-980b-ce3806a7b0d3 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:34.671725 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 411/818] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 5 15:29:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:34.677265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7b90-389a-419c-ba4a-18f9d51dbdbd None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:34.730887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a6467-c7d9-45e1-8c14-7f07f58e5245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:34.731578 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a6467-c7d9-45e1-8c14-7f07f58e5245 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:34.731864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a6467-c7d9-45e1-8c14-7f07f58e5245 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:34.732145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a6467-c7d9-45e1-8c14-7f07f58e5245 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:34.732864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a6467-c7d9-45e1-8c14-7f07f58e5245 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:34.733172 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a6467-c7d9-45e1-8c14-7f07f58e5245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:34.734581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a6467-c7d9-45e1-8c14-7f07f58e5245 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:34.740133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 408/819] 10.222.0.58 () {56 vars in 1124 bytes} [Thu May 5 15:29:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:34.747492 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7551e2-91e8-4768-aeb3-47c697e19751 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:34.747784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7551e2-91e8-4768-aeb3-47c697e19751 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:34.748069 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7551e2-91e8-4768-aeb3-47c697e19751 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:34.749617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 409/820] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:29:34.754545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fea465-86f6-468d-92eb-cec8f35a20f4 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:34.754817 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fea465-86f6-468d-92eb-cec8f35a20f4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:34.755096 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fea465-86f6-468d-92eb-cec8f35a20f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:34.772262 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d3fea465-86f6-468d-92eb-cec8f35a20f4 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:34.773371 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d3fea465-86f6-468d-92eb-cec8f35a20f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:34.786639 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7b90-389a-419c-ba4a-18f9d51dbdbd None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:34.822747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c52ac-5381-4060-b7b0-4ef29d1b1aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:34.823448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c52ac-5381-4060-b7b0-4ef29d1b1aeb None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:34.823734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c52ac-5381-4060-b7b0-4ef29d1b1aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:34.824063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c52ac-5381-4060-b7b0-4ef29d1b1aeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:34.866277 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 410/821] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:29:34.869616 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fea465-86f6-468d-92eb-cec8f35a20f4 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:34.907005 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c52ac-5381-4060-b7b0-4ef29d1b1aeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:34.908481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c52ac-5381-4060-b7b0-4ef29d1b1aeb None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:35.012794 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fea465-86f6-468d-92eb-cec8f35a20f4 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:35.021668 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 412/822] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:29:35.022569 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c52ac-5381-4060-b7b0-4ef29d1b1aeb None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:35.057186 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7944684-5eca-4825-9c80-3849dda01a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:35.057853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7944684-5eca-4825-9c80-3849dda01a8c None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:35.058136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7944684-5eca-4825-9c80-3849dda01a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:35.058623 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7944684-5eca-4825-9c80-3849dda01a8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:35.060147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7944684-5eca-4825-9c80-3849dda01a8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:35.061526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7944684-5eca-4825-9c80-3849dda01a8c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:35.093109 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 411/823] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 5 15:29:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:29:35.094060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7944684-5eca-4825-9c80-3849dda01a8c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:35.156233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c52ac-5381-4060-b7b0-4ef29d1b1aeb None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:35.258595 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7944684-5eca-4825-9c80-3849dda01a8c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:35.261255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d8b13-39a6-495e-abab-9a6ef8a474af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:35.262391 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d8b13-39a6-495e-abab-9a6ef8a474af None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:35.262753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d8b13-39a6-495e-abab-9a6ef8a474af None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:35.263042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d8b13-39a6-495e-abab-9a6ef8a474af None admin] PATH_INFO: `/v3/services/network` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:35.263708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d8b13-39a6-495e-abab-9a6ef8a474af None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:35.265101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d8b13-39a6-495e-abab-9a6ef8a474af None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-ea8d8b13-39a6-495e-abab-9a6ef8a474af None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:35.303970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:35.307348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:35.309311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:35.309311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:35.309311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:35.309311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:35.309311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:35.309311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:35.309311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:35.309311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:35.309311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:35.309311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:35.309311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:35.309311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:35.309311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 05 15:29:35.309311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:35.309311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 413/824] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:35 2022] GET /identity/v3/services/network => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:35.315228 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d8b13-39a6-495e-abab-9a6ef8a474af None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:35.344489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d06b2-3c9b-41ce-927b-4df106273d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:35.345318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d06b2-3c9b-41ce-927b-4df106273d90 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:35.345594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d06b2-3c9b-41ce-927b-4df106273d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:35.345864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d06b2-3c9b-41ce-927b-4df106273d90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:35.361461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d06b2-3c9b-41ce-927b-4df106273d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:35.362945 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d06b2-3c9b-41ce-927b-4df106273d90 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:35.384919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-1c7d06b2-3c9b-41ce-927b-4df106273d90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:35.384919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:35.384919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:35.384919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:35.384919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:35.384919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:35.384919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:35.384919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:35.384919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:35.384919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:35.384919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:35.384919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:35.384919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:35.384919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:35.384919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:35.387164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:35.389308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:35.389308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:35.389308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:35.389308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:35.389308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 412/825] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:35.392536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d06b2-3c9b-41ce-927b-4df106273d90 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:35.442563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d8b13-39a6-495e-abab-9a6ef8a474af None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:35.490555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c349a03-c376-416a-b822-e153d3644895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:35.491627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c349a03-c376-416a-b822-e153d3644895 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:35.491920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c349a03-c376-416a-b822-e153d3644895 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:35.492568 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c349a03-c376-416a-b822-e153d3644895 None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:35.493583 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c349a03-c376-416a-b822-e153d3644895 None admin] RBAC: Adding query filter params (name=network) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:35.494099 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c349a03-c376-416a-b822-e153d3644895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:35.495794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c349a03-c376-416a-b822-e153d3644895 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:35.520287 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 414/826] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 5 15:29:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:35.521434 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c349a03-c376-416a-b822-e153d3644895 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:35.549350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d06b2-3c9b-41ce-927b-4df106273d90 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:35.622608 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88c819-4b96-40d6-a81f-2fb53c591468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:35.623288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88c819-4b96-40d6-a81f-2fb53c591468 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:35.623573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88c819-4b96-40d6-a81f-2fb53c591468 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:35.623853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88c819-4b96-40d6-a81f-2fb53c591468 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:35.624585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88c819-4b96-40d6-a81f-2fb53c591468 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:35.624892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88c819-4b96-40d6-a81f-2fb53c591468 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:35.631789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88c819-4b96-40d6-a81f-2fb53c591468 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:35.657126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 413/827] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:35.663161 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88c819-4b96-40d6-a81f-2fb53c591468 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:35.694884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c349a03-c376-416a-b822-e153d3644895 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:35.740371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f468e7-e66c-48c3-b07f-42a4bbf4bc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:35.741043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f468e7-e66c-48c3-b07f-42a4bbf4bc53 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:35.741319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f468e7-e66c-48c3-b07f-42a4bbf4bc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:35.741587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f468e7-e66c-48c3-b07f-42a4bbf4bc53 None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:35.742319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f468e7-e66c-48c3-b07f-42a4bbf4bc53 None admin] RBAC: Adding query filter params (type=network) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:35.742774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f468e7-e66c-48c3-b07f-42a4bbf4bc53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:35.744148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f468e7-e66c-48c3-b07f-42a4bbf4bc53 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:35.756511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 415/828] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 5 15:29:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:35.775169 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f468e7-e66c-48c3-b07f-42a4bbf4bc53 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:35.797902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88c819-4b96-40d6-a81f-2fb53c591468 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:35.843113 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e67e4-5ea4-4cc8-bae5-0031531cc3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:35.843918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e67e4-5ea4-4cc8-bae5-0031531cc3ef None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:35.844198 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e67e4-5ea4-4cc8-bae5-0031531cc3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:35.844471 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e67e4-5ea4-4cc8-bae5-0031531cc3ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:35.854707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e67e4-5ea4-4cc8-bae5-0031531cc3ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:35.856155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e67e4-5ea4-4cc8-bae5-0031531cc3ef None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:35.874068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-bf6e67e4-5ea4-4cc8-bae5-0031531cc3ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:35.874068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:35.874068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:35.874068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:35.874068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:35.874068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:35.874068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:35.874068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:35.874068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:35.874068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:35.874068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:35.874068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:35.874068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:35.874068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:35.874068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:35.875506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:35.876391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:35.876391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:35.876391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:35.876391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:35.876391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:35.876391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:35.876391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:35.876391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:35.885067 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 414/829] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:35.891159 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e67e4-5ea4-4cc8-bae5-0031531cc3ef None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:35.967571 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f468e7-e66c-48c3-b07f-42a4bbf4bc53 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:36.025087 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73f8e1-456b-4296-a859-9fdb58314046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:36.030659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73f8e1-456b-4296-a859-9fdb58314046 None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:36.031192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73f8e1-456b-4296-a859-9fdb58314046 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:36.031766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73f8e1-456b-4296-a859-9fdb58314046 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:36.032739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73f8e1-456b-4296-a859-9fdb58314046 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:36.034332 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73f8e1-456b-4296-a859-9fdb58314046 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:36.070880 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e67e4-5ea4-4cc8-bae5-0031531cc3ef None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:36.079575 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 416/830] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 5 15:29:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:29:36.127954 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9251d4-7211-4e3d-92e5-b2474bed0209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:36.128544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9251d4-7211-4e3d-92e5-b2474bed0209 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:36.128823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9251d4-7211-4e3d-92e5-b2474bed0209 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:36.129096 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9251d4-7211-4e3d-92e5-b2474bed0209 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:36.129877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9251d4-7211-4e3d-92e5-b2474bed0209 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:36.130192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9251d4-7211-4e3d-92e5-b2474bed0209 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:36.131628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9251d4-7211-4e3d-92e5-b2474bed0209 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:36.149580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 415/831] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:36.155914 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73f8e1-456b-4296-a859-9fdb58314046 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:36.167094 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93467f-98c8-4969-80bb-ace5fed20e70 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:36.167475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93467f-98c8-4969-80bb-ace5fed20e70 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:36.167674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93467f-98c8-4969-80bb-ace5fed20e70 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:36.171625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 416/832] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:36.175921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4717dfe-5bfd-414c-a0c3-c1bc8ba40434 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:36.176522 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4717dfe-5bfd-414c-a0c3-c1bc8ba40434 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:36.177004 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4717dfe-5bfd-414c-a0c3-c1bc8ba40434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:36.200467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b4717dfe-5bfd-414c-a0c3-c1bc8ba40434 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:36.202030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b4717dfe-5bfd-414c-a0c3-c1bc8ba40434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:36.310567 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 417/833] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:36.342668 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73f8e1-456b-4296-a859-9fdb58314046 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:36.349749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4717dfe-5bfd-414c-a0c3-c1bc8ba40434 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:36.384832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513a9ac-36e3-4764-ae56-b729f2dae704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:36.386130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513a9ac-36e3-4764-ae56-b729f2dae704 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:36.386684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513a9ac-36e3-4764-ae56-b729f2dae704 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:36.387902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513a9ac-36e3-4764-ae56-b729f2dae704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:36.388960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513a9ac-36e3-4764-ae56-b729f2dae704 None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=2a29a4b1b1aa45aea2e466d8f8b79365) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:36.389477 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513a9ac-36e3-4764-ae56-b729f2dae704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:36.391231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513a9ac-36e3-4764-ae56-b729f2dae704 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:36.400143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 417/834] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:36 2022] GET /identity/v3/role_assignments?user.id=2a29a4b1b1aa45aea2e466d8f8b79365&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=70f81a43849a47f7bf393b354a46d048 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:36.463436 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4717dfe-5bfd-414c-a0c3-c1bc8ba40434 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:36.511695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1eaa6-4a50-40e0-971b-2713664c5cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:36.512518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1eaa6-4a50-40e0-971b-2713664c5cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:36.512799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1eaa6-4a50-40e0-971b-2713664c5cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:36.513070 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1eaa6-4a50-40e0-971b-2713664c5cc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:36.525076 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1eaa6-4a50-40e0-971b-2713664c5cc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-edf1eaa6-4a50-40e0-971b-2713664c5cc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:36.534329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:36.535349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:36.536174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:36.536174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:36.536174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:36.536174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:36.536174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:36.536174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:36.536174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:36.536174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:36.536174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:36.536174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:36.536174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:29:36.536174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:36.537320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 418/835] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:29:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:36.542959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513a9ac-36e3-4764-ae56-b729f2dae704 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:36.654687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513a9ac-36e3-4764-ae56-b729f2dae704 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:36.692491 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358e65e-37dc-4213-8f79-981de9490caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:36.693169 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358e65e-37dc-4213-8f79-981de9490caa None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:36.693451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358e65e-37dc-4213-8f79-981de9490caa None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:36.693725 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358e65e-37dc-4213-8f79-981de9490caa None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:36.694500 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358e65e-37dc-4213-8f79-981de9490caa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:36.694809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358e65e-37dc-4213-8f79-981de9490caa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:36.696234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358e65e-37dc-4213-8f79-981de9490caa None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:36.705136 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 418/836] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:29:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:36.710457 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1eaa6-4a50-40e0-971b-2713664c5cc5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:36.810136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1eaa6-4a50-40e0-971b-2713664c5cc5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:36.842928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c558edb-d5a7-4d9f-bfe0-14143a52ffeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:36.843783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c558edb-d5a7-4d9f-bfe0-14143a52ffeb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:36.844060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c558edb-d5a7-4d9f-bfe0-14143a52ffeb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:36.844329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c558edb-d5a7-4d9f-bfe0-14143a52ffeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:36.855952 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c558edb-d5a7-4d9f-bfe0-14143a52ffeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:36.857389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c558edb-d5a7-4d9f-bfe0-14143a52ffeb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:36.861180 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605843-0d56-4c97-b374-6a3d16a912cc None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:36.861475 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605843-0d56-4c97-b374-6a3d16a912cc None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:36.861759 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605843-0d56-4c97-b374-6a3d16a912cc None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:36.863402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 419/837] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:29:36.868721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6244-f242-48bf-9951-65426c387d85 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:36.869011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6244-f242-48bf-9951-65426c387d85 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:36.869294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6244-f242-48bf-9951-65426c387d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:36.875266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9c558edb-d5a7-4d9f-bfe0-14143a52ffeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:36.875266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:36.875266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:36.875266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:36.875266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:36.875266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:36.875266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:36.875266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:36.875266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:36.875266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:36.875266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:36.875266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:36.875266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:36.875266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:36.875266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:36.876601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:36.877489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:36.877489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:36.877489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:36.877489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:36.877489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 419/838] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:36.883235 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c558edb-d5a7-4d9f-bfe0-14143a52ffeb None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:36.889635 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-339a6244-f242-48bf-9951-65426c387d85 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:36.890857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-339a6244-f242-48bf-9951-65426c387d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:36.964192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 420/839] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:29:36.988885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6244-f242-48bf-9951-65426c387d85 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:37.003794 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c558edb-d5a7-4d9f-bfe0-14143a52ffeb None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:37.038741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9320271-3652-4f5e-b1e1-d04545c57343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:37.039403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320271-3652-4f5e-b1e1-d04545c57343 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:37.039802 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320271-3652-4f5e-b1e1-d04545c57343 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:37.040232 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320271-3652-4f5e-b1e1-d04545c57343 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:37.041025 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9320271-3652-4f5e-b1e1-d04545c57343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:37.041404 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9320271-3652-4f5e-b1e1-d04545c57343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:37.043120 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9320271-3652-4f5e-b1e1-d04545c57343 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:37.059622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 420/840] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:37.060766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9320271-3652-4f5e-b1e1-d04545c57343 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:37.090363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6244-f242-48bf-9951-65426c387d85 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:37.127804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6e58d-149a-43d7-afcd-1803b40edaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:37.128885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6e58d-149a-43d7-afcd-1803b40edaab None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:37.129472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6e58d-149a-43d7-afcd-1803b40edaab None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:37.130707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6e58d-149a-43d7-afcd-1803b40edaab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:37.144308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6e58d-149a-43d7-afcd-1803b40edaab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-19a6e58d-149a-43d7-afcd-1803b40edaab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:37.154531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:37.155483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:37.156427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:37.156427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:37.156427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:37.156427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:37.156427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:37.156427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:37.156427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:37.156427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:37.156427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:37.156427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:37.156427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:29:37.156427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:37.159156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 421/841] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:29:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:37.165340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6e58d-149a-43d7-afcd-1803b40edaab None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:37.167922 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9320271-3652-4f5e-b1e1-d04545c57343 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:37.203231 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e40ad7-c42e-4b0f-9e24-020225b05051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:37.204126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e40ad7-c42e-4b0f-9e24-020225b05051 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:37.204507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e40ad7-c42e-4b0f-9e24-020225b05051 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:37.204854 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e40ad7-c42e-4b0f-9e24-020225b05051 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:37.212537 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e40ad7-c42e-4b0f-9e24-020225b05051 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:37.214083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e40ad7-c42e-4b0f-9e24-020225b05051 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-57e40ad7-c42e-4b0f-9e24-020225b05051 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:37.230585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:37.231520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:37.232470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:37.232470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:37.232470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:37.232470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:37.232470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:37.232470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:37.232470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:37.232470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:37.232470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 05 15:29:37.232470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:37.236682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 421/842] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:29:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:37.237624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e40ad7-c42e-4b0f-9e24-020225b05051 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:37.288935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6e58d-149a-43d7-afcd-1803b40edaab None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:37.324817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4448c0d-37e8-45cc-95fb-be480a6380d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:37.325489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4448c0d-37e8-45cc-95fb-be480a6380d8 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:37.325772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4448c0d-37e8-45cc-95fb-be480a6380d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:37.326049 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4448c0d-37e8-45cc-95fb-be480a6380d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:37.326843 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4448c0d-37e8-45cc-95fb-be480a6380d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:37.327243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4448c0d-37e8-45cc-95fb-be480a6380d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:37.328610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4448c0d-37e8-45cc-95fb-be480a6380d8 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:37.342304 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 422/843] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:29:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:37.343309 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4448c0d-37e8-45cc-95fb-be480a6380d8 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:37.350236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e40ad7-c42e-4b0f-9e24-020225b05051 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:37.393460 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42c136-d6ac-475c-87d1-c2d6c1f9831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:37.394672 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42c136-d6ac-475c-87d1-c2d6c1f9831c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:37.395540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42c136-d6ac-475c-87d1-c2d6c1f9831c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:37.396012 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42c136-d6ac-475c-87d1-c2d6c1f9831c None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:37.397053 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42c136-d6ac-475c-87d1-c2d6c1f9831c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:37.397552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42c136-d6ac-475c-87d1-c2d6c1f9831c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:37.400564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42c136-d6ac-475c-87d1-c2d6c1f9831c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:37.423264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 422/844] 10.222.0.58 () {56 vars in 1135 bytes} [Thu May 5 15:29:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:37.428828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42c136-d6ac-475c-87d1-c2d6c1f9831c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:37.452311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4448c0d-37e8-45cc-95fb-be480a6380d8 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:37.486359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439c004-6c3c-456a-a863-07591786cefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:37.487101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439c004-6c3c-456a-a863-07591786cefc None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:37.487389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439c004-6c3c-456a-a863-07591786cefc None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:37.487667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439c004-6c3c-456a-a863-07591786cefc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:37.500015 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439c004-6c3c-456a-a863-07591786cefc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:37.501589 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439c004-6c3c-456a-a863-07591786cefc None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:37.530279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-c439c004-6c3c-456a-a863-07591786cefc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:37.530279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:37.530279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:37.530279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:37.530279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:37.530279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:37.530279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:37.530279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:37.530279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:37.530279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:37.530279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:37.530279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:37.530279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:37.530279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:37.530279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:37.531226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:37.532104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:37.532104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:37.532104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:37.532104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:37.536169 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 423/845] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:37.537024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439c004-6c3c-456a-a863-07591786cefc None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:37.554484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42c136-d6ac-475c-87d1-c2d6c1f9831c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:37.596015 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c37f1-4e1f-4aeb-9a96-432c364b68be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:37.597098 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c37f1-4e1f-4aeb-9a96-432c364b68be None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:37.598392 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c37f1-4e1f-4aeb-9a96-432c364b68be None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:37.598944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c37f1-4e1f-4aeb-9a96-432c364b68be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:37.651057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439c004-6c3c-456a-a863-07591786cefc None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:37.684886 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b63c4-4b06-40e2-8283-b67b1acc1882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:37.685392 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b63c4-4b06-40e2-8283-b67b1acc1882 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:37.685680 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b63c4-4b06-40e2-8283-b67b1acc1882 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:37.685956 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b63c4-4b06-40e2-8283-b67b1acc1882 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:37.686746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b63c4-4b06-40e2-8283-b67b1acc1882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:37.687051 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b63c4-4b06-40e2-8283-b67b1acc1882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:37.688433 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b63c4-4b06-40e2-8283-b67b1acc1882 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:37.688714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c37f1-4e1f-4aeb-9a96-432c364b68be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:37.690556 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c37f1-4e1f-4aeb-9a96-432c364b68be None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:37.706622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 424/846] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:37.707616 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b63c4-4b06-40e2-8283-b67b1acc1882 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:37.810062 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b63c4-4b06-40e2-8283-b67b1acc1882 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:37.821766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 423/847] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:37 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:29:37.821766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250fed7-5a40-4503-8032-4755ccfdebd6 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:37.821766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250fed7-5a40-4503-8032-4755ccfdebd6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:37.821766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250fed7-5a40-4503-8032-4755ccfdebd6 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:37.821766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 424/848] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:37.822563 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250fed7-5a40-4503-8032-4755ccfdebd6 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:37.852497 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912af950-2d60-4622-b683-17bcaac87ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:37.853965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912af950-2d60-4622-b683-17bcaac87ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:37.854542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912af950-2d60-4622-b683-17bcaac87ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:37.855049 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912af950-2d60-4622-b683-17bcaac87ae8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:37.863007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912af950-2d60-4622-b683-17bcaac87ae8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:37.864432 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912af950-2d60-4622-b683-17bcaac87ae8 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-912af950-2d60-4622-b683-17bcaac87ae8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:37.879052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:37.880008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:37.880942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:37.880942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:37.880942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:37.880942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:37.880942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:37.880942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:37.880942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:37.880942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:37.880942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:29:37.880942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:37.880942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 425/849] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 5 15:29:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:37.881992 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722e90b-9e74-484b-bf4e-34fb775ce0b0 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:37.881992 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722e90b-9e74-484b-bf4e-34fb775ce0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:37.882263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722e90b-9e74-484b-bf4e-34fb775ce0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:37.898428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-9722e90b-9e74-484b-bf4e-34fb775ce0b0 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:37.900134 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9722e90b-9e74-484b-bf4e-34fb775ce0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:37.929033 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250fed7-5a40-4503-8032-4755ccfdebd6 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:37.962442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e11b84-8a08-4843-9edb-b8e67bfad743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:37.963242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e11b84-8a08-4843-9edb-b8e67bfad743 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:37.963518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e11b84-8a08-4843-9edb-b8e67bfad743 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:37.963788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e11b84-8a08-4843-9edb-b8e67bfad743 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:37.964857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 426/850] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:37.970722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722e90b-9e74-484b-bf4e-34fb775ce0b0 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:37.975933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e11b84-8a08-4843-9edb-b8e67bfad743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:37.982196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e11b84-8a08-4843-9edb-b8e67bfad743 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:37.998768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-e4e11b84-8a08-4843-9edb-b8e67bfad743 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:37.998768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:37.998768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:37.998768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:37.998768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:37.998768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:37.998768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:37.998768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:37.998768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:37.998768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:37.998768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:37.998768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:37.998768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:37.998768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:37.998768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:37.999677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:38.000553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:38.000553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:38.000553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:38.000553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:38.000553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 425/851] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:38.000824 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e11b84-8a08-4843-9edb-b8e67bfad743 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:38.088416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722e90b-9e74-484b-bf4e-34fb775ce0b0 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:38.101414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e11b84-8a08-4843-9edb-b8e67bfad743 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:38.121958 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02eeecf-7aa2-4fa1-881d-6a59a81de4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:38.122684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02eeecf-7aa2-4fa1-881d-6a59a81de4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:38.122971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02eeecf-7aa2-4fa1-881d-6a59a81de4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:38.123243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02eeecf-7aa2-4fa1-881d-6a59a81de4b9 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:38.124067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02eeecf-7aa2-4fa1-881d-6a59a81de4b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:38.124371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02eeecf-7aa2-4fa1-881d-6a59a81de4b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:38.125787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02eeecf-7aa2-4fa1-881d-6a59a81de4b9 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:38.137605 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef2be8-ba4f-4110-99aa-7fd6920a16ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:38.138798 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef2be8-ba4f-4110-99aa-7fd6920a16ba None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:38.139267 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef2be8-ba4f-4110-99aa-7fd6920a16ba None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:38.140149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef2be8-ba4f-4110-99aa-7fd6920a16ba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:38.141240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef2be8-ba4f-4110-99aa-7fd6920a16ba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:38.142800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef2be8-ba4f-4110-99aa-7fd6920a16ba None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:38.142926 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 427/852] 10.222.0.58 () {56 vars in 1149 bytes} [Thu May 5 15:29:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:38.143691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02eeecf-7aa2-4fa1-881d-6a59a81de4b9 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-e6ef2be8-ba4f-4110-99aa-7fd6920a16ba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:38.159714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:38.160962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:38.161789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:38.161789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:38.161789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:38.161789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:38.161789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:38.161789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:38.161789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:38.161789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:38.161789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:38.161789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:38.161789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:38.161789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:38.161789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:29:38.161789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:38.161789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 426/853] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:29:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:38.163072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef2be8-ba4f-4110-99aa-7fd6920a16ba None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:38.250667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02eeecf-7aa2-4fa1-881d-6a59a81de4b9 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:38.279925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef2be8-ba4f-4110-99aa-7fd6920a16ba None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:38.285123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f73225-5fa3-4943-adf5-1b0cf600f193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:38.285880 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f73225-5fa3-4943-adf5-1b0cf600f193 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:38.286076 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f73225-5fa3-4943-adf5-1b0cf600f193 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:38.286379 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f73225-5fa3-4943-adf5-1b0cf600f193 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:38.287091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f73225-5fa3-4943-adf5-1b0cf600f193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:38.287396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f73225-5fa3-4943-adf5-1b0cf600f193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:38.288764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f73225-5fa3-4943-adf5-1b0cf600f193 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:38.309182 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 428/854] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:38.309182 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f73225-5fa3-4943-adf5-1b0cf600f193 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:38.318953 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652034b-ed68-4e6f-aa33-a66ef4340f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:38.319629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652034b-ed68-4e6f-aa33-a66ef4340f39 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:38.319911 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652034b-ed68-4e6f-aa33-a66ef4340f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:38.320187 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652034b-ed68-4e6f-aa33-a66ef4340f39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:38.389553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652034b-ed68-4e6f-aa33-a66ef4340f39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:38.391619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652034b-ed68-4e6f-aa33-a66ef4340f39 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:38.408111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f73225-5fa3-4943-adf5-1b0cf600f193 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:38.447257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b931c-311b-4344-b114-e98213f0ece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:38.448006 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b931c-311b-4344-b114-e98213f0ece0 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:38.448481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b931c-311b-4344-b114-e98213f0ece0 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:38.449108 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b931c-311b-4344-b114-e98213f0ece0 None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:38.450142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b931c-311b-4344-b114-e98213f0ece0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:38.450528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b931c-311b-4344-b114-e98213f0ece0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:38.452566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b931c-311b-4344-b114-e98213f0ece0 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:38.457226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 429/855] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:29:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:38.458024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b931c-311b-4344-b114-e98213f0ece0 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:38.495600 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 427/856] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:38 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:29:38.496450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652034b-ed68-4e6f-aa33-a66ef4340f39 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:38.568106 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b931c-311b-4344-b114-e98213f0ece0 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:38.598925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652034b-ed68-4e6f-aa33-a66ef4340f39 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:38.600737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52840b36-95b1-4087-a173-794f0dcb1f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:38.602124 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52840b36-95b1-4087-a173-794f0dcb1f2d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:38.602415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52840b36-95b1-4087-a173-794f0dcb1f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:38.602779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52840b36-95b1-4087-a173-794f0dcb1f2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:38.609445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52840b36-95b1-4087-a173-794f0dcb1f2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:38.611031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52840b36-95b1-4087-a173-794f0dcb1f2d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:38.624866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-52840b36-95b1-4087-a173-794f0dcb1f2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:38.624866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:38.624866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:38.624866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:38.624866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:38.624866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:38.624866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:38.624866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:38.624866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:38.624866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:38.624866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:38.624866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:38.624866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:38.624866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:38.624866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:38.625734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:38.626971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:38.626971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:38.626971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:38.626971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:38.626971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:38.626971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:38.626971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:38.626971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:38.626971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 430/857] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:38.626971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52840b36-95b1-4087-a173-794f0dcb1f2d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:38.638507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04303-e567-4fa6-be0c-381ffc25346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:38.639328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04303-e567-4fa6-be0c-381ffc25346d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:38.639671 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04303-e567-4fa6-be0c-381ffc25346d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:38.639900 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04303-e567-4fa6-be0c-381ffc25346d None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:38.640616 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee04303-e567-4fa6-be0c-381ffc25346d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:38.640926 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee04303-e567-4fa6-be0c-381ffc25346d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:38.642375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee04303-e567-4fa6-be0c-381ffc25346d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:38.658579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 428/858] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:29:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:38.658579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04303-e567-4fa6-be0c-381ffc25346d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:38.750243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52840b36-95b1-4087-a173-794f0dcb1f2d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:38.788719 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5f87f-a188-499d-a531-ffd2c1a1ad0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:38.790062 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5f87f-a188-499d-a531-ffd2c1a1ad0c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:38.790389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5f87f-a188-499d-a531-ffd2c1a1ad0c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:38.790676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5f87f-a188-499d-a531-ffd2c1a1ad0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:38.796289 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04303-e567-4fa6-be0c-381ffc25346d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:38.801657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5f87f-a188-499d-a531-ffd2c1a1ad0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:38.803274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5f87f-a188-499d-a531-ffd2c1a1ad0c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:38.825527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-f3e5f87f-a188-499d-a531-ffd2c1a1ad0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:38.825527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:38.825527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:38.825527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:38.825527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:38.825527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:38.825527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:38.825527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:38.825527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:38.825527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:38.825527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:38.825527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:38.825527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:38.825527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:38.825527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:38.826687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:38.827780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:38.827780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:38.827780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:38.827780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:38.827780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 431/859] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:38.833999 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5f87f-a188-499d-a531-ffd2c1a1ad0c None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:38.849476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99277d35-d49b-4722-b118-bc9fb1d71997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:38.850361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99277d35-d49b-4722-b118-bc9fb1d71997 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:38.850743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99277d35-d49b-4722-b118-bc9fb1d71997 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:38.851114 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99277d35-d49b-4722-b118-bc9fb1d71997 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:38.852076 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99277d35-d49b-4722-b118-bc9fb1d71997 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:38.852573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99277d35-d49b-4722-b118-bc9fb1d71997 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:38.854010 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99277d35-d49b-4722-b118-bc9fb1d71997 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:38.865865 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 429/860] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:38.871827 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a4b53-3365-45b1-9861-70717da2065d None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:38.872261 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a4b53-3365-45b1-9861-70717da2065d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:38.872638 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a4b53-3365-45b1-9861-70717da2065d None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:38.874989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 430/861] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:38.876569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a4b53-3365-45b1-9861-70717da2065d None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:38.937255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5f87f-a188-499d-a531-ffd2c1a1ad0c None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:38.969681 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cad40-d75a-4a64-8dfb-46d93c171ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:38.970369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cad40-d75a-4a64-8dfb-46d93c171ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:38.970653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cad40-d75a-4a64-8dfb-46d93c171ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:38.970922 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cad40-d75a-4a64-8dfb-46d93c171ec9 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:38.971634 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cad40-d75a-4a64-8dfb-46d93c171ec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:38.971934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cad40-d75a-4a64-8dfb-46d93c171ec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:38.973528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cad40-d75a-4a64-8dfb-46d93c171ec9 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:38.980513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a4b53-3365-45b1-9861-70717da2065d None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:38.985404 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 432/862] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:38.987055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884f962-cd3f-453f-bdb9-d687d6d1c3c5 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:38.987485 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884f962-cd3f-453f-bdb9-d687d6d1c3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:38.987762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884f962-cd3f-453f-bdb9-d687d6d1c3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:39.004607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-a884f962-cd3f-453f-bdb9-d687d6d1c3c5 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:39.005765 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-a884f962-cd3f-453f-bdb9-d687d6d1c3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:39.017168 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f021a-0a5c-454a-8d91-483329e15f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:39.017818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f021a-0a5c-454a-8d91-483329e15f28 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:39.018096 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f021a-0a5c-454a-8d91-483329e15f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:39.018399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f021a-0a5c-454a-8d91-483329e15f28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:39.019271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f021a-0a5c-454a-8d91-483329e15f28 None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=a90b5737f2c345b08460d291ccf49466) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:39.019582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f021a-0a5c-454a-8d91-483329e15f28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:39.021035 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f021a-0a5c-454a-8d91-483329e15f28 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:39.038196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 431/863] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:38 2022] GET /identity/v3/role_assignments?user.id=a90b5737f2c345b08460d291ccf49466&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=70f81a43849a47f7bf393b354a46d048 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:39.038196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f021a-0a5c-454a-8d91-483329e15f28 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:39.110600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 433/864] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:39.126433 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884f962-cd3f-453f-bdb9-d687d6d1c3c5 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:39.152042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f021a-0a5c-454a-8d91-483329e15f28 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:39.192841 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097422b-92e2-4500-bb7f-6d98d00c9b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:39.193729 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097422b-92e2-4500-bb7f-6d98d00c9b25 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:39.194074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097422b-92e2-4500-bb7f-6d98d00c9b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:39.194438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097422b-92e2-4500-bb7f-6d98d00c9b25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:39.202712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097422b-92e2-4500-bb7f-6d98d00c9b25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:39.204326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097422b-92e2-4500-bb7f-6d98d00c9b25 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:39.219354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-6097422b-92e2-4500-bb7f-6d98d00c9b25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:39.219354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:39.219354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:39.219354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:39.219354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:39.219354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:39.219354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:39.219354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:39.219354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:39.219354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:39.219354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:39.219354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:39.219354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:39.219354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:39.219354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:39.220304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:39.221353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:39.221353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:39.221353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:39.221353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:39.221353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:39.221353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:39.221353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:39.221353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:39.226192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 432/865] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:39.228656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097422b-92e2-4500-bb7f-6d98d00c9b25 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:39.240013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884f962-cd3f-453f-bdb9-d687d6d1c3c5 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:39.276522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb46074-3324-40ee-97a9-0cbdd5b1d76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:39.277333 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb46074-3324-40ee-97a9-0cbdd5b1d76e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:39.277608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb46074-3324-40ee-97a9-0cbdd5b1d76e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:39.277875 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb46074-3324-40ee-97a9-0cbdd5b1d76e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:39.278567 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb46074-3324-40ee-97a9-0cbdd5b1d76e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:39.279911 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb46074-3324-40ee-97a9-0cbdd5b1d76e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-5cb46074-3324-40ee-97a9-0cbdd5b1d76e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:39.293898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:39.294936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:39.296002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 434/866] 10.222.0.58 () {56 vars in 1132 bytes} [Thu May 5 15:29:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:39.302024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb46074-3324-40ee-97a9-0cbdd5b1d76e None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:39.337309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097422b-92e2-4500-bb7f-6d98d00c9b25 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:39.372471 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf63dbe-a1ea-4c32-94bb-4bf85c1ab3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:39.373493 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf63dbe-a1ea-4c32-94bb-4bf85c1ab3eb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:39.373991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf63dbe-a1ea-4c32-94bb-4bf85c1ab3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:39.374489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf63dbe-a1ea-4c32-94bb-4bf85c1ab3eb None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:39.375474 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf63dbe-a1ea-4c32-94bb-4bf85c1ab3eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:39.375999 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf63dbe-a1ea-4c32-94bb-4bf85c1ab3eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:39.377618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf63dbe-a1ea-4c32-94bb-4bf85c1ab3eb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:39.391325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 433/867] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:39.396741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf63dbe-a1ea-4c32-94bb-4bf85c1ab3eb None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:39.429473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb46074-3324-40ee-97a9-0cbdd5b1d76e None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:39.464061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53660a26-2eeb-4403-a6cc-ae77b5bc413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:39.464653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53660a26-2eeb-4403-a6cc-ae77b5bc413d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:39.464935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53660a26-2eeb-4403-a6cc-ae77b5bc413d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:39.465207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53660a26-2eeb-4403-a6cc-ae77b5bc413d None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:39.465909 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53660a26-2eeb-4403-a6cc-ae77b5bc413d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:39.466249 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53660a26-2eeb-4403-a6cc-ae77b5bc413d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:39.467821 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53660a26-2eeb-4403-a6cc-ae77b5bc413d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:39.477521 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 435/868] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 5 15:29:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:39.478649 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53660a26-2eeb-4403-a6cc-ae77b5bc413d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:39.527414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf63dbe-a1ea-4c32-94bb-4bf85c1ab3eb None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:39.571367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7be04e-a9b6-49a4-acca-c28b598f3867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:39.572439 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7be04e-a9b6-49a4-acca-c28b598f3867 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:39.573266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7be04e-a9b6-49a4-acca-c28b598f3867 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:39.573749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7be04e-a9b6-49a4-acca-c28b598f3867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:39.575077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7be04e-a9b6-49a4-acca-c28b598f3867 None admin] RBAC: Adding query filter params (role.id=0b37e8a909204679b705bf258b1cd8f1, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=a44a128e68d94e34ac3463eb7f1d8f4f) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:39.575397 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7be04e-a9b6-49a4-acca-c28b598f3867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:39.576947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7be04e-a9b6-49a4-acca-c28b598f3867 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:39.590755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 434/869] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:39 2022] GET /identity/v3/role_assignments?user.id=a44a128e68d94e34ac3463eb7f1d8f4f&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=0b37e8a909204679b705bf258b1cd8f1 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:39.600374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53660a26-2eeb-4403-a6cc-ae77b5bc413d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:39.639031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098af9ab-fcc5-482b-8145-8f6288dc3e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:39.640104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098af9ab-fcc5-482b-8145-8f6288dc3e5e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:39.640616 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098af9ab-fcc5-482b-8145-8f6288dc3e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:39.641190 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098af9ab-fcc5-482b-8145-8f6288dc3e5e None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:39.642129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098af9ab-fcc5-482b-8145-8f6288dc3e5e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:39.642799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098af9ab-fcc5-482b-8145-8f6288dc3e5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:39.644418 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098af9ab-fcc5-482b-8145-8f6288dc3e5e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:39.650989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 436/870] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 5 15:29:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:40.974146 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a710fa8-40cd-444c-923a-18e1ba23a86b None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:40.974726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a710fa8-40cd-444c-923a-18e1ba23a86b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:40.974726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a710fa8-40cd-444c-923a-18e1ba23a86b None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:40.976390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 435/871] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:40.981764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc875f-1f5e-4d2d-8813-699d90ba45ca None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:40.982160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc875f-1f5e-4d2d-8813-699d90ba45ca None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:40.982482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc875f-1f5e-4d2d-8813-699d90ba45ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:40.999536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-42dc875f-1f5e-4d2d-8813-699d90ba45ca None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:41.000709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-42dc875f-1f5e-4d2d-8813-699d90ba45ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:41.068621 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 437/872] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:41.091205 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a710fa8-40cd-444c-923a-18e1ba23a86b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:41.194188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a710fa8-40cd-444c-923a-18e1ba23a86b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:41.229778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd9294-30b0-4666-8023-f910a6f755d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:41.230419 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd9294-30b0-4666-8023-f910a6f755d8 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:41.230702 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd9294-30b0-4666-8023-f910a6f755d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:41.230973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd9294-30b0-4666-8023-f910a6f755d8 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:41.231717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd9294-30b0-4666-8023-f910a6f755d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:41.233113 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd9294-30b0-4666-8023-f910a6f755d8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:41.250919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 436/873] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 5 15:29:41 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:29:41.463186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caa528-e5c6-4f1d-bb37-9c2f78c33af9 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:41.463879 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caa528-e5c6-4f1d-bb37-9c2f78c33af9 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:41.464364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caa528-e5c6-4f1d-bb37-9c2f78c33af9 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:41.465917 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 438/874] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:41.471461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3753df4-8392-43f3-8ad7-8768380687c1 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:41.472009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3753df4-8392-43f3-8ad7-8768380687c1 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:41.472735 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3753df4-8392-43f3-8ad7-8768380687c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:41.490487 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a3753df4-8392-43f3-8ad7-8768380687c1 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:41.492000 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a3753df4-8392-43f3-8ad7-8768380687c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:41.576218 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 437/875] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:41 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:41.598061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caa528-e5c6-4f1d-bb37-9c2f78c33af9 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:41.700817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caa528-e5c6-4f1d-bb37-9c2f78c33af9 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:41.736114 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222e954-6ab2-49d2-9dd2-5243637d9976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:41.737315 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222e954-6ab2-49d2-9dd2-5243637d9976 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:41.737822 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222e954-6ab2-49d2-9dd2-5243637d9976 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:41.738333 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222e954-6ab2-49d2-9dd2-5243637d9976 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:41.739225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222e954-6ab2-49d2-9dd2-5243637d9976 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:41.740943 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222e954-6ab2-49d2-9dd2-5243637d9976 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-4222e954-6ab2-49d2-9dd2-5243637d9976 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:41.754536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:41.755588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:41.756407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:41.756407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:41.756407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:41.756407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:41.756407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:41.756407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:41.756407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:41.756407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:41.756407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:41.756407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:41.756407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:41.756407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:41.756407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:29:41.756407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:41.760005 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 439/876] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 5 15:29:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:41.770204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3753df4-8392-43f3-8ad7-8768380687c1 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:41.867827 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3753df4-8392-43f3-8ad7-8768380687c1 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:41.904765 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7e8eb-f0b5-41ef-9a44-f8b0a6f34a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:41.905439 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7e8eb-f0b5-41ef-9a44-f8b0a6f34a52 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:41.905718 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7e8eb-f0b5-41ef-9a44-f8b0a6f34a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:41.905991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7e8eb-f0b5-41ef-9a44-f8b0a6f34a52 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:41.906733 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7e8eb-f0b5-41ef-9a44-f8b0a6f34a52 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:41.907039 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7e8eb-f0b5-41ef-9a44-f8b0a6f34a52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:41.908395 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7e8eb-f0b5-41ef-9a44-f8b0a6f34a52 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:41.913414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 438/877] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 5 15:29:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:41.919154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222e954-6ab2-49d2-9dd2-5243637d9976 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:41.937636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98800858-0a64-4ae8-8e5c-62dc9dbc5ec3 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:41.937934 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98800858-0a64-4ae8-8e5c-62dc9dbc5ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:41.938222 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98800858-0a64-4ae8-8e5c-62dc9dbc5ec3 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:41.940736 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 439/878] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:29:41.944584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d2dec-ebd3-4a1a-b16c-263a4f450402 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:41.944870 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d2dec-ebd3-4a1a-b16c-263a4f450402 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:41.945227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d2dec-ebd3-4a1a-b16c-263a4f450402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:41.963085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-aa1d2dec-ebd3-4a1a-b16c-263a4f450402 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:41.964559 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-aa1d2dec-ebd3-4a1a-b16c-263a4f450402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:42.024344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222e954-6ab2-49d2-9dd2-5243637d9976 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:42.032883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 440/879] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:41 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:29:42.055767 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d2dec-ebd3-4a1a-b16c-263a4f450402 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:42.062010 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b670c4c-0f1b-4ce5-b70a-73d70e1fa5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:42.062940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b670c4c-0f1b-4ce5-b70a-73d70e1fa5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:42.063416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b670c4c-0f1b-4ce5-b70a-73d70e1fa5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:42.063920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b670c4c-0f1b-4ce5-b70a-73d70e1fa5f8 None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:42.064810 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b670c4c-0f1b-4ce5-b70a-73d70e1fa5f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:42.065316 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b670c4c-0f1b-4ce5-b70a-73d70e1fa5f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:42.066942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b670c4c-0f1b-4ce5-b70a-73d70e1fa5f8 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:42.072023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 440/880] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 5 15:29:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:42.087839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678bb56-3ede-4ce4-8762-47504c9dd7d5 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:42.088487 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678bb56-3ede-4ce4-8762-47504c9dd7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:42.088960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678bb56-3ede-4ce4-8762-47504c9dd7d5 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:42.092235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 441/881] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:42.097145 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9396f-d89d-422f-9e62-ac63122dd093 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:42.098003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9396f-d89d-422f-9e62-ac63122dd093 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:42.098549 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9396f-d89d-422f-9e62-ac63122dd093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:42.121212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-9ec9396f-d89d-422f-9e62-ac63122dd093 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:42.123322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9ec9396f-d89d-422f-9e62-ac63122dd093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:42.180477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d2dec-ebd3-4a1a-b16c-263a4f450402 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:42.210811 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 442/882] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:42 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:29:42.226796 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb194df-8ffd-40af-b348-c4960d1b2a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:42.227727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb194df-8ffd-40af-b348-c4960d1b2a5f None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:42.228005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb194df-8ffd-40af-b348-c4960d1b2a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:42.228277 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb194df-8ffd-40af-b348-c4960d1b2a5f None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:42.229077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb194df-8ffd-40af-b348-c4960d1b2a5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:42.230597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb194df-8ffd-40af-b348-c4960d1b2a5f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:42.232130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9396f-d89d-422f-9e62-ac63122dd093 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:42.262445 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 441/883] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 5 15:29:42 2022] POST /identity/v3/services => generated 269 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:29:42.366062 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9396f-d89d-422f-9e62-ac63122dd093 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:42.409983 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e9994-85fa-4722-8ec6-01862dbfc374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:42.410875 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e9994-85fa-4722-8ec6-01862dbfc374 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:42.411160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e9994-85fa-4722-8ec6-01862dbfc374 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:42.411437 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e9994-85fa-4722-8ec6-01862dbfc374 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:42.423801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e9994-85fa-4722-8ec6-01862dbfc374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-9d0e9994-85fa-4722-8ec6-01862dbfc374 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:42.432396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:42.433398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:42.434700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:42.434700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:42.434700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:42.434700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:42.434700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:42.434700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:42.434700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:42.434700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:42.434700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:42.434700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:42.434700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:29:42.434700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:42.434700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 443/884] 10.222.0.58 () {56 vars in 1120 bytes} [Thu May 5 15:29:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:42.441683 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb194df-8ffd-40af-b348-c4960d1b2a5f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:42.556912 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb194df-8ffd-40af-b348-c4960d1b2a5f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:42.591214 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb7a84-fe1c-4628-a7f0-2b5e0227a8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:42.592239 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb7a84-fe1c-4628-a7f0-2b5e0227a8dd None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:42.592714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb7a84-fe1c-4628-a7f0-2b5e0227a8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:42.593203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb7a84-fe1c-4628-a7f0-2b5e0227a8dd None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:42.594148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb7a84-fe1c-4628-a7f0-2b5e0227a8dd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:42.594672 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb7a84-fe1c-4628-a7f0-2b5e0227a8dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:42.596206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb7a84-fe1c-4628-a7f0-2b5e0227a8dd None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:42.605064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 442/885] 10.222.0.58 () {56 vars in 1115 bytes} [Thu May 5 15:29:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:42.610586 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e9994-85fa-4722-8ec6-01862dbfc374 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:42.710226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e9994-85fa-4722-8ec6-01862dbfc374 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:42.744159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ed1a5-0f08-4bbc-9e3d-c3bd77c4ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:42.744945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ed1a5-0f08-4bbc-9e3d-c3bd77c4ab69 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:42.745225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ed1a5-0f08-4bbc-9e3d-c3bd77c4ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:42.745494 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ed1a5-0f08-4bbc-9e3d-c3bd77c4ab69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:42.756080 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ed1a5-0f08-4bbc-9e3d-c3bd77c4ab69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:42.757527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ed1a5-0f08-4bbc-9e3d-c3bd77c4ab69 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:42.775557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-2f9ed1a5-0f08-4bbc-9e3d-c3bd77c4ab69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:42.775557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:42.775557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:42.775557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:42.775557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:42.775557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:42.775557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:42.775557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:42.775557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:42.775557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:42.775557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:42.775557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:42.775557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:42.775557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:42.775557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:42.776448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:42.777326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:42.777326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:42.777326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:42.777326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:42.777326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 444/886] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:42.782530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb7a84-fe1c-4628-a7f0-2b5e0227a8dd None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:42.882807 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb7a84-fe1c-4628-a7f0-2b5e0227a8dd None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:42.916367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece1dc6-8244-4fed-8408-3ae27e1f3f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:42.917040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece1dc6-8244-4fed-8408-3ae27e1f3f7e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:42.917320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece1dc6-8244-4fed-8408-3ae27e1f3f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:42.917593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece1dc6-8244-4fed-8408-3ae27e1f3f7e None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:42.918344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece1dc6-8244-4fed-8408-3ae27e1f3f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:42.918650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece1dc6-8244-4fed-8408-3ae27e1f3f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:42.920007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece1dc6-8244-4fed-8408-3ae27e1f3f7e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:42.932244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 443/887] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:42.937712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ed1a5-0f08-4bbc-9e3d-c3bd77c4ab69 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:43.040210 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ed1a5-0f08-4bbc-9e3d-c3bd77c4ab69 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:43.074351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa34578-9a93-43de-a954-7d63b82b37c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:43.075171 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa34578-9a93-43de-a954-7d63b82b37c4 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:43.075453 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa34578-9a93-43de-a954-7d63b82b37c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:43.075735 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa34578-9a93-43de-a954-7d63b82b37c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:43.083509 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa34578-9a93-43de-a954-7d63b82b37c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:43.084962 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa34578-9a93-43de-a954-7d63b82b37c4 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-2aa34578-9a93-43de-a954-7d63b82b37c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:43.100246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:43.102951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:43.105174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:43.105174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:43.105174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:43.105174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:43.105174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:43.105174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:43.105174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:43.105174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:43.105174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:29:43.105174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:43.105174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 445/888] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 5 15:29:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:43.110227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece1dc6-8244-4fed-8408-3ae27e1f3f7e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:43.213661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece1dc6-8244-4fed-8408-3ae27e1f3f7e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:43.250321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c86b9-f8bd-4155-8785-389d85ec3057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:43.251368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c86b9-f8bd-4155-8785-389d85ec3057 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:43.251841 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c86b9-f8bd-4155-8785-389d85ec3057 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:43.252320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c86b9-f8bd-4155-8785-389d85ec3057 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:43.253336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c86b9-f8bd-4155-8785-389d85ec3057 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:43.253834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c86b9-f8bd-4155-8785-389d85ec3057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:43.255480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c86b9-f8bd-4155-8785-389d85ec3057 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:43.273563 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 444/889] 10.222.0.58 () {56 vars in 1149 bytes} [Thu May 5 15:29:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:43.283246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa34578-9a93-43de-a954-7d63b82b37c4 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:43.393961 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa34578-9a93-43de-a954-7d63b82b37c4 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:43.427304 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52416ec8-87c8-4161-9979-d659823b722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:43.427943 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52416ec8-87c8-4161-9979-d659823b722e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:43.428220 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52416ec8-87c8-4161-9979-d659823b722e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:43.428490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52416ec8-87c8-4161-9979-d659823b722e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:43.501046 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52416ec8-87c8-4161-9979-d659823b722e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:43.502548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52416ec8-87c8-4161-9979-d659823b722e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:43.603580 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 446/890] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:43 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:29:43.609339 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c86b9-f8bd-4155-8785-389d85ec3057 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:43.681070 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c231a39-d05c-4c98-8a30-bf8164d9e826 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:43.681251 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c231a39-d05c-4c98-8a30-bf8164d9e826 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:43.681595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c231a39-d05c-4c98-8a30-bf8164d9e826 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:43.683977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 447/891] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:29:43.690204 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921a762-579f-4e13-b7d7-f243a5eb8acc None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:43.690204 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921a762-579f-4e13-b7d7-f243a5eb8acc None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:43.690204 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921a762-579f-4e13-b7d7-f243a5eb8acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:43.706808 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-0921a762-579f-4e13-b7d7-f243a5eb8acc None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:43.708544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-0921a762-579f-4e13-b7d7-f243a5eb8acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:43.717329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c86b9-f8bd-4155-8785-389d85ec3057 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:43.759400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57544bc7-65c0-4782-945c-317c272093f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:43.760612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57544bc7-65c0-4782-945c-317c272093f2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:43.761555 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57544bc7-65c0-4782-945c-317c272093f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:43.762044 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57544bc7-65c0-4782-945c-317c272093f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:43.775273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57544bc7-65c0-4782-945c-317c272093f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:43.777437 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57544bc7-65c0-4782-945c-317c272093f2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:43.798551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 448/892] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:43.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-57544bc7-65c0-4782-945c-317c272093f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:43.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:43.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:43.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:43.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:43.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:43.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:43.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:43.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:43.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:43.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:43.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:43.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:43.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:43.799574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:43.800447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:43.801367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:43.801367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:43.801367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:43.801367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:43.803506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 445/893] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:43.810216 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921a762-579f-4e13-b7d7-f243a5eb8acc None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:43.819979 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57544bc7-65c0-4782-945c-317c272093f2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:43.919455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921a762-579f-4e13-b7d7-f243a5eb8acc None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:43.943793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57544bc7-65c0-4782-945c-317c272093f2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:43.959321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04b746-ba03-4647-8a28-3875dedd1530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:43.960125 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04b746-ba03-4647-8a28-3875dedd1530 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:43.960523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04b746-ba03-4647-8a28-3875dedd1530 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:43.961489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04b746-ba03-4647-8a28-3875dedd1530 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:43.962352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04b746-ba03-4647-8a28-3875dedd1530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:43.962753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04b746-ba03-4647-8a28-3875dedd1530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:43.964295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04b746-ba03-4647-8a28-3875dedd1530 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:43.981701 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 449/894] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:43.983690 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04b746-ba03-4647-8a28-3875dedd1530 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:43.992197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf74dc-c8b5-48a3-a134-2c7d857f2cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:43.993189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf74dc-c8b5-48a3-a134-2c7d857f2cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:43.993471 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf74dc-c8b5-48a3-a134-2c7d857f2cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:43.993747 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf74dc-c8b5-48a3-a134-2c7d857f2cb1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:43.994428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf74dc-c8b5-48a3-a134-2c7d857f2cb1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:43.995780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf74dc-c8b5-48a3-a134-2c7d857f2cb1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-4fdf74dc-c8b5-48a3-a134-2c7d857f2cb1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:44.008126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:44.009203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:44.010778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:44.010778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:44.010778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:44.010778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:44.010778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:44.010778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:44.010778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:44.010778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:44.010778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:44.010778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:44.010778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:44.010778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:44.010778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:29:44.010778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:44.014265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 446/895] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:29:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:44.015345 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf74dc-c8b5-48a3-a134-2c7d857f2cb1 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:44.104478 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04b746-ba03-4647-8a28-3875dedd1530 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:44.130939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf74dc-c8b5-48a3-a134-2c7d857f2cb1 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:44.139896 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0d8c9-0ca8-4a79-b8d9-490767f95165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:44.140817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0d8c9-0ca8-4a79-b8d9-490767f95165 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:44.141519 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0d8c9-0ca8-4a79-b8d9-490767f95165 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:44.141519 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0d8c9-0ca8-4a79-b8d9-490767f95165 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:44.148507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0d8c9-0ca8-4a79-b8d9-490767f95165 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:44.150202 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0d8c9-0ca8-4a79-b8d9-490767f95165 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:44.165048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-afc0d8c9-0ca8-4a79-b8d9-490767f95165 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:44.165048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:44.165048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:44.165048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:44.165048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:44.165048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:44.165048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:44.165048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:44.165048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:44.165048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:44.165048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:44.165048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:44.165048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:44.165048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:44.165048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:44.166195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:44.167402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:44.167402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:44.167402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:44.167402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:44.167402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:44.167402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:44.167402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:44.167402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:44.173382 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 450/896] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:44.174888 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0d8c9-0ca8-4a79-b8d9-490767f95165 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:44.180356 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478298e5-156e-4fa9-9ff7-a7264c789562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:44.181244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478298e5-156e-4fa9-9ff7-a7264c789562 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:44.181692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478298e5-156e-4fa9-9ff7-a7264c789562 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:44.182123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478298e5-156e-4fa9-9ff7-a7264c789562 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:44.183022 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478298e5-156e-4fa9-9ff7-a7264c789562 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:44.183475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478298e5-156e-4fa9-9ff7-a7264c789562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:44.185434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478298e5-156e-4fa9-9ff7-a7264c789562 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:44.192430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 447/897] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:29:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:44.198749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478298e5-156e-4fa9-9ff7-a7264c789562 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:44.305819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0d8c9-0ca8-4a79-b8d9-490767f95165 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:44.309498 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478298e5-156e-4fa9-9ff7-a7264c789562 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:44.343685 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d262fd2-9bff-48e2-8451-a6f1215f4c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:44.344344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d262fd2-9bff-48e2-8451-a6f1215f4c5b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:44.344621 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d262fd2-9bff-48e2-8451-a6f1215f4c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:44.344892 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d262fd2-9bff-48e2-8451-a6f1215f4c5b None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:44.345667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d262fd2-9bff-48e2-8451-a6f1215f4c5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:44.346002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d262fd2-9bff-48e2-8451-a6f1215f4c5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:44.347810 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d262fd2-9bff-48e2-8451-a6f1215f4c5b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:44.356151 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70928b8c-ac61-40f9-a3c5-0577dc0cc8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:44.357552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70928b8c-ac61-40f9-a3c5-0577dc0cc8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:44.358348 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70928b8c-ac61-40f9-a3c5-0577dc0cc8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:44.358846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70928b8c-ac61-40f9-a3c5-0577dc0cc8b7 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:44.359763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70928b8c-ac61-40f9-a3c5-0577dc0cc8b7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:44.364833 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 451/898] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:44.364972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70928b8c-ac61-40f9-a3c5-0577dc0cc8b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:44.364972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70928b8c-ac61-40f9-a3c5-0577dc0cc8b7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:44.367054 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d262fd2-9bff-48e2-8451-a6f1215f4c5b None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:44.374225 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 448/899] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:29:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:44.375299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70928b8c-ac61-40f9-a3c5-0577dc0cc8b7 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:44.478367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70928b8c-ac61-40f9-a3c5-0577dc0cc8b7 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:44.491215 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d262fd2-9bff-48e2-8451-a6f1215f4c5b None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:44.519329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debe6c7-3882-422a-8f3e-3eff97aae5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:44.520015 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debe6c7-3882-422a-8f3e-3eff97aae5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:44.520301 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debe6c7-3882-422a-8f3e-3eff97aae5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:44.520581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debe6c7-3882-422a-8f3e-3eff97aae5a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:44.521394 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debe6c7-3882-422a-8f3e-3eff97aae5a9 None admin] RBAC: Adding query filter params (interface=public, service_id=a1a9bd0655a84640937e2f134201fcc1, region_id=RegionOne) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:44.521706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debe6c7-3882-422a-8f3e-3eff97aae5a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:44.523170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debe6c7-3882-422a-8f3e-3eff97aae5a9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:44.533713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 449/900] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 5 15:29:44 2022] GET /identity/v3/endpoints?service_id=a1a9bd0655a84640937e2f134201fcc1&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:44.533713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172c2f3-8f16-4717-98ec-8b9e2317776e None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:44.533713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172c2f3-8f16-4717-98ec-8b9e2317776e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:44.533713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172c2f3-8f16-4717-98ec-8b9e2317776e None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:44.533713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 450/901] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:44.537375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172c2f3-8f16-4717-98ec-8b9e2317776e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:44.543270 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163a3cd-9d17-43f2-8a1a-f3c07b791411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:44.543938 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a3cd-9d17-43f2-8a1a-f3c07b791411 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:44.544222 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a3cd-9d17-43f2-8a1a-f3c07b791411 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:44.544497 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a3cd-9d17-43f2-8a1a-f3c07b791411 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:44.545334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163a3cd-9d17-43f2-8a1a-f3c07b791411 None admin] RBAC: Adding query filter params (role.id=edfde1ef46e447c0bf59f670ecfef070, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=a44a128e68d94e34ac3463eb7f1d8f4f) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:44.545643 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163a3cd-9d17-43f2-8a1a-f3c07b791411 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:44.547103 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163a3cd-9d17-43f2-8a1a-f3c07b791411 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:44.553040 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 452/902] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:44 2022] GET /identity/v3/role_assignments?user.id=a44a128e68d94e34ac3463eb7f1d8f4f&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=edfde1ef46e447c0bf59f670ecfef070 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:44.554074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1ad40-9ac2-4575-9888-22e80b6de7f2 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:44.554873 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1ad40-9ac2-4575-9888-22e80b6de7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:44.555292 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1ad40-9ac2-4575-9888-22e80b6de7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:44.573422 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-b7b1ad40-9ac2-4575-9888-22e80b6de7f2 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:44.574706 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b7b1ad40-9ac2-4575-9888-22e80b6de7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:44.653184 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 453/903] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:44.676646 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1ad40-9ac2-4575-9888-22e80b6de7f2 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:44.678238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172c2f3-8f16-4717-98ec-8b9e2317776e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:44.716978 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464a3c2-0445-41cd-8c28-26483fc2043d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:44.717656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464a3c2-0445-41cd-8c28-26483fc2043d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:44.717934 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464a3c2-0445-41cd-8c28-26483fc2043d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:44.718235 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464a3c2-0445-41cd-8c28-26483fc2043d None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:44.718928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464a3c2-0445-41cd-8c28-26483fc2043d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:44.720891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464a3c2-0445-41cd-8c28-26483fc2043d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:44.728520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 451/904] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 5 15:29:44 2022] GET /identity/v3/services => generated 1268 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:29:44.729805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f16bb-23b5-4125-a81c-0ff9936c2177 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:44.730089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f16bb-23b5-4125-a81c-0ff9936c2177 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:44.730387 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f16bb-23b5-4125-a81c-0ff9936c2177 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:44.731873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 452/905] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:44.737440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd359f-eb90-496f-aaf0-b3f21ee81bec None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:44.737749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd359f-eb90-496f-aaf0-b3f21ee81bec None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:44.737971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd359f-eb90-496f-aaf0-b3f21ee81bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:44.756131 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b8bd359f-eb90-496f-aaf0-b3f21ee81bec None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:44.757345 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b8bd359f-eb90-496f-aaf0-b3f21ee81bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:44.803924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1ad40-9ac2-4575-9888-22e80b6de7f2 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:44.851525 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e8d4c-9212-4119-a61f-a9ae87aaa886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:44.852757 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e8d4c-9212-4119-a61f-a9ae87aaa886 None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:44.853240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e8d4c-9212-4119-a61f-a9ae87aaa886 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:44.853718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e8d4c-9212-4119-a61f-a9ae87aaa886 None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:44.854743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e8d4c-9212-4119-a61f-a9ae87aaa886 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:44.856403 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e8d4c-9212-4119-a61f-a9ae87aaa886 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:44.857348 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 453/906] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:29:44.881482 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd359f-eb90-496f-aaf0-b3f21ee81bec None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:44.882311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 454/907] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 5 15:29:44 2022] POST /identity/v3/services => generated 241 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:29:44.996407 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd359f-eb90-496f-aaf0-b3f21ee81bec None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:45.038684 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af462c16-1418-4c44-ac7e-7e24aef697f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:45.040266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af462c16-1418-4c44-ac7e-7e24aef697f8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:45.040763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af462c16-1418-4c44-ac7e-7e24aef697f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:45.041252 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af462c16-1418-4c44-ac7e-7e24aef697f8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:45.042128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af462c16-1418-4c44-ac7e-7e24aef697f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:45.043807 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af462c16-1418-4c44-ac7e-7e24aef697f8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-af462c16-1418-4c44-ac7e-7e24aef697f8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:45.057570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:45.058636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:45.059470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:45.059470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:45.059470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:45.059470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:45.059470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:45.059470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:45.059470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:45.059470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:45.059470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:45.059470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:45.059470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:45.059470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:45.059470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:45.059470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:29:45.059470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:45.062455 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 454/908] 10.222.0.58 () {56 vars in 1132 bytes} [Thu May 5 15:29:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:45.068537 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e8d4c-9212-4119-a61f-a9ae87aaa886 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:45.177144 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e8d4c-9212-4119-a61f-a9ae87aaa886 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:45.214551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc453e-3e92-4ca2-b26e-1b7722040909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:45.215226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc453e-3e92-4ca2-b26e-1b7722040909 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:45.215511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc453e-3e92-4ca2-b26e-1b7722040909 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:45.215787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc453e-3e92-4ca2-b26e-1b7722040909 None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:45.216498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc453e-3e92-4ca2-b26e-1b7722040909 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:45.216806 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc453e-3e92-4ca2-b26e-1b7722040909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:45.218186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc453e-3e92-4ca2-b26e-1b7722040909 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:45.223588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 455/909] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 5 15:29:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:45.229158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af462c16-1418-4c44-ac7e-7e24aef697f8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:45.330982 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af462c16-1418-4c44-ac7e-7e24aef697f8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:45.365707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0ed88-7c18-45ed-882b-ce69537fde7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:45.366393 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0ed88-7c18-45ed-882b-ce69537fde7e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:45.366670 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0ed88-7c18-45ed-882b-ce69537fde7e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:45.367052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0ed88-7c18-45ed-882b-ce69537fde7e None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:45.367940 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0ed88-7c18-45ed-882b-ce69537fde7e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:45.368245 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0ed88-7c18-45ed-882b-ce69537fde7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:45.369609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0ed88-7c18-45ed-882b-ce69537fde7e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:45.374911 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 455/910] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 5 15:29:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:45.380658 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc453e-3e92-4ca2-b26e-1b7722040909 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:45.485098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc453e-3e92-4ca2-b26e-1b7722040909 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:45.519200 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dc26b-fb75-4882-b323-23fbff0d330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:45.519857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dc26b-fb75-4882-b323-23fbff0d330c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:45.520140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dc26b-fb75-4882-b323-23fbff0d330c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:45.520418 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dc26b-fb75-4882-b323-23fbff0d330c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:45.521261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dc26b-fb75-4882-b323-23fbff0d330c None admin] RBAC: Adding query filter params (interface=public, service_id=8115974e65d84a15960668b520aa8c92, region_id=RegionOne) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:45.521569 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dc26b-fb75-4882-b323-23fbff0d330c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:45.523006 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dc26b-fb75-4882-b323-23fbff0d330c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:45.528557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 456/911] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 5 15:29:45 2022] GET /identity/v3/endpoints?service_id=8115974e65d84a15960668b520aa8c92&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:45.535222 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0ed88-7c18-45ed-882b-ce69537fde7e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:45.639786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0ed88-7c18-45ed-882b-ce69537fde7e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:45.673676 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3af83-4d09-4d33-8754-11edb8baad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:45.674374 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3af83-4d09-4d33-8754-11edb8baad92 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:45.674657 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3af83-4d09-4d33-8754-11edb8baad92 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:45.674931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3af83-4d09-4d33-8754-11edb8baad92 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:45.675602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3af83-4d09-4d33-8754-11edb8baad92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:45.676953 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3af83-4d09-4d33-8754-11edb8baad92 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:45.684013 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 456/912] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 5 15:29:45 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:29:46.911007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff809821-a2d4-4e8a-a7b5-d5d329212841 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:46.911556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff809821-a2d4-4e8a-a7b5-d5d329212841 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:46.911556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff809821-a2d4-4e8a-a7b5-d5d329212841 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:46.913282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 457/913] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:46.919952 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8e498-e6be-4231-924f-e62c49cba825 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:46.920599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8e498-e6be-4231-924f-e62c49cba825 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:46.920599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8e498-e6be-4231-924f-e62c49cba825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:46.937777 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b6d8e498-e6be-4231-924f-e62c49cba825 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:46.939021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b6d8e498-e6be-4231-924f-e62c49cba825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:47.007899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 457/914] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:47.030882 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff809821-a2d4-4e8a-a7b5-d5d329212841 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:47.106999 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291399b-7d9f-4c6d-898c-27598a5d20fa None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:47.107436 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291399b-7d9f-4c6d-898c-27598a5d20fa None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:47.107716 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291399b-7d9f-4c6d-898c-27598a5d20fa None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:47.109194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 458/915] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:47.114023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73ef95-d512-4aae-9bf7-c611e2d1db2e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:47.114334 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73ef95-d512-4aae-9bf7-c611e2d1db2e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:47.114607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73ef95-d512-4aae-9bf7-c611e2d1db2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:47.131987 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-7a73ef95-d512-4aae-9bf7-c611e2d1db2e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:47.133502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7a73ef95-d512-4aae-9bf7-c611e2d1db2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:47.142848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff809821-a2d4-4e8a-a7b5-d5d329212841 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:47.187064 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d7303-5634-47de-b9c0-eb8312e802d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:47.188456 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7303-5634-47de-b9c0-eb8312e802d3 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:47.189090 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7303-5634-47de-b9c0-eb8312e802d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:47.189868 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7303-5634-47de-b9c0-eb8312e802d3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:47.203142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d7303-5634-47de-b9c0-eb8312e802d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:47.206406 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 459/916] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-c03d7303-5634-47de-b9c0-eb8312e802d3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:47.212289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:47.213232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:47.214113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:47.214113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:47.214113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:47.214113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:47.214113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:47.214113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:47.214113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:47.214113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:47.214113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:47.214113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:47.214113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:29:47.214113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:47.216497 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 458/917] 10.222.0.58 () {56 vars in 1120 bytes} [Thu May 5 15:29:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:47.222871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73ef95-d512-4aae-9bf7-c611e2d1db2e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:47.223394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d7303-5634-47de-b9c0-eb8312e802d3 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:47.325963 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73ef95-d512-4aae-9bf7-c611e2d1db2e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:47.329063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d7303-5634-47de-b9c0-eb8312e802d3 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:47.359127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b4fd5-335b-4f7f-8453-c2a1b74025b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:47.360082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b4fd5-335b-4f7f-8453-c2a1b74025b6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:47.360358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b4fd5-335b-4f7f-8453-c2a1b74025b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:47.360630 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b4fd5-335b-4f7f-8453-c2a1b74025b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:47.361363 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b4fd5-335b-4f7f-8453-c2a1b74025b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:47.361784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e2b3d-fa18-40d6-aeab-25ce5356dc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:47.362481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e2b3d-fa18-40d6-aeab-25ce5356dc46 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:47.362746 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b4fd5-335b-4f7f-8453-c2a1b74025b6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:47.362860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e2b3d-fa18-40d6-aeab-25ce5356dc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:47.363016 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e2b3d-fa18-40d6-aeab-25ce5356dc46 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:47.363747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e2b3d-fa18-40d6-aeab-25ce5356dc46 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:47.364050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e2b3d-fa18-40d6-aeab-25ce5356dc46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:47.365387 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e2b3d-fa18-40d6-aeab-25ce5356dc46 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:47.380551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 459/918] 10.222.0.58 () {56 vars in 1115 bytes} [Thu May 5 15:29:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-995b4fd5-335b-4f7f-8453-c2a1b74025b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:47.380723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:47.381632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:47.382543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:47.382543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:47.382543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:47.382543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:47.382543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:47.382543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:47.382543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:47.382543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:47.382543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:47.382543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:47.382543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:47.382543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:47.382543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 05 15:29:47.382543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:47.383265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd6f47-557b-41d3-8faf-227ccff6663b None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:47.383265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd6f47-557b-41d3-8faf-227ccff6663b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:47.383265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd6f47-557b-41d3-8faf-227ccff6663b None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:47.383459 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 460/919] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:29:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:47.383532 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 460/920] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:47.383607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b4fd5-335b-4f7f-8453-c2a1b74025b6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:47.383694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f1c67-20e3-40d9-8984-38cbd04efe29 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:47.383694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f1c67-20e3-40d9-8984-38cbd04efe29 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:47.383694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f1c67-20e3-40d9-8984-38cbd04efe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:47.400418 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-659f1c67-20e3-40d9-8984-38cbd04efe29 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:47.401803 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-659f1c67-20e3-40d9-8984-38cbd04efe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:47.474343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 461/921] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:47.474343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f1c67-20e3-40d9-8984-38cbd04efe29 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:47.495462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b4fd5-335b-4f7f-8453-c2a1b74025b6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:47.534280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb7a66-d8dc-4646-936a-0a6347cae65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:47.535491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb7a66-d8dc-4646-936a-0a6347cae65a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:47.536220 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb7a66-d8dc-4646-936a-0a6347cae65a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:47.536905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb7a66-d8dc-4646-936a-0a6347cae65a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:47.550193 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb7a66-d8dc-4646-936a-0a6347cae65a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:47.552209 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb7a66-d8dc-4646-936a-0a6347cae65a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:47.572909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-4fdb7a66-d8dc-4646-936a-0a6347cae65a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:47.572909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:47.572909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:47.572909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:47.572909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:47.572909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:47.572909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:47.572909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:47.572909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:47.572909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:47.572909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:47.572909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:47.572909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:47.572909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:47.572909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:47.574041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:47.575170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:47.575170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:47.575170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:47.575170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:47.580872 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 461/922] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:47.580872 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb7a66-d8dc-4646-936a-0a6347cae65a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:47.583586 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f1c67-20e3-40d9-8984-38cbd04efe29 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:47.621631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35477a-e7bf-4804-a7b6-115e1f7af142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:47.622343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35477a-e7bf-4804-a7b6-115e1f7af142 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:47.622609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35477a-e7bf-4804-a7b6-115e1f7af142 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:47.622884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35477a-e7bf-4804-a7b6-115e1f7af142 None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:47.623582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35477a-e7bf-4804-a7b6-115e1f7af142 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:47.623888 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35477a-e7bf-4804-a7b6-115e1f7af142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:47.625264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35477a-e7bf-4804-a7b6-115e1f7af142 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:47.630080 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 462/923] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:29:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:47.630809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35477a-e7bf-4804-a7b6-115e1f7af142 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:47.682523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb7a66-d8dc-4646-936a-0a6347cae65a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:47.718534 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d58a1-b781-4e47-a276-ace672a3e0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:47.719494 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d58a1-b781-4e47-a276-ace672a3e0ec None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:47.719776 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d58a1-b781-4e47-a276-ace672a3e0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:47.720352 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d58a1-b781-4e47-a276-ace672a3e0ec None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:47.721268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d58a1-b781-4e47-a276-ace672a3e0ec None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:47.723344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d58a1-b781-4e47-a276-ace672a3e0ec None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:47.725693 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35477a-e7bf-4804-a7b6-115e1f7af142 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-350d58a1-b781-4e47-a276-ace672a3e0ec None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:47.738282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:47.739309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:47.740129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:47.740129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:47.740129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:47.740129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:47.740129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:47.740129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:47.740129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:47.740129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:47.740129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:47.740129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:47.740129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:47.740129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:47.740129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:29:47.740129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:47.741461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 462/924] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 5 15:29:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:47.741461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d58a1-b781-4e47-a276-ace672a3e0ec None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:47.761622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc71faa-5c1f-42af-890e-060e1c80a77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:47.762323 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc71faa-5c1f-42af-890e-060e1c80a77a None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:47.762604 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc71faa-5c1f-42af-890e-060e1c80a77a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:47.762876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc71faa-5c1f-42af-890e-060e1c80a77a None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:47.763583 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc71faa-5c1f-42af-890e-060e1c80a77a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:47.763882 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc71faa-5c1f-42af-890e-060e1c80a77a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:47.765234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc71faa-5c1f-42af-890e-060e1c80a77a None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:47.776096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 463/925] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:47.776872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc71faa-5c1f-42af-890e-060e1c80a77a None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:47.853105 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d58a1-b781-4e47-a276-ace672a3e0ec None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:47.878723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc71faa-5c1f-42af-890e-060e1c80a77a None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:47.887182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a441be5-4124-4398-9770-3cd20a757823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:47.887843 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a441be5-4124-4398-9770-3cd20a757823 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:47.888121 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a441be5-4124-4398-9770-3cd20a757823 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:47.888391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a441be5-4124-4398-9770-3cd20a757823 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:47.889090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a441be5-4124-4398-9770-3cd20a757823 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:47.889388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a441be5-4124-4398-9770-3cd20a757823 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:47.890781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a441be5-4124-4398-9770-3cd20a757823 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:47.895516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 463/926] 10.222.0.58 () {56 vars in 1114 bytes} [Thu May 5 15:29:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:47.896291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a441be5-4124-4398-9770-3cd20a757823 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:47.919312 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a573c4-1bfc-4034-a4d8-21b646d3743a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:47.919968 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a573c4-1bfc-4034-a4d8-21b646d3743a None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:47.920243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a573c4-1bfc-4034-a4d8-21b646d3743a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:47.920515 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a573c4-1bfc-4034-a4d8-21b646d3743a None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:47.921206 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a573c4-1bfc-4034-a4d8-21b646d3743a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:47.921498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a573c4-1bfc-4034-a4d8-21b646d3743a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:47.922906 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a573c4-1bfc-4034-a4d8-21b646d3743a None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:47.927723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 464/927] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 5 15:29:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:47.928588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a573c4-1bfc-4034-a4d8-21b646d3743a None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:48.000998 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a441be5-4124-4398-9770-3cd20a757823 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:48.033770 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a573c4-1bfc-4034-a4d8-21b646d3743a None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:48.034031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc81185-0492-4f00-a155-54223b941e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:48.034869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc81185-0492-4f00-a155-54223b941e2f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:48.035158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc81185-0492-4f00-a155-54223b941e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:48.035424 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc81185-0492-4f00-a155-54223b941e2f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:48.042941 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc81185-0492-4f00-a155-54223b941e2f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:48.044366 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc81185-0492-4f00-a155-54223b941e2f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-2fc81185-0492-4f00-a155-54223b941e2f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:48.058857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:48.059937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:48.060888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:48.060888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:48.060888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:48.060888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:48.060888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:48.060888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:48.060888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:48.060888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:48.060888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:29:48.060888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:48.060888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 464/928] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 5 15:29:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:48.060888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc81185-0492-4f00-a155-54223b941e2f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:48.072455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aed83c-72e7-4f53-b3ee-c10e83bb0608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:48.076719 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aed83c-72e7-4f53-b3ee-c10e83bb0608 None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:48.077004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aed83c-72e7-4f53-b3ee-c10e83bb0608 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:48.077637 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aed83c-72e7-4f53-b3ee-c10e83bb0608 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:48.078902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aed83c-72e7-4f53-b3ee-c10e83bb0608 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:48.080267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aed83c-72e7-4f53-b3ee-c10e83bb0608 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:48.107593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 465/929] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 5 15:29:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:29:48.109008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b15a5-1854-474e-ae18-7354b5dfbfd8 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:48.109496 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b15a5-1854-474e-ae18-7354b5dfbfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:48.109914 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b15a5-1854-474e-ae18-7354b5dfbfd8 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:48.112102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 466/930] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:48.113156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b15a5-1854-474e-ae18-7354b5dfbfd8 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:48.177565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc81185-0492-4f00-a155-54223b941e2f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:48.221943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb20505-7a60-49b9-9a16-a37ba3ae3beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:48.222896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb20505-7a60-49b9-9a16-a37ba3ae3beb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:48.223171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb20505-7a60-49b9-9a16-a37ba3ae3beb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:48.223464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb20505-7a60-49b9-9a16-a37ba3ae3beb None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:48.224139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb20505-7a60-49b9-9a16-a37ba3ae3beb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:48.224443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb20505-7a60-49b9-9a16-a37ba3ae3beb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:48.225825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb20505-7a60-49b9-9a16-a37ba3ae3beb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:48.229376 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b15a5-1854-474e-ae18-7354b5dfbfd8 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:48.232048 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 465/931] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 5 15:29:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:48.233344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d89b0-f219-447f-b30a-f2f96cfc94ee None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:48.233629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d89b0-f219-447f-b30a-f2f96cfc94ee None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:48.233905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d89b0-f219-447f-b30a-f2f96cfc94ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:48.251306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d92d89b0-f219-447f-b30a-f2f96cfc94ee None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:48.252468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d92d89b0-f219-447f-b30a-f2f96cfc94ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:48.270912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74f4b8-4bbd-428e-9df0-1225416c32ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:48.271602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74f4b8-4bbd-428e-9df0-1225416c32ab None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:48.271880 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74f4b8-4bbd-428e-9df0-1225416c32ab None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:48.272153 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74f4b8-4bbd-428e-9df0-1225416c32ab None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:48.273589 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74f4b8-4bbd-428e-9df0-1225416c32ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:48.273910 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74f4b8-4bbd-428e-9df0-1225416c32ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:48.275608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74f4b8-4bbd-428e-9df0-1225416c32ab None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:48.293984 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 467/932] 10.222.0.58 () {56 vars in 1149 bytes} [Thu May 5 15:29:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:48.294875 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74f4b8-4bbd-428e-9df0-1225416c32ab None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:48.330433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 466/933] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:48.330433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d89b0-f219-447f-b30a-f2f96cfc94ee None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:48.412953 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74f4b8-4bbd-428e-9df0-1225416c32ab None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:48.432969 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d89b0-f219-447f-b30a-f2f96cfc94ee None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:48.448483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf60c64-55df-4255-9c5f-10b4f4275500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:48.449144 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf60c64-55df-4255-9c5f-10b4f4275500 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:48.449424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf60c64-55df-4255-9c5f-10b4f4275500 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:48.449694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf60c64-55df-4255-9c5f-10b4f4275500 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:48.450513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf60c64-55df-4255-9c5f-10b4f4275500 None admin] RBAC: Adding query filter params (interface=public, service_id=e848957590324131819746138aa3a76f, region_id=RegionOne) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:48.450828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf60c64-55df-4255-9c5f-10b4f4275500 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:48.452183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf60c64-55df-4255-9c5f-10b4f4275500 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:48.464046 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 468/934] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 5 15:29:48 2022] GET /identity/v3/endpoints?service_id=e848957590324131819746138aa3a76f&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:48.464046 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf60c64-55df-4255-9c5f-10b4f4275500 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:48.472540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6006c42-be71-4235-a4a4-ca438c937b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:48.473331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6006c42-be71-4235-a4a4-ca438c937b71 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:48.473617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6006c42-be71-4235-a4a4-ca438c937b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:48.473878 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6006c42-be71-4235-a4a4-ca438c937b71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:48.484007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6006c42-be71-4235-a4a4-ca438c937b71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:48.485438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6006c42-be71-4235-a4a4-ca438c937b71 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:48.502834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d6006c42-be71-4235-a4a4-ca438c937b71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:48.502834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:48.502834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:48.502834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:48.502834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:48.502834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:48.502834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:48.502834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:48.502834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:48.502834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:48.502834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:48.502834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:48.502834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:48.502834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:48.502834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:48.503750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:48.504710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:48.504710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:48.504710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:48.504710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:48.510730 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 467/935] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:48.510730 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6006c42-be71-4235-a4a4-ca438c937b71 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:48.565901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf60c64-55df-4255-9c5f-10b4f4275500 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:48.602072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7692c3c-e065-4013-8784-d09194d9477d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:48.602951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7692c3c-e065-4013-8784-d09194d9477d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:48.603226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7692c3c-e065-4013-8784-d09194d9477d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:48.603556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7692c3c-e065-4013-8784-d09194d9477d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:48.604196 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7692c3c-e065-4013-8784-d09194d9477d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:48.605544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7692c3c-e065-4013-8784-d09194d9477d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:48.614347 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6006c42-be71-4235-a4a4-ca438c937b71 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-a7692c3c-e065-4013-8784-d09194d9477d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:48.617828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:48.618986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:48.625133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 469/936] 10.222.0.58 () {56 vars in 1132 bytes} [Thu May 5 15:29:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:48.625997 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7692c3c-e065-4013-8784-d09194d9477d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:48.650636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e6ae0-2bb5-4857-a072-b6b95977804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:48.651396 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e6ae0-2bb5-4857-a072-b6b95977804c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:48.651682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e6ae0-2bb5-4857-a072-b6b95977804c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:48.651958 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e6ae0-2bb5-4857-a072-b6b95977804c None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:48.652628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e6ae0-2bb5-4857-a072-b6b95977804c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:48.653989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e6ae0-2bb5-4857-a072-b6b95977804c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:48.670496 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 468/937] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 5 15:29:48 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:29:48.670496 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e6ae0-2bb5-4857-a072-b6b95977804c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:48.735505 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7692c3c-e065-4013-8784-d09194d9477d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:48.772253 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce2977-41b1-48d9-ac40-693b56d28a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:48.773643 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2977-41b1-48d9-ac40-693b56d28a01 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:48.774211 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2977-41b1-48d9-ac40-693b56d28a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:48.774597 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2977-41b1-48d9-ac40-693b56d28a01 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:48.775455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce2977-41b1-48d9-ac40-693b56d28a01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:48.775866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce2977-41b1-48d9-ac40-693b56d28a01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:48.777356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce2977-41b1-48d9-ac40-693b56d28a01 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:48.787329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e6ae0-2bb5-4857-a072-b6b95977804c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:48.791463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 470/938] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:48.799931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce2977-41b1-48d9-ac40-693b56d28a01 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:48.833728 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51d456-304b-43a2-88db-2d5f00addb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:48.834625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51d456-304b-43a2-88db-2d5f00addb3b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:48.835169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51d456-304b-43a2-88db-2d5f00addb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:48.836560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51d456-304b-43a2-88db-2d5f00addb3b None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:48.837711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51d456-304b-43a2-88db-2d5f00addb3b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:48.838122 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51d456-304b-43a2-88db-2d5f00addb3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:48.840432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51d456-304b-43a2-88db-2d5f00addb3b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:48.850348 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 469/939] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 5 15:29:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:48.854586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51d456-304b-43a2-88db-2d5f00addb3b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:48.929842 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce2977-41b1-48d9-ac40-693b56d28a01 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:48.957624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51d456-304b-43a2-88db-2d5f00addb3b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:48.965768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047d91d-8dcb-4b15-9db9-593bb2d410e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:48.966597 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047d91d-8dcb-4b15-9db9-593bb2d410e2 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:48.966878 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047d91d-8dcb-4b15-9db9-593bb2d410e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:48.967150 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047d91d-8dcb-4b15-9db9-593bb2d410e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:48.974410 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047d91d-8dcb-4b15-9db9-593bb2d410e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:48.975908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047d91d-8dcb-4b15-9db9-593bb2d410e2 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:48.989839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-2047d91d-8dcb-4b15-9db9-593bb2d410e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:48.989839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:48.989839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:48.989839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:48.989839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:48.989839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:48.989839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:48.989839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:48.989839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:48.989839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:48.989839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:48.989839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:48.989839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:48.989839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:48.989839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:48.990965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:48.992030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:48.992030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:48.992030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:48.992030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:48.992030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:48.992030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:48.992030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:48.992030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:48.992030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 471/940] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:48.998036 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047d91d-8dcb-4b15-9db9-593bb2d410e2 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:49.001413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb381523-e375-43a1-8fad-8e6b6e9eebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:49.002618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb381523-e375-43a1-8fad-8e6b6e9eebb8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:49.003041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb381523-e375-43a1-8fad-8e6b6e9eebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:49.003598 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb381523-e375-43a1-8fad-8e6b6e9eebb8 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:49.004486 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb381523-e375-43a1-8fad-8e6b6e9eebb8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:49.005092 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb381523-e375-43a1-8fad-8e6b6e9eebb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:49.006633 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb381523-e375-43a1-8fad-8e6b6e9eebb8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:49.012701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 470/941] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 5 15:29:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:49.018025 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb381523-e375-43a1-8fad-8e6b6e9eebb8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:49.103949 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047d91d-8dcb-4b15-9db9-593bb2d410e2 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:49.125700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb381523-e375-43a1-8fad-8e6b6e9eebb8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:49.139474 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddc464-c8ee-40fb-a881-0cc7596fa888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:49.140362 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddc464-c8ee-40fb-a881-0cc7596fa888 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:49.140786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddc464-c8ee-40fb-a881-0cc7596fa888 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:49.141218 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddc464-c8ee-40fb-a881-0cc7596fa888 None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:49.142132 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddc464-c8ee-40fb-a881-0cc7596fa888 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:49.142606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddc464-c8ee-40fb-a881-0cc7596fa888 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:49.144176 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddc464-c8ee-40fb-a881-0cc7596fa888 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:49.161911 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 472/942] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:49.163085 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddc464-c8ee-40fb-a881-0cc7596fa888 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:49.164270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5773e2c-a133-4a04-8305-51e6c4d9228e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:49.165610 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5773e2c-a133-4a04-8305-51e6c4d9228e None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:49.165893 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5773e2c-a133-4a04-8305-51e6c4d9228e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:49.166249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5773e2c-a133-4a04-8305-51e6c4d9228e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:49.166998 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5773e2c-a133-4a04-8305-51e6c4d9228e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:49.169074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5773e2c-a133-4a04-8305-51e6c4d9228e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:49.198368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 471/943] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 5 15:29:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:29:49.277148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddc464-c8ee-40fb-a881-0cc7596fa888 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:49.322377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70656cbe-f38f-45d7-871d-be76ea5140dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:49.323697 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70656cbe-f38f-45d7-871d-be76ea5140dc None admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:49.324177 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70656cbe-f38f-45d7-871d-be76ea5140dc None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:49.324644 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70656cbe-f38f-45d7-871d-be76ea5140dc None admin] PATH_INFO: `/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/a44a128e68d94e34ac3463eb7f1d8f4f/roles/edfde1ef46e447c0bf59f670ecfef070` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:49.327231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70656cbe-f38f-45d7-871d-be76ea5140dc None admin] RBAC: Authorizing `identity:create_grant(project_id=bdd58b84c6394504beb84d13d13d60a1, user_id=a44a128e68d94e34ac3463eb7f1d8f4f, role_id=edfde1ef46e447c0bf59f670ecfef070)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:49.328959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70656cbe-f38f-45d7-871d-be76ea5140dc None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:49.347984 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 473/944] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:29:49 2022] PUT /identity/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/a44a128e68d94e34ac3463eb7f1d8f4f/roles/edfde1ef46e447c0bf59f670ecfef070 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:29:50.455323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3b964-b465-463b-850f-8ebf2947ac65 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:50.455877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3b964-b465-463b-850f-8ebf2947ac65 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:50.455877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3b964-b465-463b-850f-8ebf2947ac65 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:50.457378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 472/945] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:50.465484 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2a1e3-4925-457f-a561-ebe1c8d7c92c None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:50.465945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2a1e3-4925-457f-a561-ebe1c8d7c92c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:50.466040 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2a1e3-4925-457f-a561-ebe1c8d7c92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:50.484280 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-42a2a1e3-4925-457f-a561-ebe1c8d7c92c None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:50.485478 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-42a2a1e3-4925-457f-a561-ebe1c8d7c92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:50.560037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 474/946] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:29:50.583327 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3b964-b465-463b-850f-8ebf2947ac65 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:50.687696 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3b964-b465-463b-850f-8ebf2947ac65 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:50.724718 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8b2a2-da93-496e-b41a-b408c5b16f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:50.725300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8b2a2-da93-496e-b41a-b408c5b16f75 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:50.725585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8b2a2-da93-496e-b41a-b408c5b16f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:50.725861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8b2a2-da93-496e-b41a-b408c5b16f75 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:50.727810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8b2a2-da93-496e-b41a-b408c5b16f75 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:50.729243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8b2a2-da93-496e-b41a-b408c5b16f75 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:50.730620 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: WARNING keystone.server.flask.common [None req-9ad8b2a2-da93-496e-b41a-b408c5b16f75 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 05 15:29:50.751526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.sql.core [None req-9ad8b2a2-da93-496e-b41a-b408c5b16f75 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 05 15:29:50.751526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 05 15:29:50.751526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [parameters: {'id': '049149aa095a4f7b8b265ea78f18fa0e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 05 15:29:50.751526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80046) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 05 15:29:50.759853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9ad8b2a2-da93-496e-b41a-b408c5b16f75 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 049149aa095a4f7b8b265ea78f18fa0e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 049149aa095a4f7b8b265ea78f18fa0e. May 05 15:29:50.759853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:50.759853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:29:50.759853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:29:50.759853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:29:50.759853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:29:50.759853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:29:50.759853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:29:50.759853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:29:50.759853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application conn.query(q) May 05 15:29:50.759853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:29:50.759853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:29:50.759853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application result.read() May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 05 15:29:50.760635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return project_ref.to_dict() May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application next(self.gen) May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application yield resource May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application next(self.gen) May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self.session.rollback() May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self.force_reraise() May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise self.value May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application session.commit() May 05 15:29:50.761585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._prepare_impl() May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self.session.flush() May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._flush(objects) May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application compat.raise_( May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application flush_context.execute() May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 05 15:29:50.762513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rec.execute(self) May 05 15:29:50.763425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 05 15:29:50.763425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 05 15:29:50.763425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 05 15:29:50.763425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application _emit_insert_statements( May 05 15:29:50.763425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 05 15:29:50.763425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application c = connection._execute_20( May 05 15:29:50.763425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 05 15:29:50.763425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 05 15:29:50.763425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 05 15:29:50.763425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 05 15:29:50.763425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 05 15:29:50.763425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ret = self._execute_context( May 05 15:29:50.763425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 05 15:29:50.763425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 05 15:29:50.763425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application conn.query(q) May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application result.read() May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:29:50.764206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:29:50.765064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:29:50.765064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:29:50.765064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:29:50.765064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:29:50.765064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:29:50.765064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:29:50.765064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 05 15:29:50.765064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 05 15:29:50.765064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [parameters: {'id': '049149aa095a4f7b8b265ea78f18fa0e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 05 15:29:50.765064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 05 15:29:50.765064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:50.765064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:50.765064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:50.765064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:50.765064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:50.765831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:50.772768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:50.772768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 05 15:29:50.772768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 05 15:29:50.772768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:50.772768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:50.772768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 05 15:29:50.772768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.Conflict( May 05 15:29:50.772768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 049149aa095a4f7b8b265ea78f18fa0e. May 05 15:29:50.772768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:50.772768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 473/947] 10.222.0.58 () {60 vars in 1140 bytes} [Thu May 5 15:29:50 2022] POST /identity/v3/projects => generated 262 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:50.774020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2a1e3-4925-457f-a561-ebe1c8d7c92c None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:50.883006 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2a1e3-4925-457f-a561-ebe1c8d7c92c None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:50.918301 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f986cf-34ba-4ae9-8537-dce61f960e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:50.919092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f986cf-34ba-4ae9-8537-dce61f960e16 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:50.919372 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f986cf-34ba-4ae9-8537-dce61f960e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:50.919645 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f986cf-34ba-4ae9-8537-dce61f960e16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:50.926678 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f986cf-34ba-4ae9-8537-dce61f960e16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:50.928125 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f986cf-34ba-4ae9-8537-dce61f960e16 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:50.942369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-16f986cf-34ba-4ae9-8537-dce61f960e16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:50.942369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:50.942369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:50.942369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:50.942369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:50.942369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:50.942369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:50.942369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:50.942369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:50.942369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:50.942369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:50.942369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:50.942369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:50.942369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:50.942369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:50.944358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:50.945641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:50.945641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:50.945641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:50.945641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:50.945641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:50.945641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:50.945641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:50.945641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:50.945641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 475/948] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:50.949508 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8b2a2-da93-496e-b41a-b408c5b16f75 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:51.034654 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004e847-a3f3-4c16-9f76-775289f2cf2b None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:51.034966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004e847-a3f3-4c16-9f76-775289f2cf2b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:51.035368 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004e847-a3f3-4c16-9f76-775289f2cf2b None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:51.037091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 476/949] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:29:51.042842 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4a4f1-bad5-4d62-ab5b-161cf947ba7f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:51.042842 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4a4f1-bad5-4d62-ab5b-161cf947ba7f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:51.042842 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4a4f1-bad5-4d62-ab5b-161cf947ba7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:51.062532 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-4db4a4f1-bad5-4d62-ab5b-161cf947ba7f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:51.064266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4db4a4f1-bad5-4d62-ab5b-161cf947ba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:51.065777 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8b2a2-da93-496e-b41a-b408c5b16f75 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:51.105220 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391e4f8-7e8a-4766-bea3-282857d06df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:51.106266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391e4f8-7e8a-4766-bea3-282857d06df0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:51.106764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391e4f8-7e8a-4766-bea3-282857d06df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:51.107231 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391e4f8-7e8a-4766-bea3-282857d06df0 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:51.109137 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391e4f8-7e8a-4766-bea3-282857d06df0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:51.109628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391e4f8-7e8a-4766-bea3-282857d06df0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:51.111473 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391e4f8-7e8a-4766-bea3-282857d06df0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:51.138575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 474/950] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 5 15:29:50 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:51.150291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 477/951] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:29:51.169588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391e4f8-7e8a-4766-bea3-282857d06df0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:51.280691 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391e4f8-7e8a-4766-bea3-282857d06df0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:51.318421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ffb77-e514-4d6e-8ce4-c65041c8504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:51.319542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ffb77-e514-4d6e-8ce4-c65041c8504d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:51.320157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ffb77-e514-4d6e-8ce4-c65041c8504d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:51.320618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ffb77-e514-4d6e-8ce4-c65041c8504d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:51.321441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ffb77-e514-4d6e-8ce4-c65041c8504d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:51.323006 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ffb77-e514-4d6e-8ce4-c65041c8504d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-3d7ffb77-e514-4d6e-8ce4-c65041c8504d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:51.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:51.336452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:51.337298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:51.337298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:51.337298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:51.337298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:51.337298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:51.337298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:51.337298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:51.337298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:51.337298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:51.337298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:51.337298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:51.337298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:51.337298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:29:51.337298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:51.339548 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 475/952] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 5 15:29:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:51.345665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4a4f1-bad5-4d62-ab5b-161cf947ba7f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:51.455010 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4a4f1-bad5-4d62-ab5b-161cf947ba7f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:51.494261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991255bc-191e-4a69-ab4c-03f73978bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:51.495051 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991255bc-191e-4a69-ab4c-03f73978bc3c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:51.495220 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991255bc-191e-4a69-ab4c-03f73978bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:51.495497 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991255bc-191e-4a69-ab4c-03f73978bc3c None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:51.496211 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991255bc-191e-4a69-ab4c-03f73978bc3c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:51.496513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991255bc-191e-4a69-ab4c-03f73978bc3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:51.497889 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991255bc-191e-4a69-ab4c-03f73978bc3c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:51.503475 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 478/953] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 5 15:29:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:51.518227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ffb77-e514-4d6e-8ce4-c65041c8504d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:51.625556 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ffb77-e514-4d6e-8ce4-c65041c8504d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:51.659742 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9781e-67a1-40c3-8057-007556d117f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:51.660758 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9781e-67a1-40c3-8057-007556d117f9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:51.661235 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9781e-67a1-40c3-8057-007556d117f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:51.661762 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9781e-67a1-40c3-8057-007556d117f9 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:51.662721 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9781e-67a1-40c3-8057-007556d117f9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:51.663193 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40519f14-280e-4e03-aedd-d3700bf92aa5 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:51.663509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9781e-67a1-40c3-8057-007556d117f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:51.663612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40519f14-280e-4e03-aedd-d3700bf92aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:51.663880 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40519f14-280e-4e03-aedd-d3700bf92aa5 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:51.665369 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9781e-67a1-40c3-8057-007556d117f9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:51.669223 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 479/954] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:29:51.670808 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab184e-8930-4b8d-a112-15110d1c21f3 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:51.671096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab184e-8930-4b8d-a112-15110d1c21f3 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:51.671375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab184e-8930-4b8d-a112-15110d1c21f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:51.672178 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 476/955] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 5 15:29:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:51.677720 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9781e-67a1-40c3-8057-007556d117f9 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:51.688979 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-e9ab184e-8930-4b8d-a112-15110d1c21f3 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:51.690129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e9ab184e-8930-4b8d-a112-15110d1c21f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:51.757503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 480/956] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:29:51.775783 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25ee24-2509-48bd-abe3-f4aff61c06ab None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:51.776078 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25ee24-2509-48bd-abe3-f4aff61c06ab None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:51.776286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9781e-67a1-40c3-8057-007556d117f9 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:51.776414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25ee24-2509-48bd-abe3-f4aff61c06ab None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:51.777902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 481/957] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:29:51.781874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25ee24-2509-48bd-abe3-f4aff61c06ab None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:51.809648 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c48ca-1613-40bb-b025-f71e4d5597ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:51.810326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c48ca-1613-40bb-b025-f71e4d5597ce None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:51.810604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c48ca-1613-40bb-b025-f71e4d5597ce None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:51.810874 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c48ca-1613-40bb-b025-f71e4d5597ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:51.811597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c48ca-1613-40bb-b025-f71e4d5597ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:51.812933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c48ca-1613-40bb-b025-f71e4d5597ce None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:51.833445 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 477/958] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 5 15:29:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:29:51.835416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb215d-5e0e-4203-bb5d-ff728791622f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:51.835806 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb215d-5e0e-4203-bb5d-ff728791622f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:51.836180 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb215d-5e0e-4203-bb5d-ff728791622f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:51.860857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-3aeb215d-5e0e-4203-bb5d-ff728791622f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:51.862877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3aeb215d-5e0e-4203-bb5d-ff728791622f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:51.909427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25ee24-2509-48bd-abe3-f4aff61c06ab None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:51.948816 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92583e-3a3d-4173-b5fc-105d52cbe853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:51.950127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92583e-3a3d-4173-b5fc-105d52cbe853 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:51.950678 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92583e-3a3d-4173-b5fc-105d52cbe853 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:51.951154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92583e-3a3d-4173-b5fc-105d52cbe853 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:51.952160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92583e-3a3d-4173-b5fc-105d52cbe853 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:51.953969 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92583e-3a3d-4173-b5fc-105d52cbe853 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:51.958327 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 478/959] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-5f92583e-3a3d-4173-b5fc-105d52cbe853 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:51.972102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:51.973419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:51.974792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:51.974792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:51.974792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:51.974792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:51.974792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:51.974792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:51.974792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:51.974792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:51.974792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:51.974792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:51.974792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:51.974792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:51.974792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:29:51.974792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:51.977251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb215d-5e0e-4203-bb5d-ff728791622f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:51.982973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 482/960] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:51.984773 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92583e-3a3d-4173-b5fc-105d52cbe853 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:52.091142 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb215d-5e0e-4203-bb5d-ff728791622f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:52.105030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92583e-3a3d-4173-b5fc-105d52cbe853 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:52.130561 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27a846-4255-4e7d-aadb-ab3909daa30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:52.131767 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27a846-4255-4e7d-aadb-ab3909daa30d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:52.132816 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27a846-4255-4e7d-aadb-ab3909daa30d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:52.133297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27a846-4255-4e7d-aadb-ab3909daa30d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:52.140039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6784f-45e9-4cdf-99af-ed88315cd55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:52.140851 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6784f-45e9-4cdf-99af-ed88315cd55a None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:52.141042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6784f-45e9-4cdf-99af-ed88315cd55a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:52.141308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6784f-45e9-4cdf-99af-ed88315cd55a None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:52.142082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6784f-45e9-4cdf-99af-ed88315cd55a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:52.142522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6784f-45e9-4cdf-99af-ed88315cd55a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:52.143743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6784f-45e9-4cdf-99af-ed88315cd55a None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:52.145665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27a846-4255-4e7d-aadb-ab3909daa30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:29:52.153484 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 483/961] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 5 15:29:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:52.154941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6784f-45e9-4cdf-99af-ed88315cd55a None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-5d27a846-4255-4e7d-aadb-ab3909daa30d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:29:52.155504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:52.156520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:52.157732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:52.157732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:52.157732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:52.157732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:52.157732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:29:52.157732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:29:52.157732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:29:52.157732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:29:52.157732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:29:52.157732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:29:52.157732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:29:52.157732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:52.157732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 479/962] 10.222.0.58 () {56 vars in 1120 bytes} [Thu May 5 15:29:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:52.164811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27a846-4255-4e7d-aadb-ab3909daa30d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:52.274983 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6784f-45e9-4cdf-99af-ed88315cd55a None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:52.277910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27a846-4255-4e7d-aadb-ab3909daa30d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:52.310659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48682af8-fa3b-4ae2-9a4b-7f29376e6433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:52.311322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48682af8-fa3b-4ae2-9a4b-7f29376e6433 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:52.311604 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48682af8-fa3b-4ae2-9a4b-7f29376e6433 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:52.311881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48682af8-fa3b-4ae2-9a4b-7f29376e6433 None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:52.312673 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48682af8-fa3b-4ae2-9a4b-7f29376e6433 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:52.312994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48682af8-fa3b-4ae2-9a4b-7f29376e6433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:52.314425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2ef7c-7f88-489c-bbdf-5259d008968f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:52.314550 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48682af8-fa3b-4ae2-9a4b-7f29376e6433 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:52.315408 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2ef7c-7f88-489c-bbdf-5259d008968f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:52.315900 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2ef7c-7f88-489c-bbdf-5259d008968f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:52.316387 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2ef7c-7f88-489c-bbdf-5259d008968f None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:52.317323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2ef7c-7f88-489c-bbdf-5259d008968f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:52.317836 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2ef7c-7f88-489c-bbdf-5259d008968f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:52.319469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 484/963] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 5 15:29:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:52.326340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2ef7c-7f88-489c-bbdf-5259d008968f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:52.336861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 480/964] 10.222.0.58 () {56 vars in 1115 bytes} [Thu May 5 15:29:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:52.342863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48682af8-fa3b-4ae2-9a4b-7f29376e6433 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:52.458883 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48682af8-fa3b-4ae2-9a4b-7f29376e6433 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:52.496412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb81c5a-75ab-4525-b1d9-254a19d49990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:52.498067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb81c5a-75ab-4525-b1d9-254a19d49990 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:52.498611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb81c5a-75ab-4525-b1d9-254a19d49990 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:52.499082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb81c5a-75ab-4525-b1d9-254a19d49990 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:52.511115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb81c5a-75ab-4525-b1d9-254a19d49990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:52.518188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb81c5a-75ab-4525-b1d9-254a19d49990 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:52.531063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-feb81c5a-75ab-4525-b1d9-254a19d49990 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:52.531063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:52.531063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:52.531063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:52.531063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:52.531063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:52.531063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:52.531063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:52.531063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:52.531063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:52.531063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:52.531063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:52.531063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:52.531063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:52.531063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:52.531952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:52.532860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:52.532860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:52.532860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:52.532860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:52.532860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 485/965] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:52.538133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2ef7c-7f88-489c-bbdf-5259d008968f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:52.640604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2ef7c-7f88-489c-bbdf-5259d008968f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:52.674320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62e1d5-569b-4806-b157-f9f10411a6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:52.674992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62e1d5-569b-4806-b157-f9f10411a6ce None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:52.675274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62e1d5-569b-4806-b157-f9f10411a6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:52.675542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62e1d5-569b-4806-b157-f9f10411a6ce None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:52.676258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62e1d5-569b-4806-b157-f9f10411a6ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:52.676555 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62e1d5-569b-4806-b157-f9f10411a6ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:52.677895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62e1d5-569b-4806-b157-f9f10411a6ce None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:52.695044 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 481/966] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:52.696582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb81c5a-75ab-4525-b1d9-254a19d49990 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:52.796562 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb81c5a-75ab-4525-b1d9-254a19d49990 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:52.831183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c1809-37cb-473c-882b-2cd186a33b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:52.831995 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c1809-37cb-473c-882b-2cd186a33b8d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:52.832278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c1809-37cb-473c-882b-2cd186a33b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:52.832554 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c1809-37cb-473c-882b-2cd186a33b8d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:52.840400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c1809-37cb-473c-882b-2cd186a33b8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:52.841833 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c1809-37cb-473c-882b-2cd186a33b8d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-7f3c1809-37cb-473c-882b-2cd186a33b8d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:52.857128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:52.859123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:52.860384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:52.860384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:52.860384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:52.860384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:52.860384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:52.860384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:52.860384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:52.860384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:52.860384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 05 15:29:52.860384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:52.860384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 486/967] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 5 15:29:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:52.863981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62e1d5-569b-4806-b157-f9f10411a6ce None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:52.969852 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62e1d5-569b-4806-b157-f9f10411a6ce None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:53.004119 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500efbb-a85d-42e9-8b28-e6f855234912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:53.004789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500efbb-a85d-42e9-8b28-e6f855234912 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:53.005067 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500efbb-a85d-42e9-8b28-e6f855234912 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:53.005339 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500efbb-a85d-42e9-8b28-e6f855234912 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:53.006194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500efbb-a85d-42e9-8b28-e6f855234912 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:53.006492 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500efbb-a85d-42e9-8b28-e6f855234912 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:53.008443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500efbb-a85d-42e9-8b28-e6f855234912 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:53.026534 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 482/968] 10.222.0.58 () {56 vars in 1149 bytes} [Thu May 5 15:29:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:53.032150 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c1809-37cb-473c-882b-2cd186a33b8d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:53.141274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c1809-37cb-473c-882b-2cd186a33b8d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:53.176324 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e6bf3-f725-4b65-a594-e5540f987cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:53.176980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6bf3-f725-4b65-a594-e5540f987cac None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:53.177261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6bf3-f725-4b65-a594-e5540f987cac None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:53.177535 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6bf3-f725-4b65-a594-e5540f987cac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:53.245944 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e6bf3-f725-4b65-a594-e5540f987cac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:53.247729 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e6bf3-f725-4b65-a594-e5540f987cac None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:53.345117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 487/969] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:29:53 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:29:53.354282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500efbb-a85d-42e9-8b28-e6f855234912 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:53.459798 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500efbb-a85d-42e9-8b28-e6f855234912 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:53.495922 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4b396-8b77-431b-a92b-e6dcaa987047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:53.496741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4b396-8b77-431b-a92b-e6dcaa987047 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:53.497021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4b396-8b77-431b-a92b-e6dcaa987047 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:53.497292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4b396-8b77-431b-a92b-e6dcaa987047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:53.511250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4b396-8b77-431b-a92b-e6dcaa987047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:53.511250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4b396-8b77-431b-a92b-e6dcaa987047 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:53.529895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d9f4b396-8b77-431b-a92b-e6dcaa987047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:53.529895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:53.529895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:53.529895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:53.529895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:53.529895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:53.529895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:53.529895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:53.529895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:53.529895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:53.529895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:53.529895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:53.529895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:29:53.529895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:29:53.529895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:53.530839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:53.531708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:29:53.531708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:29:53.531708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:29:53.531708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:53.531708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 483/970] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:53.536947 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e6bf3-f725-4b65-a594-e5540f987cac None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:53.607800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eed52c-768f-4074-a916-22d439dfe7e0 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:53.608309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eed52c-768f-4074-a916-22d439dfe7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:53.608309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eed52c-768f-4074-a916-22d439dfe7e0 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:53.609941 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 484/971] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:53.615028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859796-9bd3-4e90-bc39-d22ddad408bf None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:53.615548 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859796-9bd3-4e90-bc39-d22ddad408bf None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:53.616021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859796-9bd3-4e90-bc39-d22ddad408bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:53.633353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-72859796-9bd3-4e90-bc39-d22ddad408bf None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:53.635080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-72859796-9bd3-4e90-bc39-d22ddad408bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:53.644827 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e6bf3-f725-4b65-a594-e5540f987cac None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:53.686520 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584f029-e2ae-4a70-8bf8-a054d2209c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:53.687542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584f029-e2ae-4a70-8bf8-a054d2209c7c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:53.688190 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584f029-e2ae-4a70-8bf8-a054d2209c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:53.688666 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584f029-e2ae-4a70-8bf8-a054d2209c7c None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:53.689586 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584f029-e2ae-4a70-8bf8-a054d2209c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:53.690099 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584f029-e2ae-4a70-8bf8-a054d2209c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:53.691671 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584f029-e2ae-4a70-8bf8-a054d2209c7c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:53.703713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 488/972] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:53.709383 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584f029-e2ae-4a70-8bf8-a054d2209c7c None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:53.722523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 485/973] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) May 05 15:29:53.739929 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72859796-9bd3-4e90-bc39-d22ddad408bf None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:53.816308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584f029-e2ae-4a70-8bf8-a054d2209c7c None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:53.862198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458c31e-4802-492a-bbed-5e9f987e63c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:53.862198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458c31e-4802-492a-bbed-5e9f987e63c9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:53.862198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458c31e-4802-492a-bbed-5e9f987e63c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:53.862198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458c31e-4802-492a-bbed-5e9f987e63c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:53.869217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458c31e-4802-492a-bbed-5e9f987e63c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:53.870702 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458c31e-4802-492a-bbed-5e9f987e63c9 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:53.871136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72859796-9bd3-4e90-bc39-d22ddad408bf None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:53.885720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-2458c31e-4802-492a-bbed-5e9f987e63c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:53.885720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:53.885720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:53.885720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:53.885720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:53.885720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:53.885720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:53.885720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:53.885720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:53.885720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:53.885720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:53.885720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:53.885720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:29:53.885720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:29:53.885720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:53.886758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:53.887688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:29:53.887688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:29:53.887688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:29:53.887688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:29:53.887688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:29:53.887688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:29:53.887688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:29:53.887688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:53.891925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 489/974] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:53.892809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458c31e-4802-492a-bbed-5e9f987e63c9 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:53.911332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa4bbf-4c48-41a0-a805-7635c424ed86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:53.912167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa4bbf-4c48-41a0-a805-7635c424ed86 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:53.912784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa4bbf-4c48-41a0-a805-7635c424ed86 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:53.913068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa4bbf-4c48-41a0-a805-7635c424ed86 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:53.914490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa4bbf-4c48-41a0-a805-7635c424ed86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:53.915931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa4bbf-4c48-41a0-a805-7635c424ed86 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:53.934282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.sql.core [None req-e1fa4bbf-4c48-41a0-a805-7635c424ed86 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 05 15:29:53.934282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 05 15:29:53.934282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [parameters: {'user_id': '7d59b2336abc442a83893db8ddf7daca', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 05 15:29:53.934282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80046) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 05 15:29:53.944866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-e1fa4bbf-4c48-41a0-a805-7635c424ed86 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 05 15:29:53.944866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:53.944866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:29:53.944866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:29:53.944866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:29:53.944866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:29:53.944866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:29:53.944866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:29:53.944866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:29:53.944866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application conn.query(q) May 05 15:29:53.944866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:29:53.944866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:29:53.944866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:29:53.944866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application result.read() May 05 15:29:53.944866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:29:53.946619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application next(self.gen) May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application yield resource May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application next(self.gen) May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self.session.rollback() May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self.force_reraise() May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise self.value May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application session.commit() May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 05 15:29:53.947975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._prepare_impl() May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self.session.flush() May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._flush(objects) May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application compat.raise_( May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application flush_context.execute() May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rec.execute(self) May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 05 15:29:53.949058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application _emit_insert_statements( May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application result = connection._execute_20( May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ret = self._execute_context( May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 05 15:29:53.950282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self.dialect.do_execute( May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application result = self._query(query) May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application conn.query(q) May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application result.read() May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 05 15:29:53.951274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application packet.raise_for_error() May 05 15:29:53.952299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 05 15:29:53.952299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 05 15:29:53.952299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 05 15:29:53.952299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 05 15:29:53.952299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 05 15:29:53.952299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 05 15:29:53.952299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [parameters: {'user_id': '7d59b2336abc442a83893db8ddf7daca', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 05 15:29:53.952299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 05 15:29:53.952299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:53.952299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:53.952299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:53.952299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:53.952299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:53.952299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:53.952299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 05 15:29:53.958609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 05 15:29:53.961223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 05 15:29:53.961223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 05 15:29:53.961223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 05 15:29:53.961223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 05 15:29:53.961223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 05 15:29:53.961223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:53.961223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 486/975] 10.222.0.58 () {60 vars in 1131 bytes} [Thu May 5 15:29:53 2022] POST /identity/v3/users => generated 160 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:53.963846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa4bbf-4c48-41a0-a805-7635c424ed86 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:54.000846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458c31e-4802-492a-bbed-5e9f987e63c9 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:54.041057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d72e4-f95d-4320-983b-b8d2f2d241da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:54.042688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d72e4-f95d-4320-983b-b8d2f2d241da None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:54.043212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d72e4-f95d-4320-983b-b8d2f2d241da None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:54.043684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d72e4-f95d-4320-983b-b8d2f2d241da None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:54.044688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d72e4-f95d-4320-983b-b8d2f2d241da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:54.045435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d72e4-f95d-4320-983b-b8d2f2d241da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:54.048048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d72e4-f95d-4320-983b-b8d2f2d241da None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:54.064932 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 490/976] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:29:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:54.073649 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d72e4-f95d-4320-983b-b8d2f2d241da None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:54.088083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa4bbf-4c48-41a0-a805-7635c424ed86 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:54.123686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1681f-1e50-4aed-a986-4a6fe6cc0490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:54.124837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1681f-1e50-4aed-a986-4a6fe6cc0490 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:54.125318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1681f-1e50-4aed-a986-4a6fe6cc0490 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:54.125811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1681f-1e50-4aed-a986-4a6fe6cc0490 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:54.134347 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1681f-1e50-4aed-a986-4a6fe6cc0490 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:54.136593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1681f-1e50-4aed-a986-4a6fe6cc0490 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-12d1681f-1e50-4aed-a986-4a6fe6cc0490 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:29:54.152381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:54.153381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:54.154744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:54.154744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:54.154744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:29:54.154744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:29:54.154744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:29:54.154744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:29:54.154744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:29:54.154744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:29:54.154744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 05 15:29:54.154744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:54.157135 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 487/977] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:29:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:54.162530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1681f-1e50-4aed-a986-4a6fe6cc0490 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:54.179679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d72e4-f95d-4320-983b-b8d2f2d241da None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:54.213321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1e92b-95c8-4d2d-a55b-99ff5c25ea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:54.213983 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1e92b-95c8-4d2d-a55b-99ff5c25ea74 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:54.214351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1e92b-95c8-4d2d-a55b-99ff5c25ea74 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:54.214622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1e92b-95c8-4d2d-a55b-99ff5c25ea74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:54.215458 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1e92b-95c8-4d2d-a55b-99ff5c25ea74 None admin] RBAC: Adding query filter params (role.id=edfde1ef46e447c0bf59f670ecfef070, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=a44a128e68d94e34ac3463eb7f1d8f4f) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:54.215750 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1e92b-95c8-4d2d-a55b-99ff5c25ea74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:54.217166 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1e92b-95c8-4d2d-a55b-99ff5c25ea74 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:54.230471 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 491/978] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:29:54 2022] GET /identity/v3/role_assignments?user.id=a44a128e68d94e34ac3463eb7f1d8f4f&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=edfde1ef46e447c0bf59f670ecfef070 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:54.245664 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f065844-5021-4715-928e-e811985b46fb None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:54.245907 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f065844-5021-4715-928e-e811985b46fb None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:54.246635 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f065844-5021-4715-928e-e811985b46fb None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:54.253326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 492/979] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:29:54.254885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc7aa2-d9e3-45d3-8f0d-d5d89e419513 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:54.255289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc7aa2-d9e3-45d3-8f0d-d5d89e419513 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:54.256121 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc7aa2-d9e3-45d3-8f0d-d5d89e419513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:54.273315 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-85dc7aa2-d9e3-45d3-8f0d-d5d89e419513 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:54.274794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-85dc7aa2-d9e3-45d3-8f0d-d5d89e419513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:54.277443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1681f-1e50-4aed-a986-4a6fe6cc0490 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:54.314064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55384af8-1350-4b96-a99c-57c41d51d772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:54.314938 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55384af8-1350-4b96-a99c-57c41d51d772 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:54.315312 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55384af8-1350-4b96-a99c-57c41d51d772 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:54.315714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55384af8-1350-4b96-a99c-57c41d51d772 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:54.316647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55384af8-1350-4b96-a99c-57c41d51d772 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:54.317052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55384af8-1350-4b96-a99c-57c41d51d772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:54.319919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55384af8-1350-4b96-a99c-57c41d51d772 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:54.351846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 493/980] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:54.365428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 488/981] 10.222.0.58 () {56 vars in 1101 bytes} [Thu May 5 15:29:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:54.375329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc7aa2-d9e3-45d3-8f0d-d5d89e419513 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:54.502081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc7aa2-d9e3-45d3-8f0d-d5d89e419513 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:54.555193 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f158c5-2a6e-45bb-9ff6-60cf6acc21ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:54.556057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f158c5-2a6e-45bb-9ff6-60cf6acc21ad None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:54.556422 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f158c5-2a6e-45bb-9ff6-60cf6acc21ad None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:54.556695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f158c5-2a6e-45bb-9ff6-60cf6acc21ad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:54.557401 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f158c5-2a6e-45bb-9ff6-60cf6acc21ad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:54.558828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f158c5-2a6e-45bb-9ff6-60cf6acc21ad None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-c8f158c5-2a6e-45bb-9ff6-60cf6acc21ad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:54.572835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:54.573923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:54.574834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:54.574834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:54.574834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:54.574834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:54.574834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:54.574834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:54.574834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:54.574834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:54.574834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:54.574834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:54.574834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:54.574834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:54.574834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:29:54.574834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:54.574834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 494/982] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 5 15:29:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:54.582203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55384af8-1350-4b96-a99c-57c41d51d772 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:54.683534 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316addb-3467-42dd-9bb2-814d3a9d1e47 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:54.683816 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316addb-3467-42dd-9bb2-814d3a9d1e47 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:54.684099 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316addb-3467-42dd-9bb2-814d3a9d1e47 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:54.685461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 495/983] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:54.690745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa24975-b1d5-4407-b9b6-409a263a024b None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:54.691035 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa24975-b1d5-4407-b9b6-409a263a024b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:54.691315 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa24975-b1d5-4407-b9b6-409a263a024b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:54.692971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55384af8-1350-4b96-a99c-57c41d51d772 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:54.712154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-4aa24975-b1d5-4407-b9b6-409a263a024b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:54.713380 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4aa24975-b1d5-4407-b9b6-409a263a024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:54.730992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359f95c-cae9-44eb-be90-237cd0f155df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:54.731657 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359f95c-cae9-44eb-be90-237cd0f155df None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:54.731939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359f95c-cae9-44eb-be90-237cd0f155df None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:54.732212 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359f95c-cae9-44eb-be90-237cd0f155df None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:54.732907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359f95c-cae9-44eb-be90-237cd0f155df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:54.733207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359f95c-cae9-44eb-be90-237cd0f155df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:54.734608 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359f95c-cae9-44eb-be90-237cd0f155df None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:54.739380 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 489/984] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 5 15:29:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:54.746092 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359f95c-cae9-44eb-be90-237cd0f155df None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:54.790802 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 496/985] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:29:54.813629 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa24975-b1d5-4407-b9b6-409a263a024b None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:54.842860 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359f95c-cae9-44eb-be90-237cd0f155df None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:54.876968 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3231a8-6648-473b-871b-4c734cf44e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:54.877622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3231a8-6648-473b-871b-4c734cf44e93 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:54.877901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3231a8-6648-473b-871b-4c734cf44e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:54.878195 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3231a8-6648-473b-871b-4c734cf44e93 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:54.878894 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3231a8-6648-473b-871b-4c734cf44e93 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:54.879196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3231a8-6648-473b-871b-4c734cf44e93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:54.880537 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3231a8-6648-473b-871b-4c734cf44e93 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:54.885802 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 490/986] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 5 15:29:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:54.891383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3231a8-6648-473b-871b-4c734cf44e93 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:54.911132 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa24975-b1d5-4407-b9b6-409a263a024b None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:54.946444 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34ac18-be6f-493a-8f2b-a4de076463cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:54.947417 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34ac18-be6f-493a-8f2b-a4de076463cd None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:54.948016 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34ac18-be6f-493a-8f2b-a4de076463cd None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:54.948301 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34ac18-be6f-493a-8f2b-a4de076463cd None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:54.949219 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34ac18-be6f-493a-8f2b-a4de076463cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:54.951266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34ac18-be6f-493a-8f2b-a4de076463cd None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:54.966335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 497/987] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 5 15:29:54 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:29:54.987552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3231a8-6648-473b-871b-4c734cf44e93 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:55.033723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a5d28-2ca2-4431-9c0f-9aa7478fd6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:55.034775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a5d28-2ca2-4431-9c0f-9aa7478fd6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:55.035233 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a5d28-2ca2-4431-9c0f-9aa7478fd6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:55.035665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a5d28-2ca2-4431-9c0f-9aa7478fd6a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:55.036698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a5d28-2ca2-4431-9c0f-9aa7478fd6a3 None admin] RBAC: Adding query filter params (interface=admin, service_id=e848957590324131819746138aa3a76f, region_id=RegionOne) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:55.037155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a5d28-2ca2-4431-9c0f-9aa7478fd6a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:55.040239 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a5d28-2ca2-4431-9c0f-9aa7478fd6a3 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:55.046521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 491/988] 10.222.0.58 () {56 vars in 1249 bytes} [Thu May 5 15:29:54 2022] GET /identity/v3/endpoints?service_id=e848957590324131819746138aa3a76f&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:55.051920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34ac18-be6f-493a-8f2b-a4de076463cd None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:55.163023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34ac18-be6f-493a-8f2b-a4de076463cd None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:55.198792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce1929-4495-4312-96ad-7740b5109ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:55.199471 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce1929-4495-4312-96ad-7740b5109ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:55.199755 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce1929-4495-4312-96ad-7740b5109ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:55.200032 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce1929-4495-4312-96ad-7740b5109ba8 None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:55.200721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce1929-4495-4312-96ad-7740b5109ba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:55.202085 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce1929-4495-4312-96ad-7740b5109ba8 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:55.208638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 498/989] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 5 15:29:55 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:29:56.669832 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb2c52-3cfc-4091-8181-a5ac8e4dd105 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:56.670371 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb2c52-3cfc-4091-8181-a5ac8e4dd105 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:56.670449 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb2c52-3cfc-4091-8181-a5ac8e4dd105 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:56.671936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 492/990] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:56.676879 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602cafc-89d3-4427-8c40-7ef3e4de7b27 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:56.677267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602cafc-89d3-4427-8c40-7ef3e4de7b27 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:56.677428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602cafc-89d3-4427-8c40-7ef3e4de7b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:56.694129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-5602cafc-89d3-4427-8c40-7ef3e4de7b27 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:56.696117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-5602cafc-89d3-4427-8c40-7ef3e4de7b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:56.761298 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 499/991] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:56.782881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb2c52-3cfc-4091-8181-a5ac8e4dd105 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:56.882309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb2c52-3cfc-4091-8181-a5ac8e4dd105 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:56.922680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62485173-bf0e-4821-b656-17e2296558b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:56.923472 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62485173-bf0e-4821-b656-17e2296558b0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:56.923752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62485173-bf0e-4821-b656-17e2296558b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:56.924022 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62485173-bf0e-4821-b656-17e2296558b0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:56.924667 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62485173-bf0e-4821-b656-17e2296558b0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:56.930432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62485173-bf0e-4821-b656-17e2296558b0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-62485173-bf0e-4821-b656-17e2296558b0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:56.944333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:56.946102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:56.947554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:56.947554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:56.947554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:56.947554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:56.947554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:56.947554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:56.947554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:56.947554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:56.947554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:56.947554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:56.947554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:56.947554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:56.947554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:29:56.947554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:56.950573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 493/992] 10.222.0.58 () {56 vars in 1105 bytes} [Thu May 5 15:29:56 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:56.951884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602cafc-89d3-4427-8c40-7ef3e4de7b27 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:57.047362 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602cafc-89d3-4427-8c40-7ef3e4de7b27 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:57.084116 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f5ffd-77dc-4387-a61b-5bc56b5d1e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:57.084805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f5ffd-77dc-4387-a61b-5bc56b5d1e48 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:57.085613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f5ffd-77dc-4387-a61b-5bc56b5d1e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:57.085996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f5ffd-77dc-4387-a61b-5bc56b5d1e48 None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:57.086741 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f5ffd-77dc-4387-a61b-5bc56b5d1e48 None admin] RBAC: Adding query filter params (name=image) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:57.087050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f5ffd-77dc-4387-a61b-5bc56b5d1e48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:57.088441 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f5ffd-77dc-4387-a61b-5bc56b5d1e48 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:57.098543 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 500/993] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:57.099589 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62485173-bf0e-4821-b656-17e2296558b0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:57.197436 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62485173-bf0e-4821-b656-17e2296558b0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:57.230714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efe119-d1fd-45af-899f-e984629bc756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:57.231386 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efe119-d1fd-45af-899f-e984629bc756 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:57.231667 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efe119-d1fd-45af-899f-e984629bc756 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:57.231943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efe119-d1fd-45af-899f-e984629bc756 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:57.232648 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efe119-d1fd-45af-899f-e984629bc756 None admin] RBAC: Adding query filter params (type=image) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:57.232953 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efe119-d1fd-45af-899f-e984629bc756 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:57.234383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efe119-d1fd-45af-899f-e984629bc756 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:57.245406 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 494/994] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:29:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:57.250451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc96d1f-b5e9-45e2-b858-9cbc9be5a7b0 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:57.250743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc96d1f-b5e9-45e2-b858-9cbc9be5a7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:57.251014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc96d1f-b5e9-45e2-b858-9cbc9be5a7b0 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:57.252582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 501/995] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:57.260656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff118ea4-9c6a-4f54-b786-f2fee1efacd3 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:57.260656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff118ea4-9c6a-4f54-b786-f2fee1efacd3 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:57.260656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff118ea4-9c6a-4f54-b786-f2fee1efacd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:57.277760 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ff118ea4-9c6a-4f54-b786-f2fee1efacd3 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:57.279749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ff118ea4-9c6a-4f54-b786-f2fee1efacd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:57.354378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 495/996] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:29:57.377833 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc96d1f-b5e9-45e2-b858-9cbc9be5a7b0 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:57.481949 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc96d1f-b5e9-45e2-b858-9cbc9be5a7b0 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:57.484863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3071166-bc3c-4354-8981-592e3a7d97b9 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:57.485144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3071166-bc3c-4354-8981-592e3a7d97b9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:57.485423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3071166-bc3c-4354-8981-592e3a7d97b9 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:57.486998 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 496/997] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:29:57.492297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438ccdb-e0ab-4e4f-b479-d2d95c92736b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:57.492601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438ccdb-e0ab-4e4f-b479-d2d95c92736b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:57.492871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438ccdb-e0ab-4e4f-b479-d2d95c92736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:57.513715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-1438ccdb-e0ab-4e4f-b479-d2d95c92736b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:57.514926 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-1438ccdb-e0ab-4e4f-b479-d2d95c92736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:57.527293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3594c3-a252-4a51-8821-3820c38fd1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:57.528063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3594c3-a252-4a51-8821-3820c38fd1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:57.528381 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3594c3-a252-4a51-8821-3820c38fd1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:57.528658 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3594c3-a252-4a51-8821-3820c38fd1a8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:57.529265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3594c3-a252-4a51-8821-3820c38fd1a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:57.530639 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3594c3-a252-4a51-8821-3820c38fd1a8 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-4b3594c3-a252-4a51-8821-3820c38fd1a8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:57.542415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:57.543467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:57.544524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:57.544524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:29:57.544524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:57.544524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:57.544524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:57.544524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:57.544524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:57.544524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:57.544524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:57.544524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:57.544524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:57.544524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:57.544524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:29:57.544524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:29:57.544524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 502/998] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:29:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:29:57.549431 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3594c3-a252-4a51-8821-3820c38fd1a8 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:57.589236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 497/999] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:29:57.611974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438ccdb-e0ab-4e4f-b479-d2d95c92736b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:57.658208 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3594c3-a252-4a51-8821-3820c38fd1a8 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:57.695629 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460b3e4-5d5f-4f0c-a772-8b2f4b4013ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:57.697049 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460b3e4-5d5f-4f0c-a772-8b2f4b4013ef None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:57.697516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460b3e4-5d5f-4f0c-a772-8b2f4b4013ef None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:57.697987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460b3e4-5d5f-4f0c-a772-8b2f4b4013ef None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:57.698721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460b3e4-5d5f-4f0c-a772-8b2f4b4013ef None admin] RBAC: Adding query filter params (name=compute) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:57.699026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460b3e4-5d5f-4f0c-a772-8b2f4b4013ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:57.700385 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460b3e4-5d5f-4f0c-a772-8b2f4b4013ef None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:57.705115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 503/1000] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 5 15:29:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:57.709383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438ccdb-e0ab-4e4f-b479-d2d95c92736b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:57.710745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460b3e4-5d5f-4f0c-a772-8b2f4b4013ef None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:57.742913 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9b259-c1e3-46e1-8c10-c9b3c52fa897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:57.743740 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9b259-c1e3-46e1-8c10-c9b3c52fa897 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:57.744020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9b259-c1e3-46e1-8c10-c9b3c52fa897 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:57.744291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9b259-c1e3-46e1-8c10-c9b3c52fa897 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:57.745149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9b259-c1e3-46e1-8c10-c9b3c52fa897 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:57.746405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9b259-c1e3-46e1-8c10-c9b3c52fa897 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-06e9b259-c1e3-46e1-8c10-c9b3c52fa897 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:29:57.758714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:29:57.759701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:29:57.760568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:29:57.760568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:29:57.760568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:29:57.760568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:29:57.760568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:29:57.760568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:29:57.760568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:29:57.760568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:29:57.760568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:29:57.760568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:29:57.760568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:29:57.760568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:29:57.760568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 05 15:29:57.760568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:29:57.760568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 498/1001] 10.222.0.58 () {56 vars in 1126 bytes} [Thu May 5 15:29:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:29:57.767368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9b259-c1e3-46e1-8c10-c9b3c52fa897 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:57.812906 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460b3e4-5d5f-4f0c-a772-8b2f4b4013ef None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:57.845923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5756efa-6146-49ef-a017-68d0c5b6d650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:57.846683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5756efa-6146-49ef-a017-68d0c5b6d650 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:57.847238 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5756efa-6146-49ef-a017-68d0c5b6d650 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:57.847512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5756efa-6146-49ef-a017-68d0c5b6d650 None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:57.848206 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5756efa-6146-49ef-a017-68d0c5b6d650 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:57.848507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5756efa-6146-49ef-a017-68d0c5b6d650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:57.849856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5756efa-6146-49ef-a017-68d0c5b6d650 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:57.854763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 504/1002] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 5 15:29:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:29:57.860393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5756efa-6146-49ef-a017-68d0c5b6d650 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:57.868388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9b259-c1e3-46e1-8c10-c9b3c52fa897 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:57.903313 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587b71c-9a6f-417b-9e20-644a890eb5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:57.904382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b71c-9a6f-417b-9e20-644a890eb5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:57.904945 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b71c-9a6f-417b-9e20-644a890eb5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:57.905426 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b71c-9a6f-417b-9e20-644a890eb5e4 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:57.906331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587b71c-9a6f-417b-9e20-644a890eb5e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:57.906784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587b71c-9a6f-417b-9e20-644a890eb5e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:57.908402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587b71c-9a6f-417b-9e20-644a890eb5e4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:57.914885 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 499/1003] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 5 15:29:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:57.920433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587b71c-9a6f-417b-9e20-644a890eb5e4 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:57.967114 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5756efa-6146-49ef-a017-68d0c5b6d650 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:58.008928 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec0d2d-ca00-424a-b130-99e07278112b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:58.009996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec0d2d-ca00-424a-b130-99e07278112b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:58.010815 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec0d2d-ca00-424a-b130-99e07278112b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:58.011374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec0d2d-ca00-424a-b130-99e07278112b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:58.012426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec0d2d-ca00-424a-b130-99e07278112b None admin] RBAC: Adding query filter params (interface=public, service_id=57b1f5461d524ac4b3103e2bafb7a421, region_id=RegionOne) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:58.012899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec0d2d-ca00-424a-b130-99e07278112b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:58.014434 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec0d2d-ca00-424a-b130-99e07278112b None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:58.019017 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587b71c-9a6f-417b-9e20-644a890eb5e4 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:58.019923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 505/1004] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 5 15:29:57 2022] GET /identity/v3/endpoints?service_id=57b1f5461d524ac4b3103e2bafb7a421&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:58.025270 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec0d2d-ca00-424a-b130-99e07278112b None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:58.055499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadeebbb-9017-4e09-8c4f-b748fba7de7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:58.056225 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadeebbb-9017-4e09-8c4f-b748fba7de7b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:58.056506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadeebbb-9017-4e09-8c4f-b748fba7de7b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:58.056773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadeebbb-9017-4e09-8c4f-b748fba7de7b None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:58.057497 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadeebbb-9017-4e09-8c4f-b748fba7de7b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:29:58.057802 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadeebbb-9017-4e09-8c4f-b748fba7de7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:58.059178 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadeebbb-9017-4e09-8c4f-b748fba7de7b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:58.066125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 500/1005] 10.222.0.58 () {56 vars in 1122 bytes} [Thu May 5 15:29:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:29:58.072663 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadeebbb-9017-4e09-8c4f-b748fba7de7b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:58.129111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec0d2d-ca00-424a-b130-99e07278112b None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:58.161955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914e1be-f377-465d-a7d7-e8c7fd6ca3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:58.162653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914e1be-f377-465d-a7d7-e8c7fd6ca3ca None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:58.163472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914e1be-f377-465d-a7d7-e8c7fd6ca3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:58.163758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914e1be-f377-465d-a7d7-e8c7fd6ca3ca None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:58.164433 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914e1be-f377-465d-a7d7-e8c7fd6ca3ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:58.165788 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914e1be-f377-465d-a7d7-e8c7fd6ca3ca None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:58.169510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadeebbb-9017-4e09-8c4f-b748fba7de7b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:58.172798 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 506/1006] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 5 15:29:58 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:29:58.211966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13e6dc-2081-4f73-84c0-c4b86bd83dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:58.212648 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13e6dc-2081-4f73-84c0-c4b86bd83dcd None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:58.212929 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13e6dc-2081-4f73-84c0-c4b86bd83dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:58.213206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13e6dc-2081-4f73-84c0-c4b86bd83dcd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:58.213967 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13e6dc-2081-4f73-84c0-c4b86bd83dcd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:58.215426 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13e6dc-2081-4f73-84c0-c4b86bd83dcd None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:58.232220 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 501/1007] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 5 15:29:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:29:59.534007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c08a8-b311-455b-877e-9690835c9873 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:59.534549 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c08a8-b311-455b-877e-9690835c9873 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:59.534754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c08a8-b311-455b-877e-9690835c9873 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:59.536245 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 507/1008] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:29:59.542260 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab15427-cbf1-4c39-ad74-d97f76833941 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:59.542674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab15427-cbf1-4c39-ad74-d97f76833941 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:59.542837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab15427-cbf1-4c39-ad74-d97f76833941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:59.562358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-2ab15427-cbf1-4c39-ad74-d97f76833941 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:29:59.563568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-2ab15427-cbf1-4c39-ad74-d97f76833941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:29:59.635821 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 502/1009] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:29:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:29:59.659137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c08a8-b311-455b-877e-9690835c9873 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:29:59.760401 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c08a8-b311-455b-877e-9690835c9873 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:29:59.792650 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f605b4-0c38-481e-8c34-7be97c086ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:29:59.793227 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f605b4-0c38-481e-8c34-7be97c086ace None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:29:59.793505 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f605b4-0c38-481e-8c34-7be97c086ace None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:29:59.793778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f605b4-0c38-481e-8c34-7be97c086ace None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:29:59.794523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f605b4-0c38-481e-8c34-7be97c086ace None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:29:59.795870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f605b4-0c38-481e-8c34-7be97c086ace None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:29:59.809885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 508/1010] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 5 15:29:59 2022] POST /identity/v3/services => generated 242 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:00.449739 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38168-cb60-4636-a05c-3e1b68d17a79 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:00.450452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38168-cb60-4636-a05c-3e1b68d17a79 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:00.450940 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38168-cb60-4636-a05c-3e1b68d17a79 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:00.452733 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 503/1011] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:00.457624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465dd48-c19a-4e24-8ece-7d7ffe296bf2 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:00.458114 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465dd48-c19a-4e24-8ece-7d7ffe296bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:00.458602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465dd48-c19a-4e24-8ece-7d7ffe296bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:00.476154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-3465dd48-c19a-4e24-8ece-7d7ffe296bf2 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:00.477611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-3465dd48-c19a-4e24-8ece-7d7ffe296bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:00.552234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 509/1012] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:00 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:00.559549 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212681f-1431-429d-9cb2-b2656c92676a None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:00.559996 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212681f-1431-429d-9cb2-b2656c92676a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:00.560173 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212681f-1431-429d-9cb2-b2656c92676a None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:00.561584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 504/1013] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:00.566708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d50f5e-f642-43f5-aaad-e499ecdcb62c None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:00.566995 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d50f5e-f642-43f5-aaad-e499ecdcb62c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:00.567267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d50f5e-f642-43f5-aaad-e499ecdcb62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:00.576079 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212681f-1431-429d-9cb2-b2656c92676a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:00.587084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-e0d50f5e-f642-43f5-aaad-e499ecdcb62c None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:00.588258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e0d50f5e-f642-43f5-aaad-e499ecdcb62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:00.655091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 510/1014] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:00 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:30:00.676245 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212681f-1431-429d-9cb2-b2656c92676a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:00.678194 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d50f5e-f642-43f5-aaad-e499ecdcb62c None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:00.711518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb23ac-f414-4b7a-a088-87eb3755071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:00.712244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb23ac-f414-4b7a-a088-87eb3755071d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:00.712526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb23ac-f414-4b7a-a088-87eb3755071d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:00.712801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb23ac-f414-4b7a-a088-87eb3755071d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:00.713447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb23ac-f414-4b7a-a088-87eb3755071d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:00.714848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb23ac-f414-4b7a-a088-87eb3755071d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-fcfb23ac-f414-4b7a-a088-87eb3755071d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:00.727970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:00.728992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:00.729822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:00.729822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:30:00.729822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:00.729822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:00.729822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:00.729822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:00.729822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:00.729822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:00.729822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:00.729822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:00.729822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:30:00.729822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:30:00.729822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 05 15:30:00.729822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:00.729822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 505/1015] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:30:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:30:00.735006 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb23ac-f414-4b7a-a088-87eb3755071d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:00.778884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d50f5e-f642-43f5-aaad-e499ecdcb62c None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:00.813262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2a8a0-4cbd-402c-8b4b-070f1a9ccfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:00.814051 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2a8a0-4cbd-402c-8b4b-070f1a9ccfbe None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:00.814357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2a8a0-4cbd-402c-8b4b-070f1a9ccfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:00.814629 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2a8a0-4cbd-402c-8b4b-070f1a9ccfbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:00.815779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2a8a0-4cbd-402c-8b4b-070f1a9ccfbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:00.817194 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2a8a0-4cbd-402c-8b4b-070f1a9ccfbe None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:00.822488 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 511/1016] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:00.824508 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2a8a0-4cbd-402c-8b4b-070f1a9ccfbe None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:00.835445 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb23ac-f414-4b7a-a088-87eb3755071d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:00.870983 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae5de6-caa9-41e4-94b4-725d45294ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:00.871655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae5de6-caa9-41e4-94b4-725d45294ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:00.871944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae5de6-caa9-41e4-94b4-725d45294ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:00.872226 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae5de6-caa9-41e4-94b4-725d45294ac6 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:00.872933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae5de6-caa9-41e4-94b4-725d45294ac6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:00.873244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae5de6-caa9-41e4-94b4-725d45294ac6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:00.874657 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae5de6-caa9-41e4-94b4-725d45294ac6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:00.879644 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 506/1017] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 5 15:30:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:00.885355 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae5de6-caa9-41e4-94b4-725d45294ac6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:00.925491 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2a8a0-4cbd-402c-8b4b-070f1a9ccfbe None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:00.959657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63385b-fe8b-47d6-8d80-597dd94b338d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:00.960722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63385b-fe8b-47d6-8d80-597dd94b338d None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:00.961013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63385b-fe8b-47d6-8d80-597dd94b338d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:00.961292 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63385b-fe8b-47d6-8d80-597dd94b338d None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:00.962086 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63385b-fe8b-47d6-8d80-597dd94b338d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:00.963702 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63385b-fe8b-47d6-8d80-597dd94b338d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:00.992182 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 512/1018] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 5 15:30:00 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:30:01.009325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae5de6-caa9-41e4-94b4-725d45294ac6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:01.046856 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0947a8-80d0-4fda-8d9d-bc82a0a871ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:01.047861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0947a8-80d0-4fda-8d9d-bc82a0a871ec None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:01.048320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0947a8-80d0-4fda-8d9d-bc82a0a871ec None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:01.048796 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0947a8-80d0-4fda-8d9d-bc82a0a871ec None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:01.049693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0947a8-80d0-4fda-8d9d-bc82a0a871ec None admin] RBAC: Adding query filter params (type=compute) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:01.050215 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0947a8-80d0-4fda-8d9d-bc82a0a871ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:01.051812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0947a8-80d0-4fda-8d9d-bc82a0a871ec None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:01.058042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 507/1019] 10.222.0.58 () {56 vars in 1112 bytes} [Thu May 5 15:30:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:01.063731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63385b-fe8b-47d6-8d80-597dd94b338d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:01.167481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63385b-fe8b-47d6-8d80-597dd94b338d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:01.202725 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce265a-2414-4e4d-8787-3bd3ce22f016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:01.203934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce265a-2414-4e4d-8787-3bd3ce22f016 None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:01.203934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce265a-2414-4e4d-8787-3bd3ce22f016 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:01.203934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce265a-2414-4e4d-8787-3bd3ce22f016 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:01.205078 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce265a-2414-4e4d-8787-3bd3ce22f016 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:01.206258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce265a-2414-4e4d-8787-3bd3ce22f016 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:01.226522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 513/1020] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 5 15:30:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:02.117794 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59f8d2-bbb2-4e09-aa48-a7f1e5691c21 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:02.118346 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59f8d2-bbb2-4e09-aa48-a7f1e5691c21 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:02.118423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59f8d2-bbb2-4e09-aa48-a7f1e5691c21 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:02.119805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 508/1021] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:02.125149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e36281-a1d1-47da-948f-898db71a0b5b None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:02.125584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e36281-a1d1-47da-948f-898db71a0b5b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:02.125788 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e36281-a1d1-47da-948f-898db71a0b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:02.143259 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-80e36281-a1d1-47da-948f-898db71a0b5b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:02.144138 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-80e36281-a1d1-47da-948f-898db71a0b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:02.223425 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 514/1022] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:02.248061 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59f8d2-bbb2-4e09-aa48-a7f1e5691c21 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:02.348193 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59f8d2-bbb2-4e09-aa48-a7f1e5691c21 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:02.380105 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dd1cc-ea82-460c-bc63-fb08d1364d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:02.380806 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dd1cc-ea82-460c-bc63-fb08d1364d9f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:02.381081 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dd1cc-ea82-460c-bc63-fb08d1364d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:02.381390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dd1cc-ea82-460c-bc63-fb08d1364d9f None admin] PATH_INFO: `/v3/services/image` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:02.382253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dd1cc-ea82-460c-bc63-fb08d1364d9f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:02.383591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dd1cc-ea82-460c-bc63-fb08d1364d9f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-1f5dd1cc-ea82-460c-bc63-fb08d1364d9f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:02.394942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:02.395925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:02.396753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:02.396753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:30:02.396753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:02.396753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:02.396753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:02.396753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:02.396753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:02.396753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:02.396753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:02.396753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:02.396753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:30:02.396753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:30:02.396753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:30:02.396753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:02.396753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 509/1023] 10.222.0.58 () {56 vars in 1105 bytes} [Thu May 5 15:30:02 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:30:02.404119 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e36281-a1d1-47da-948f-898db71a0b5b None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:02.512076 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e36281-a1d1-47da-948f-898db71a0b5b None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:02.545442 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99364d09-bad3-4621-a1f1-2fcc30a5f808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:02.546102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99364d09-bad3-4621-a1f1-2fcc30a5f808 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:02.546422 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99364d09-bad3-4621-a1f1-2fcc30a5f808 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:02.546696 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99364d09-bad3-4621-a1f1-2fcc30a5f808 None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:02.547390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99364d09-bad3-4621-a1f1-2fcc30a5f808 None admin] RBAC: Adding query filter params (name=image) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:02.547699 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99364d09-bad3-4621-a1f1-2fcc30a5f808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:02.549050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99364d09-bad3-4621-a1f1-2fcc30a5f808 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:02.558736 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 515/1024] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:02.559678 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dd1cc-ea82-460c-bc63-fb08d1364d9f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:02.655993 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dd1cc-ea82-460c-bc63-fb08d1364d9f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:02.687150 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28e380-6a93-47ce-8be0-b55d100ddd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:02.687807 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28e380-6a93-47ce-8be0-b55d100ddd92 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:02.688088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28e380-6a93-47ce-8be0-b55d100ddd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:02.688353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28e380-6a93-47ce-8be0-b55d100ddd92 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:02.689050 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28e380-6a93-47ce-8be0-b55d100ddd92 None admin] RBAC: Adding query filter params (type=image) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:02.689349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28e380-6a93-47ce-8be0-b55d100ddd92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:02.690727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28e380-6a93-47ce-8be0-b55d100ddd92 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:02.695898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 510/1025] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:02.701729 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99364d09-bad3-4621-a1f1-2fcc30a5f808 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:02.798084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99364d09-bad3-4621-a1f1-2fcc30a5f808 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:02.830848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51e23e-eecf-42aa-8b92-c42943353336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:02.831497 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51e23e-eecf-42aa-8b92-c42943353336 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:02.831776 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51e23e-eecf-42aa-8b92-c42943353336 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:02.832043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51e23e-eecf-42aa-8b92-c42943353336 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:02.832812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51e23e-eecf-42aa-8b92-c42943353336 None admin] RBAC: Adding query filter params (interface=public, service_id=f41f1407a7f44297ac220b1c531656b8, region_id=RegionOne) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:02.833114 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51e23e-eecf-42aa-8b92-c42943353336 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:02.834516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51e23e-eecf-42aa-8b92-c42943353336 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:02.844153 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 516/1026] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 5 15:30:02 2022] GET /identity/v3/endpoints?service_id=f41f1407a7f44297ac220b1c531656b8&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:02.845667 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28e380-6a93-47ce-8be0-b55d100ddd92 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:02.941714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28e380-6a93-47ce-8be0-b55d100ddd92 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:02.974087 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be4ad9-0085-401d-a143-2fcf89dc499c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:02.974782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be4ad9-0085-401d-a143-2fcf89dc499c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:02.975060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be4ad9-0085-401d-a143-2fcf89dc499c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:02.975622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be4ad9-0085-401d-a143-2fcf89dc499c None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:02.976305 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be4ad9-0085-401d-a143-2fcf89dc499c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:02.977649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be4ad9-0085-401d-a143-2fcf89dc499c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:02.984148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 511/1027] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 5 15:30:02 2022] GET /identity/v3/services => generated 1957 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:30:03.426725 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7756d8-c41d-41b8-bc93-698ddf93287f None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:03.427242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7756d8-c41d-41b8-bc93-698ddf93287f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:03.427242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7756d8-c41d-41b8-bc93-698ddf93287f None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:03.429423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 517/1028] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:03.434366 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a7345-8484-423f-bd63-395d9a1c3b88 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:03.434742 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a7345-8484-423f-bd63-395d9a1c3b88 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:03.434902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a7345-8484-423f-bd63-395d9a1c3b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:03.452073 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-836a7345-8484-423f-bd63-395d9a1c3b88 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:03.453287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-836a7345-8484-423f-bd63-395d9a1c3b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:03.526212 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 512/1029] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:03.549822 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7756d8-c41d-41b8-bc93-698ddf93287f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:03.643580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd67fea-b1e4-40f4-b984-4e2ee26992bd None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:03.643921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd67fea-b1e4-40f4-b984-4e2ee26992bd None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:03.644133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd67fea-b1e4-40f4-b984-4e2ee26992bd None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:03.645614 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 513/1030] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:03.650338 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d840d-0601-4df8-9bfe-a841d99624ab None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:03.650624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d840d-0601-4df8-9bfe-a841d99624ab None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:03.650901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d840d-0601-4df8-9bfe-a841d99624ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:03.652438 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7756d8-c41d-41b8-bc93-698ddf93287f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:03.667116 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-951d840d-0601-4df8-9bfe-a841d99624ab None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:03.668396 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-951d840d-0601-4df8-9bfe-a841d99624ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:03.686239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e405823-f0a0-435a-a482-6b78652483c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:03.686949 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e405823-f0a0-435a-a482-6b78652483c7 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:03.687231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e405823-f0a0-435a-a482-6b78652483c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:03.687502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e405823-f0a0-435a-a482-6b78652483c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:03.688675 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e405823-f0a0-435a-a482-6b78652483c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:03.690098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e405823-f0a0-435a-a482-6b78652483c7 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:03.691882 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 518/1031] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:03.697894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e405823-f0a0-435a-a482-6b78652483c7 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:03.742680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 514/1032] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:30:03.766478 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d840d-0601-4df8-9bfe-a841d99624ab None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:03.795932 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e405823-f0a0-435a-a482-6b78652483c7 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:03.830838 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65673c5-c2b7-424c-a206-ed565c9b98d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:03.831503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65673c5-c2b7-424c-a206-ed565c9b98d0 None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:03.831780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65673c5-c2b7-424c-a206-ed565c9b98d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:03.832048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65673c5-c2b7-424c-a206-ed565c9b98d0 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:03.832743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65673c5-c2b7-424c-a206-ed565c9b98d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:03.834154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65673c5-c2b7-424c-a206-ed565c9b98d0 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:03.854548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 519/1033] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:30:03 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:30:03.867337 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d840d-0601-4df8-9bfe-a841d99624ab None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:03.906632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befe37e-9fc9-4645-8712-82ab42c59a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:03.907776 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befe37e-9fc9-4645-8712-82ab42c59a3a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:03.908275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befe37e-9fc9-4645-8712-82ab42c59a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:03.908729 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befe37e-9fc9-4645-8712-82ab42c59a3a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:03.921759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befe37e-9fc9-4645-8712-82ab42c59a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9befe37e-9fc9-4645-8712-82ab42c59a3a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:30:03.930604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:03.931646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:03.932499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:03.932499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:03.932499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:03.932499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:03.932499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:30:03.932499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:30:03.932499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:30:03.932499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:30:03.932499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:30:03.932499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:30:03.932499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:30:03.932499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:03.934668 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 515/1034] 10.222.0.58 () {56 vars in 1120 bytes} [Thu May 5 15:30:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:30:03.940789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65673c5-c2b7-424c-a206-ed565c9b98d0 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:04.048105 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65673c5-c2b7-424c-a206-ed565c9b98d0 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:04.085452 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9abba6-acb2-4044-aa6a-9233bfbb7714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:04.086121 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9abba6-acb2-4044-aa6a-9233bfbb7714 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:04.086445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9abba6-acb2-4044-aa6a-9233bfbb7714 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:04.086714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9abba6-acb2-4044-aa6a-9233bfbb7714 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:04.087629 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9abba6-acb2-4044-aa6a-9233bfbb7714 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:04.087734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9abba6-acb2-4044-aa6a-9233bfbb7714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:04.089082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9abba6-acb2-4044-aa6a-9233bfbb7714 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:04.097583 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 520/1035] 10.222.0.58 () {56 vars in 1115 bytes} [Thu May 5 15:30:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:04.103782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befe37e-9fc9-4645-8712-82ab42c59a3a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:04.208040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befe37e-9fc9-4645-8712-82ab42c59a3a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:04.240578 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d04b4b-7347-4758-ab87-3a06e41e2440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:04.241596 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d04b4b-7347-4758-ab87-3a06e41e2440 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:04.241881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d04b4b-7347-4758-ab87-3a06e41e2440 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:04.242159 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d04b4b-7347-4758-ab87-3a06e41e2440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:04.252716 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d04b4b-7347-4758-ab87-3a06e41e2440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:04.254156 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d04b4b-7347-4758-ab87-3a06e41e2440 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:04.271582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-65d04b4b-7347-4758-ab87-3a06e41e2440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:30:04.271582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:04.271582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:04.271582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:04.271582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:04.271582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:04.271582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:04.271582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:04.271582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:04.271582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:04.271582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:04.271582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:04.271582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:30:04.271582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:30:04.271582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:04.272579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:04.273467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:30:04.273467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:30:04.273467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:30:04.273467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:04.274247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 516/1036] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:30:04.279457 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9abba6-acb2-4044-aa6a-9233bfbb7714 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:04.377253 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9abba6-acb2-4044-aa6a-9233bfbb7714 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:04.410401 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccac99-61a4-4c0c-bac5-06d2df5001ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:04.411068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccac99-61a4-4c0c-bac5-06d2df5001ee None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:04.411346 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccac99-61a4-4c0c-bac5-06d2df5001ee None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:04.411616 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccac99-61a4-4c0c-bac5-06d2df5001ee None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:04.412325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccac99-61a4-4c0c-bac5-06d2df5001ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:04.413194 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccac99-61a4-4c0c-bac5-06d2df5001ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:04.414577 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccac99-61a4-4c0c-bac5-06d2df5001ee None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:04.426015 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 521/1037] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:04.431722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d04b4b-7347-4758-ab87-3a06e41e2440 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:04.545801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d04b4b-7347-4758-ab87-3a06e41e2440 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:04.579421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c2a91-7cbe-4b8e-88fc-ad5a7e218687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:04.580285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c2a91-7cbe-4b8e-88fc-ad5a7e218687 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:04.580507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c2a91-7cbe-4b8e-88fc-ad5a7e218687 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:04.580757 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c2a91-7cbe-4b8e-88fc-ad5a7e218687 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:04.589459 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c2a91-7cbe-4b8e-88fc-ad5a7e218687 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:04.590920 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c2a91-7cbe-4b8e-88fc-ad5a7e218687 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-f27c2a91-7cbe-4b8e-88fc-ad5a7e218687 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:30:04.606111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:04.607204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:04.608197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:04.608197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:04.608197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:30:04.608197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:30:04.608197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:30:04.608197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:30:04.608197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:30:04.608197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:30:04.608197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:30:04.608197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:04.610249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 517/1038] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 5 15:30:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:30:04.615452 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccac99-61a4-4c0c-bac5-06d2df5001ee None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:04.713847 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccac99-61a4-4c0c-bac5-06d2df5001ee None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:04.748920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50edd33-9fe9-4f6e-99e1-1ce368abe5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:04.749590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50edd33-9fe9-4f6e-99e1-1ce368abe5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:04.749870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50edd33-9fe9-4f6e-99e1-1ce368abe5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:04.750141 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50edd33-9fe9-4f6e-99e1-1ce368abe5d9 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:04.750996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50edd33-9fe9-4f6e-99e1-1ce368abe5d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:04.751299 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50edd33-9fe9-4f6e-99e1-1ce368abe5d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:04.752766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50edd33-9fe9-4f6e-99e1-1ce368abe5d9 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:04.775434 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 522/1039] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 5 15:30:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:04.776557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c2a91-7cbe-4b8e-88fc-ad5a7e218687 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:04.872470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c2a91-7cbe-4b8e-88fc-ad5a7e218687 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:04.905124 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc55877-0000-4b72-ae18-d70f0436fdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:04.905771 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc55877-0000-4b72-ae18-d70f0436fdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:04.906055 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc55877-0000-4b72-ae18-d70f0436fdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:04.906352 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc55877-0000-4b72-ae18-d70f0436fdc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:04.969446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc55877-0000-4b72-ae18-d70f0436fdc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:04.970900 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc55877-0000-4b72-ae18-d70f0436fdc0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:05.070737 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 518/1040] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:30:04 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 15:30:05.072418 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50edd33-9fe9-4f6e-99e1-1ce368abe5d9 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:05.172485 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50edd33-9fe9-4f6e-99e1-1ce368abe5d9 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:05.204651 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960991f-3b09-487a-9a04-4bf16fd664bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:05.205434 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960991f-3b09-487a-9a04-4bf16fd664bf None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:05.205714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960991f-3b09-487a-9a04-4bf16fd664bf None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:05.205988 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960991f-3b09-487a-9a04-4bf16fd664bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:05.216064 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960991f-3b09-487a-9a04-4bf16fd664bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:05.217486 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960991f-3b09-487a-9a04-4bf16fd664bf None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:05.234329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-2960991f-3b09-487a-9a04-4bf16fd664bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:30:05.234329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:05.234329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:05.234329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:05.234329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:05.234329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:05.234329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:05.234329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:05.234329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:05.234329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:05.234329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:05.234329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:05.234329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:30:05.234329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:30:05.234329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:05.235212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:05.236102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:30:05.236102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:30:05.236102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:30:05.236102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:30:05.240126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 523/1041] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:30:05.242199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc55877-0000-4b72-ae18-d70f0436fdc0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:05.286905 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e3e0a-6f8a-4e62-ad4b-56b5f942b241 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:05.287216 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e3e0a-6f8a-4e62-ad4b-56b5f942b241 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:05.287745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e3e0a-6f8a-4e62-ad4b-56b5f942b241 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:05.289142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 524/1042] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:30:05.294112 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90f62-0913-486a-a23f-3e3cb0ae8979 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:05.294673 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90f62-0913-486a-a23f-3e3cb0ae8979 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:05.294955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90f62-0913-486a-a23f-3e3cb0ae8979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:05.311547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-43a90f62-0913-486a-a23f-3e3cb0ae8979 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:05.312720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-43a90f62-0913-486a-a23f-3e3cb0ae8979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:05.338693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc55877-0000-4b72-ae18-d70f0436fdc0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:05.372462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b45700-417e-4240-96f0-8987133160d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:05.373123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b45700-417e-4240-96f0-8987133160d2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:05.373397 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b45700-417e-4240-96f0-8987133160d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:05.373666 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b45700-417e-4240-96f0-8987133160d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:05.374406 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b45700-417e-4240-96f0-8987133160d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:05.374708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b45700-417e-4240-96f0-8987133160d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:05.376060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b45700-417e-4240-96f0-8987133160d2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:05.382052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 525/1043] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:05.392334 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 519/1044] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:05.393835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a90f62-0913-486a-a23f-3e3cb0ae8979 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:05.404479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b45700-417e-4240-96f0-8987133160d2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:05.490106 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a90f62-0913-486a-a23f-3e3cb0ae8979 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:05.503165 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b45700-417e-4240-96f0-8987133160d2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:05.531315 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31442b1-98e6-42c9-ac50-a9ee915e9b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:05.532108 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31442b1-98e6-42c9-ac50-a9ee915e9b04 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:05.532391 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31442b1-98e6-42c9-ac50-a9ee915e9b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:05.532664 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31442b1-98e6-42c9-ac50-a9ee915e9b04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:05.538647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d5e3a-3cf5-46f3-b671-2525be1941a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:05.539427 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d5e3a-3cf5-46f3-b671-2525be1941a4 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:05.539598 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31442b1-98e6-42c9-ac50-a9ee915e9b04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:05.539701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d5e3a-3cf5-46f3-b671-2525be1941a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:05.539962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d5e3a-3cf5-46f3-b671-2525be1941a4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:05.540604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d5e3a-3cf5-46f3-b671-2525be1941a4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:05.541008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31442b1-98e6-42c9-ac50-a9ee915e9b04 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:05.541932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d5e3a-3cf5-46f3-b671-2525be1941a4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-0a0d5e3a-3cf5-46f3-b671-2525be1941a4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:05.553032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:05.554726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:05.555546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:05.555546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:30:05.555546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:05.555546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:05.555546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:05.555546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:05.555546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:05.555546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:05.555546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:05.555546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:05.555546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:30:05.555546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:30:05.555546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 05 15:30:05.555546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:05.555546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 520/1045] 10.222.0.58 () {56 vars in 1105 bytes} [Thu May 5 15:30:05 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:30:05.556894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-c31442b1-98e6-42c9-ac50-a9ee915e9b04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:30:05.556894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:05.556894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:05.556894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:05.556894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:05.556894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:05.556894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:05.556894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:05.556894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:05.556894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:05.556894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:05.556894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:05.556894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:30:05.556894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:30:05.556894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:05.557760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:05.558669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:30:05.558669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:30:05.558669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:30:05.558669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:30:05.558669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:30:05.558669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:30:05.558669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:30:05.558669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:30:05.558669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 526/1046] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:30:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:30:05.559988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d5e3a-3cf5-46f3-b671-2525be1941a4 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:05.563870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31442b1-98e6-42c9-ac50-a9ee915e9b04 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:05.665459 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d5e3a-3cf5-46f3-b671-2525be1941a4 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:05.671389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31442b1-98e6-42c9-ac50-a9ee915e9b04 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:05.699009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba9983-3fda-43f7-90c0-6201ed5cc4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:05.699674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba9983-3fda-43f7-90c0-6201ed5cc4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:05.699956 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba9983-3fda-43f7-90c0-6201ed5cc4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:05.700236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba9983-3fda-43f7-90c0-6201ed5cc4e1 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:05.700935 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba9983-3fda-43f7-90c0-6201ed5cc4e1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:05.701239 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba9983-3fda-43f7-90c0-6201ed5cc4e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:05.702632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba9983-3fda-43f7-90c0-6201ed5cc4e1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:05.712132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 521/1047] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:05.712377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e677dbd-7810-41a6-9c30-f1d67401033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:05.712377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e677dbd-7810-41a6-9c30-f1d67401033d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:05.712551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e677dbd-7810-41a6-9c30-f1d67401033d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:05.712797 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e677dbd-7810-41a6-9c30-f1d67401033d None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:05.713170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba9983-3fda-43f7-90c0-6201ed5cc4e1 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:05.713545 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e677dbd-7810-41a6-9c30-f1d67401033d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:05.713857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e677dbd-7810-41a6-9c30-f1d67401033d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:05.715317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e677dbd-7810-41a6-9c30-f1d67401033d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:05.728659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 527/1048] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:30:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:05.734713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e677dbd-7810-41a6-9c30-f1d67401033d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:05.811155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba9983-3fda-43f7-90c0-6201ed5cc4e1 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:05.840515 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e677dbd-7810-41a6-9c30-f1d67401033d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:05.843647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54732d-409b-4fec-aa54-c2b888f6f671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:05.844313 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54732d-409b-4fec-aa54-c2b888f6f671 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:05.844596 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54732d-409b-4fec-aa54-c2b888f6f671 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:05.844872 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54732d-409b-4fec-aa54-c2b888f6f671 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:05.845581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54732d-409b-4fec-aa54-c2b888f6f671 None admin] RBAC: Adding query filter params (type=image) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:05.845888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54732d-409b-4fec-aa54-c2b888f6f671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:05.847610 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54732d-409b-4fec-aa54-c2b888f6f671 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:05.853033 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 522/1049] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:05.858591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54732d-409b-4fec-aa54-c2b888f6f671 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:05.876361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a472de-a0bd-4ab7-99dc-b5d2ef3cd40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:05.877016 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a472de-a0bd-4ab7-99dc-b5d2ef3cd40e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:05.877299 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a472de-a0bd-4ab7-99dc-b5d2ef3cd40e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:05.877577 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a472de-a0bd-4ab7-99dc-b5d2ef3cd40e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:05.878436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a472de-a0bd-4ab7-99dc-b5d2ef3cd40e None admin] RBAC: Adding query filter params (role.id=edfde1ef46e447c0bf59f670ecfef070, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=2a29a4b1b1aa45aea2e466d8f8b79365) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:05.878747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a472de-a0bd-4ab7-99dc-b5d2ef3cd40e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:05.880167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a472de-a0bd-4ab7-99dc-b5d2ef3cd40e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:05.885746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 528/1050] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:30:05 2022] GET /identity/v3/role_assignments?user.id=2a29a4b1b1aa45aea2e466d8f8b79365&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=edfde1ef46e447c0bf59f670ecfef070 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:05.971095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54732d-409b-4fec-aa54-c2b888f6f671 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:06.009450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca55646-ccfd-4361-a704-ffdb4155a79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:06.010519 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca55646-ccfd-4361-a704-ffdb4155a79e None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:06.010987 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca55646-ccfd-4361-a704-ffdb4155a79e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:06.011444 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca55646-ccfd-4361-a704-ffdb4155a79e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:06.012434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca55646-ccfd-4361-a704-ffdb4155a79e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:06.014080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca55646-ccfd-4361-a704-ffdb4155a79e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:06.036241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 523/1051] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 5 15:30:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:30:06.198641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ca483-e484-4d40-845e-e2bd7d71df1e None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:06.198981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ca483-e484-4d40-845e-e2bd7d71df1e None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:06.199204 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ca483-e484-4d40-845e-e2bd7d71df1e None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:06.200603 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 529/1052] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:06.206274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffd061-a02a-4a25-b7dd-7bdc1eae1c74 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:06.206568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffd061-a02a-4a25-b7dd-7bdc1eae1c74 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:06.206842 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffd061-a02a-4a25-b7dd-7bdc1eae1c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:06.223917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d2ffd061-a02a-4a25-b7dd-7bdc1eae1c74 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:06.225631 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d2ffd061-a02a-4a25-b7dd-7bdc1eae1c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:06.309167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 524/1053] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:06.331919 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ca483-e484-4d40-845e-e2bd7d71df1e None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:06.428858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ca483-e484-4d40-845e-e2bd7d71df1e None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:06.460667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106bd24-f847-4cf1-9398-ec42ccc1980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:06.461442 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106bd24-f847-4cf1-9398-ec42ccc1980b None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:06.461714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106bd24-f847-4cf1-9398-ec42ccc1980b None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:06.461979 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106bd24-f847-4cf1-9398-ec42ccc1980b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:06.472091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106bd24-f847-4cf1-9398-ec42ccc1980b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-9106bd24-f847-4cf1-9398-ec42ccc1980b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:30:06.480490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:06.481556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:06.487841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:06.487841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:06.487841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:06.487841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:06.487841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:30:06.487841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:30:06.487841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:30:06.487841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:30:06.487841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:30:06.487841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:30:06.487841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:06.487841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:30:06.487841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 530/1054] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:30:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:30:06.489629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffd061-a02a-4a25-b7dd-7bdc1eae1c74 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:06.596305 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffd061-a02a-4a25-b7dd-7bdc1eae1c74 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:06.630670 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c13a85-653b-47b0-a942-ab989d4f70e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:06.631985 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c13a85-653b-47b0-a942-ab989d4f70e0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:06.632265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c13a85-653b-47b0-a942-ab989d4f70e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:06.632606 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c13a85-653b-47b0-a942-ab989d4f70e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:06.633175 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c13a85-653b-47b0-a942-ab989d4f70e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:06.633473 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c13a85-653b-47b0-a942-ab989d4f70e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:06.634845 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c13a85-653b-47b0-a942-ab989d4f70e0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:06.648129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 525/1055] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:30:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:06.649378 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106bd24-f847-4cf1-9398-ec42ccc1980b None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:06.748862 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106bd24-f847-4cf1-9398-ec42ccc1980b None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:06.782590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7bb05-9f0f-4dd8-88f1-c50b67da0a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:06.783471 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7bb05-9f0f-4dd8-88f1-c50b67da0a80 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:06.783753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7bb05-9f0f-4dd8-88f1-c50b67da0a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:06.784026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7bb05-9f0f-4dd8-88f1-c50b67da0a80 None admin] PATH_INFO: `/v3/users/068fa6040e704a77b7b95533da265462` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:06.797879 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7bb05-9f0f-4dd8-88f1-c50b67da0a80 None admin] RBAC: Authorizing `identity:get_user(user_id=068fa6040e704a77b7b95533da265462)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:06.799350 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7bb05-9f0f-4dd8-88f1-c50b67da0a80 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:06.801175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 531/1056] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:30:06 2022] GET /identity/v3/users/068fa6040e704a77b7b95533da265462 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:06.808033 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c13a85-653b-47b0-a942-ab989d4f70e0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:06.906208 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c13a85-653b-47b0-a942-ab989d4f70e0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:06.938844 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5774b-6f7e-4465-8cfa-76d1da1468a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:06.939492 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5774b-6f7e-4465-8cfa-76d1da1468a6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:06.939780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5774b-6f7e-4465-8cfa-76d1da1468a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:06.940098 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5774b-6f7e-4465-8cfa-76d1da1468a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:07.004580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5774b-6f7e-4465-8cfa-76d1da1468a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:07.005926 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5774b-6f7e-4465-8cfa-76d1da1468a6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:07.106045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 526/1057] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:30:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 15:30:07.107355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7bb05-9f0f-4dd8-88f1-c50b67da0a80 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:07.201369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7bb05-9f0f-4dd8-88f1-c50b67da0a80 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:07.236283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ea3de-b3c6-4bbd-ba43-03cea3239752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:07.237132 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ea3de-b3c6-4bbd-ba43-03cea3239752 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:07.237410 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ea3de-b3c6-4bbd-ba43-03cea3239752 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:07.237680 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ea3de-b3c6-4bbd-ba43-03cea3239752 None admin] PATH_INFO: `/v3/projects/4f260d476e5646d2a07d75871106f92c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:07.238915 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ea3de-b3c6-4bbd-ba43-03cea3239752 None admin] RBAC: Authorizing `identity:get_project(project_id=4f260d476e5646d2a07d75871106f92c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:07.240437 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ea3de-b3c6-4bbd-ba43-03cea3239752 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:07.247154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 532/1058] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:30:07 2022] GET /identity/v3/projects/4f260d476e5646d2a07d75871106f92c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:07.248268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5774b-6f7e-4465-8cfa-76d1da1468a6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:07.343065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5774b-6f7e-4465-8cfa-76d1da1468a6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:07.375370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a388cf-2d4e-4ede-85cb-fe83c694d87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:07.376018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a388cf-2d4e-4ede-85cb-fe83c694d87f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:07.376300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a388cf-2d4e-4ede-85cb-fe83c694d87f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:07.376577 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a388cf-2d4e-4ede-85cb-fe83c694d87f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:07.377398 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a388cf-2d4e-4ede-85cb-fe83c694d87f None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=4f260d476e5646d2a07d75871106f92c, user.id=068fa6040e704a77b7b95533da265462) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:07.377709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a388cf-2d4e-4ede-85cb-fe83c694d87f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:07.379143 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a388cf-2d4e-4ede-85cb-fe83c694d87f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:07.390320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 527/1059] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:30:07 2022] GET /identity/v3/role_assignments?user.id=068fa6040e704a77b7b95533da265462&scope.project.id=4f260d476e5646d2a07d75871106f92c&role.id=70f81a43849a47f7bf393b354a46d048 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:08.162186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea048085-817c-44bb-a2eb-da5d5e32f693 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:08.162819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea048085-817c-44bb-a2eb-da5d5e32f693 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:08.162819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea048085-817c-44bb-a2eb-da5d5e32f693 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:08.164468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 533/1060] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:08.170369 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb05e13-0c53-4759-9830-a9c5561a8c67 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:08.170878 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb05e13-0c53-4759-9830-a9c5561a8c67 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:08.170878 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb05e13-0c53-4759-9830-a9c5561a8c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:08.189003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-dfb05e13-0c53-4759-9830-a9c5561a8c67 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:08.190202 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-dfb05e13-0c53-4759-9830-a9c5561a8c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:08.253625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 528/1061] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:08.276498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea048085-817c-44bb-a2eb-da5d5e32f693 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:08.343153 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27751391-3356-4c42-abf3-0dac2b1e813b None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:08.343436 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27751391-3356-4c42-abf3-0dac2b1e813b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:08.343713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27751391-3356-4c42-abf3-0dac2b1e813b None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:08.345081 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 529/1062] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:08.350813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce178f-dcef-4e88-9361-84a11de6adb4 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:08.351098 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce178f-dcef-4e88-9361-84a11de6adb4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:08.351371 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce178f-dcef-4e88-9361-84a11de6adb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:08.372527 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-c6ce178f-dcef-4e88-9361-84a11de6adb4 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:08.373997 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c6ce178f-dcef-4e88-9361-84a11de6adb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:08.378047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea048085-817c-44bb-a2eb-da5d5e32f693 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:08.412097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0ca83-d623-4264-8d13-b78ee1b7b4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:08.414157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0ca83-d623-4264-8d13-b78ee1b7b4fd None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:08.414467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0ca83-d623-4264-8d13-b78ee1b7b4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:08.414679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0ca83-d623-4264-8d13-b78ee1b7b4fd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:08.425533 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0ca83-d623-4264-8d13-b78ee1b7b4fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-02d0ca83-d623-4264-8d13-b78ee1b7b4fd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:30:08.434357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:08.435435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:08.436258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:08.436258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:08.436258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:08.436258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:08.436258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:30:08.436258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:30:08.436258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:30:08.436258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:30:08.436258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:30:08.436258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:30:08.436258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:30:08.436258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:30:08.440677 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 534/1063] 10.222.0.58 () {56 vars in 1120 bytes} [Thu May 5 15:30:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:30:08.441351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0ca83-d623-4264-8d13-b78ee1b7b4fd None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:08.458194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 530/1064] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:30:08.477328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce178f-dcef-4e88-9361-84a11de6adb4 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:08.553800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0ca83-d623-4264-8d13-b78ee1b7b4fd None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:08.587379 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe91d3-36eb-49cf-a167-f033a113a91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:08.588038 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe91d3-36eb-49cf-a167-f033a113a91e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:08.588317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe91d3-36eb-49cf-a167-f033a113a91e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:08.588588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe91d3-36eb-49cf-a167-f033a113a91e None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:08.589318 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe91d3-36eb-49cf-a167-f033a113a91e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:08.589840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe91d3-36eb-49cf-a167-f033a113a91e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:08.590990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe91d3-36eb-49cf-a167-f033a113a91e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:08.595033 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce178f-dcef-4e88-9361-84a11de6adb4 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:08.599175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 535/1065] 10.222.0.58 () {56 vars in 1115 bytes} [Thu May 5 15:30:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:08.604780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe91d3-36eb-49cf-a167-f033a113a91e None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:08.628037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb3511-b8f5-40cd-9ceb-0f377002b402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:08.628676 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb3511-b8f5-40cd-9ceb-0f377002b402 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:08.628956 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb3511-b8f5-40cd-9ceb-0f377002b402 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:08.629227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb3511-b8f5-40cd-9ceb-0f377002b402 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:08.692793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb3511-b8f5-40cd-9ceb-0f377002b402 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:08.694701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb3511-b8f5-40cd-9ceb-0f377002b402 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:08.700108 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe91d3-36eb-49cf-a167-f033a113a91e None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:08.732655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f7cbb-bdbe-4439-b1ba-b98395bf1beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:08.733499 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f7cbb-bdbe-4439-b1ba-b98395bf1beb None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:08.733809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f7cbb-bdbe-4439-b1ba-b98395bf1beb None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:08.734088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f7cbb-bdbe-4439-b1ba-b98395bf1beb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:08.744899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f7cbb-bdbe-4439-b1ba-b98395bf1beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:08.746471 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f7cbb-bdbe-4439-b1ba-b98395bf1beb None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:08.763996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-db6f7cbb-bdbe-4439-b1ba-b98395bf1beb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:30:08.763996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:08.763996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:08.763996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:08.763996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:08.763996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:08.763996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:08.763996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:08.763996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:08.763996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:08.763996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:08.763996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:08.763996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:30:08.763996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:30:08.763996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:08.764929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:08.765994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:30:08.765994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:30:08.765994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:30:08.765994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:30:08.765994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 536/1066] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:30:08.770930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f7cbb-bdbe-4439-b1ba-b98395bf1beb None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:08.791411 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 531/1067] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:30:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 15:30:08.797071 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb3511-b8f5-40cd-9ceb-0f377002b402 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:08.870927 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f7cbb-bdbe-4439-b1ba-b98395bf1beb None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:08.898040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb3511-b8f5-40cd-9ceb-0f377002b402 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:08.904060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe9f88-e0cc-46eb-80e5-5116c06900c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:08.904723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe9f88-e0cc-46eb-80e5-5116c06900c8 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:08.904998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe9f88-e0cc-46eb-80e5-5116c06900c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:08.905267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe9f88-e0cc-46eb-80e5-5116c06900c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:08.905974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe9f88-e0cc-46eb-80e5-5116c06900c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:08.906304 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe9f88-e0cc-46eb-80e5-5116c06900c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:08.907658 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe9f88-e0cc-46eb-80e5-5116c06900c8 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:08.919416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 537/1068] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:08.924813 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe9f88-e0cc-46eb-80e5-5116c06900c8 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:08.933550 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c93c84-6fe8-493f-a37d-7a1e1b86ad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:08.934072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c93c84-6fe8-493f-a37d-7a1e1b86ad0f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:08.934380 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c93c84-6fe8-493f-a37d-7a1e1b86ad0f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:08.934650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c93c84-6fe8-493f-a37d-7a1e1b86ad0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:08.945975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c93c84-6fe8-493f-a37d-7a1e1b86ad0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:08.948287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c93c84-6fe8-493f-a37d-7a1e1b86ad0f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:08.967381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-c1c93c84-6fe8-493f-a37d-7a1e1b86ad0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:30:08.967381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:08.967381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:08.967381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:08.967381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:08.967381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:08.967381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:08.967381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:08.967381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:08.967381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:08.967381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:08.967381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:08.967381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:30:08.967381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:30:08.967381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:08.968350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:08.969921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:30:08.969921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:30:08.969921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:30:08.969921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:08.969921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 532/1069] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:30:08.974668 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c93c84-6fe8-493f-a37d-7a1e1b86ad0f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:09.026089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe9f88-e0cc-46eb-80e5-5116c06900c8 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:09.061408 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93e415-b585-48b2-818a-c6e6f338ca20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:09.062226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93e415-b585-48b2-818a-c6e6f338ca20 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:09.062511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93e415-b585-48b2-818a-c6e6f338ca20 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:09.062779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93e415-b585-48b2-818a-c6e6f338ca20 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:09.070588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93e415-b585-48b2-818a-c6e6f338ca20 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:09.072021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93e415-b585-48b2-818a-c6e6f338ca20 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:09.076150 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c93c84-6fe8-493f-a37d-7a1e1b86ad0f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-9d93e415-b585-48b2-818a-c6e6f338ca20 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:30:09.086237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:09.087390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:09.088542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:09.088542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:09.088542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:30:09.088542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:30:09.088542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:30:09.088542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:30:09.088542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:30:09.088542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:30:09.088542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:30:09.088542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:30:09.092213 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 538/1070] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 5 15:30:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:30:09.093031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93e415-b585-48b2-818a-c6e6f338ca20 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:09.113378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61b4db-9eca-4825-8624-2a3932065f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:09.114038 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61b4db-9eca-4825-8624-2a3932065f63 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:09.114348 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61b4db-9eca-4825-8624-2a3932065f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:09.114622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61b4db-9eca-4825-8624-2a3932065f63 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:09.115912 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61b4db-9eca-4825-8624-2a3932065f63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:09.116359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61b4db-9eca-4825-8624-2a3932065f63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:09.117573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61b4db-9eca-4825-8624-2a3932065f63 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:09.128444 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 533/1071] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:09.210853 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93e415-b585-48b2-818a-c6e6f338ca20 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:09.247084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc6cd0-7313-4799-b3ec-fea7344f99f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:09.247772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc6cd0-7313-4799-b3ec-fea7344f99f0 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:09.248055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc6cd0-7313-4799-b3ec-fea7344f99f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:09.248332 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc6cd0-7313-4799-b3ec-fea7344f99f0 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:09.249168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc6cd0-7313-4799-b3ec-fea7344f99f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:09.249479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc6cd0-7313-4799-b3ec-fea7344f99f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:09.250972 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc6cd0-7313-4799-b3ec-fea7344f99f0 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:09.277711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 539/1072] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 5 15:30:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:09.279307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61b4db-9eca-4825-8624-2a3932065f63 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:09.382452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61b4db-9eca-4825-8624-2a3932065f63 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:09.417649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e70b0-9447-4f99-81c4-88458018c67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:09.418509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e70b0-9447-4f99-81c4-88458018c67b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:09.418788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e70b0-9447-4f99-81c4-88458018c67b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:09.419058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e70b0-9447-4f99-81c4-88458018c67b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:09.429902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e70b0-9447-4f99-81c4-88458018c67b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:09.431394 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e70b0-9447-4f99-81c4-88458018c67b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:09.449799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-1d5e70b0-9447-4f99-81c4-88458018c67b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:30:09.449799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:09.449799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:09.449799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:09.449799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:09.449799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:09.449799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:09.449799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:09.449799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:09.449799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:09.449799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:09.449799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:09.449799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:30:09.449799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:30:09.449799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:09.450812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:09.451703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:30:09.451703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:30:09.451703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:30:09.451703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:09.451703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 534/1073] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:30:09.458120 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc6cd0-7313-4799-b3ec-fea7344f99f0 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:09.558073 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc6cd0-7313-4799-b3ec-fea7344f99f0 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:09.590098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca427a8-f3c2-4074-9a60-47a0fa8341cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:09.590779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca427a8-f3c2-4074-9a60-47a0fa8341cd None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:09.591059 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca427a8-f3c2-4074-9a60-47a0fa8341cd None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:09.591331 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca427a8-f3c2-4074-9a60-47a0fa8341cd None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:09.592039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca427a8-f3c2-4074-9a60-47a0fa8341cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:09.592337 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca427a8-f3c2-4074-9a60-47a0fa8341cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:09.593689 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca427a8-f3c2-4074-9a60-47a0fa8341cd None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:09.604792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 540/1074] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:09.610528 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e70b0-9447-4f99-81c4-88458018c67b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:09.634950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d02384-88fa-4bb7-a73a-5b432c024776 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:09.635226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d02384-88fa-4bb7-a73a-5b432c024776 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:09.635503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d02384-88fa-4bb7-a73a-5b432c024776 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:09.636830 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 541/1075] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:30:09.641740 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d647e-cd1f-416c-a37c-7504e8da6e9c None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:09.642026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d647e-cd1f-416c-a37c-7504e8da6e9c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:09.642333 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d647e-cd1f-416c-a37c-7504e8da6e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:09.658064 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-8a8d647e-cd1f-416c-a37c-7504e8da6e9c None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:09.659270 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8a8d647e-cd1f-416c-a37c-7504e8da6e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:09.705929 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e70b0-9447-4f99-81c4-88458018c67b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:09.721494 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 542/1076] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:30:09.738335 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe2f30-de80-4dcb-a3b1-226297e5fecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:09.739124 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe2f30-de80-4dcb-a3b1-226297e5fecc None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:09.739405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe2f30-de80-4dcb-a3b1-226297e5fecc None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:09.739675 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe2f30-de80-4dcb-a3b1-226297e5fecc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:09.743980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d647e-cd1f-416c-a37c-7504e8da6e9c None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:09.746108 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe2f30-de80-4dcb-a3b1-226297e5fecc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:09.747568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe2f30-de80-4dcb-a3b1-226297e5fecc None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:09.761278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-4cbe2f30-de80-4dcb-a3b1-226297e5fecc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:30:09.761278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:09.761278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:09.761278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:09.761278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:09.761278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:09.761278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:09.761278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:09.761278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:09.761278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:09.761278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:09.761278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:09.761278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:30:09.761278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:30:09.761278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:09.762399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:09.763476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:30:09.763476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:30:09.763476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:30:09.763476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:30:09.763476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:30:09.763476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:30:09.763476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:30:09.763476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:09.763476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 535/1077] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:30:09.768036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe2f30-de80-4dcb-a3b1-226297e5fecc None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:09.837517 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d647e-cd1f-416c-a37c-7504e8da6e9c None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:09.861959 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe2f30-de80-4dcb-a3b1-226297e5fecc None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:09.869913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11d6b0-2bdf-4fb7-91fc-37ab0521a707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:09.870731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11d6b0-2bdf-4fb7-91fc-37ab0521a707 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:09.871012 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11d6b0-2bdf-4fb7-91fc-37ab0521a707 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:09.871284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11d6b0-2bdf-4fb7-91fc-37ab0521a707 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:09.880852 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11d6b0-2bdf-4fb7-91fc-37ab0521a707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-fb11d6b0-2bdf-4fb7-91fc-37ab0521a707 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:30:09.888530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:09.889511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:09.890373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:09.890373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:09.890373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:09.890373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:09.890373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:30:09.890373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:30:09.890373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:30:09.890373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:30:09.890373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:30:09.890373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:30:09.890373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:09.890373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:30:09.890373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 543/1078] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:30:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:30:09.895361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0a66a-ba5e-4a53-8f23-36cf17d5507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:09.895617 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11d6b0-2bdf-4fb7-91fc-37ab0521a707 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:09.896019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0a66a-ba5e-4a53-8f23-36cf17d5507a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:09.896301 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0a66a-ba5e-4a53-8f23-36cf17d5507a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:09.897052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0a66a-ba5e-4a53-8f23-36cf17d5507a None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:09.897834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0a66a-ba5e-4a53-8f23-36cf17d5507a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:09.898131 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0a66a-ba5e-4a53-8f23-36cf17d5507a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:09.899572 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0a66a-ba5e-4a53-8f23-36cf17d5507a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:09.910856 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 536/1079] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:30:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:09.916940 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0a66a-ba5e-4a53-8f23-36cf17d5507a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:09.990483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11d6b0-2bdf-4fb7-91fc-37ab0521a707 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:10.009256 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0a66a-ba5e-4a53-8f23-36cf17d5507a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:10.023465 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1b002-b58d-455a-a14a-9d5818c8ba19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:10.024063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1b002-b58d-455a-a14a-9d5818c8ba19 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:10.024342 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1b002-b58d-455a-a14a-9d5818c8ba19 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:10.024618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1b002-b58d-455a-a14a-9d5818c8ba19 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:10.025347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1b002-b58d-455a-a14a-9d5818c8ba19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:10.025651 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1b002-b58d-455a-a14a-9d5818c8ba19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:10.027049 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1b002-b58d-455a-a14a-9d5818c8ba19 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:10.034854 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 544/1080] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:30:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:10.040751 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1b002-b58d-455a-a14a-9d5818c8ba19 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:10.041905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb13207-bc3b-4d9b-b058-cc72f534061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:10.042808 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb13207-bc3b-4d9b-b058-cc72f534061c None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:10.043089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb13207-bc3b-4d9b-b058-cc72f534061c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:10.043358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb13207-bc3b-4d9b-b058-cc72f534061c None admin] PATH_INFO: `/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/2a29a4b1b1aa45aea2e466d8f8b79365/roles/edfde1ef46e447c0bf59f670ecfef070` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:10.045511 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb13207-bc3b-4d9b-b058-cc72f534061c None admin] RBAC: Authorizing `identity:create_grant(project_id=bdd58b84c6394504beb84d13d13d60a1, user_id=2a29a4b1b1aa45aea2e466d8f8b79365, role_id=edfde1ef46e447c0bf59f670ecfef070)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:10.046956 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb13207-bc3b-4d9b-b058-cc72f534061c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:10.059866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 537/1081] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:30:09 2022] PUT /identity/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/2a29a4b1b1aa45aea2e466d8f8b79365/roles/edfde1ef46e447c0bf59f670ecfef070 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:30:10.141536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1b002-b58d-455a-a14a-9d5818c8ba19 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:10.177451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4a56f-7703-429f-9e12-de1415a3c2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:10.178451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4a56f-7703-429f-9e12-de1415a3c2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:10.178731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4a56f-7703-429f-9e12-de1415a3c2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:10.179008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4a56f-7703-429f-9e12-de1415a3c2a0 None admin] PATH_INFO: `/v3/users/068fa6040e704a77b7b95533da265462` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:10.180256 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4a56f-7703-429f-9e12-de1415a3c2a0 None admin] RBAC: Authorizing `identity:get_user(user_id=068fa6040e704a77b7b95533da265462)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:10.181711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4a56f-7703-429f-9e12-de1415a3c2a0 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:10.183424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 545/1082] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:30:10 2022] GET /identity/v3/users/068fa6040e704a77b7b95533da265462 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:10.189534 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb13207-bc3b-4d9b-b058-cc72f534061c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:10.291965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb13207-bc3b-4d9b-b058-cc72f534061c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:10.324827 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ae76f-b6ed-4fd7-a9ea-5addd05f5977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:10.325685 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ae76f-b6ed-4fd7-a9ea-5addd05f5977 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:10.325969 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ae76f-b6ed-4fd7-a9ea-5addd05f5977 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:10.326276 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ae76f-b6ed-4fd7-a9ea-5addd05f5977 None admin] PATH_INFO: `/v3/projects/4f260d476e5646d2a07d75871106f92c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:10.327452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ae76f-b6ed-4fd7-a9ea-5addd05f5977 None admin] RBAC: Authorizing `identity:get_project(project_id=4f260d476e5646d2a07d75871106f92c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:10.328869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ae76f-b6ed-4fd7-a9ea-5addd05f5977 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:10.330606 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 538/1083] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:30:10 2022] GET /identity/v3/projects/4f260d476e5646d2a07d75871106f92c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:10.337018 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4a56f-7703-429f-9e12-de1415a3c2a0 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:10.436615 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4a56f-7703-429f-9e12-de1415a3c2a0 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:10.468232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c2af4-f11f-4ad1-91c2-3c7fa01e14d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:10.469108 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c2af4-f11f-4ad1-91c2-3c7fa01e14d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:10.469386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c2af4-f11f-4ad1-91c2-3c7fa01e14d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:10.469657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c2af4-f11f-4ad1-91c2-3c7fa01e14d7 None admin] PATH_INFO: `/v3/projects/4f260d476e5646d2a07d75871106f92c/users/068fa6040e704a77b7b95533da265462/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:10.471870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c2af4-f11f-4ad1-91c2-3c7fa01e14d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f260d476e5646d2a07d75871106f92c, user_id=068fa6040e704a77b7b95533da265462, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:10.473283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c2af4-f11f-4ad1-91c2-3c7fa01e14d7 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:10.486778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 546/1084] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:30:10 2022] PUT /identity/v3/projects/4f260d476e5646d2a07d75871106f92c/users/068fa6040e704a77b7b95533da265462/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:12.314722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cde64-e47a-4ebc-ae13-d4d4dc9172d0 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:12.315261 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cde64-e47a-4ebc-ae13-d4d4dc9172d0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:12.315261 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cde64-e47a-4ebc-ae13-d4d4dc9172d0 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:12.316624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 539/1085] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:12.322435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6b886-6c99-4182-a626-236d37f60a90 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:12.322825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6b886-6c99-4182-a626-236d37f60a90 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:12.322980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6b886-6c99-4182-a626-236d37f60a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:12.340141 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-26d6b886-6c99-4182-a626-236d37f60a90 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:12.341294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-26d6b886-6c99-4182-a626-236d37f60a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:12.424221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 547/1086] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:12.447099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cde64-e47a-4ebc-ae13-d4d4dc9172d0 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:12.567127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cde64-e47a-4ebc-ae13-d4d4dc9172d0 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:12.601519 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565e4d1-eb36-42f7-bb24-650c7ecd63e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:12.602361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565e4d1-eb36-42f7-bb24-650c7ecd63e1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:12.602645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565e4d1-eb36-42f7-bb24-650c7ecd63e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:12.602917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565e4d1-eb36-42f7-bb24-650c7ecd63e1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:12.613562 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565e4d1-eb36-42f7-bb24-650c7ecd63e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-7565e4d1-eb36-42f7-bb24-650c7ecd63e1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:30:12.622422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:12.623650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:12.624513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:12.624513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:12.624513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:12.624513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:12.624513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:30:12.624513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:30:12.624513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:30:12.624513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:30:12.624513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:30:12.624513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:30:12.624513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 05 15:30:12.624513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:12.624513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 540/1087] 10.222.0.58 () {56 vars in 1120 bytes} [Thu May 5 15:30:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:30:12.632210 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6b886-6c99-4182-a626-236d37f60a90 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:12.722127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534d779-ec4e-4a7d-94a8-27c0acfe399f None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:12.722346 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534d779-ec4e-4a7d-94a8-27c0acfe399f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:12.722620 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534d779-ec4e-4a7d-94a8-27c0acfe399f None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:12.723967 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 541/1088] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:30:12.729972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71502b41-7510-4548-a7fe-61a34e4f89c4 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:12.730355 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71502b41-7510-4548-a7fe-61a34e4f89c4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:12.730859 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71502b41-7510-4548-a7fe-61a34e4f89c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:12.734292 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6b886-6c99-4182-a626-236d37f60a90 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:12.747702 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-71502b41-7510-4548-a7fe-61a34e4f89c4 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:12.748867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-71502b41-7510-4548-a7fe-61a34e4f89c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:12.768110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cbb1e-6ba2-4e6b-a611-af24dcd885d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:12.768774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cbb1e-6ba2-4e6b-a611-af24dcd885d8 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:12.769053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cbb1e-6ba2-4e6b-a611-af24dcd885d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:12.769326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cbb1e-6ba2-4e6b-a611-af24dcd885d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:12.770059 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5cbb1e-6ba2-4e6b-a611-af24dcd885d8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:12.770391 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5cbb1e-6ba2-4e6b-a611-af24dcd885d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:12.771798 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5cbb1e-6ba2-4e6b-a611-af24dcd885d8 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:12.779408 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 548/1089] 10.222.0.58 () {56 vars in 1115 bytes} [Thu May 5 15:30:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:12.784906 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cbb1e-6ba2-4e6b-a611-af24dcd885d8 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:12.811754 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 542/1090] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:30:12.835633 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71502b41-7510-4548-a7fe-61a34e4f89c4 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:12.878351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cbb1e-6ba2-4e6b-a611-af24dcd885d8 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:12.909668 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77850ee9-eeec-450c-92ef-5713b3270df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:12.910482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77850ee9-eeec-450c-92ef-5713b3270df5 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:12.910763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77850ee9-eeec-450c-92ef-5713b3270df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:12.911030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77850ee9-eeec-450c-92ef-5713b3270df5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:12.921450 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77850ee9-eeec-450c-92ef-5713b3270df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:12.922898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77850ee9-eeec-450c-92ef-5713b3270df5 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:12.929106 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71502b41-7510-4548-a7fe-61a34e4f89c4 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:12.939608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-77850ee9-eeec-450c-92ef-5713b3270df5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:30:12.939608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:12.939608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:12.939608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:12.939608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:12.939608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:12.939608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:12.939608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:12.939608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:12.939608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:12.939608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:12.939608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:12.939608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:30:12.939608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:30:12.939608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:12.940624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:12.941523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:30:12.941523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:30:12.941523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:30:12.941523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:30:12.941523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 549/1091] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:30:12.946721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77850ee9-eeec-450c-92ef-5713b3270df5 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:12.961844 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb650678-c77e-4c03-8419-3b52aa3652de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:12.962661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb650678-c77e-4c03-8419-3b52aa3652de None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:12.962943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb650678-c77e-4c03-8419-3b52aa3652de None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:12.963215 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb650678-c77e-4c03-8419-3b52aa3652de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:12.973050 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb650678-c77e-4c03-8419-3b52aa3652de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-fb650678-c77e-4c03-8419-3b52aa3652de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:30:12.984045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:12.985001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:12.985890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:12.985890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:12.985890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:12.985890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:12.985890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:30:12.985890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:30:12.985890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:30:12.985890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:30:12.985890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:30:12.985890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:30:12.985890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:12.985890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:12.985890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 543/1092] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:30:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:30:12.992210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb650678-c77e-4c03-8419-3b52aa3652de None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:13.045555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77850ee9-eeec-450c-92ef-5713b3270df5 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:13.077341 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd05f8-ce2c-4ca2-bd70-4359168a24c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:13.078079 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd05f8-ce2c-4ca2-bd70-4359168a24c7 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:13.078393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd05f8-ce2c-4ca2-bd70-4359168a24c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:13.078666 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd05f8-ce2c-4ca2-bd70-4359168a24c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:13.079372 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd05f8-ce2c-4ca2-bd70-4359168a24c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:13.079674 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd05f8-ce2c-4ca2-bd70-4359168a24c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:13.081021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd05f8-ce2c-4ca2-bd70-4359168a24c7 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:13.088121 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb650678-c77e-4c03-8419-3b52aa3652de None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:13.092283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 550/1093] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:13.097996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd05f8-ce2c-4ca2-bd70-4359168a24c7 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:13.121130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601904bd-6f80-4abd-a81f-5a0fdcf6f829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:13.121797 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601904bd-6f80-4abd-a81f-5a0fdcf6f829 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:13.122082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601904bd-6f80-4abd-a81f-5a0fdcf6f829 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:13.122394 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601904bd-6f80-4abd-a81f-5a0fdcf6f829 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:13.123129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601904bd-6f80-4abd-a81f-5a0fdcf6f829 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:13.123517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601904bd-6f80-4abd-a81f-5a0fdcf6f829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:13.124783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601904bd-6f80-4abd-a81f-5a0fdcf6f829 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:13.133331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 544/1094] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:30:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:13.138860 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601904bd-6f80-4abd-a81f-5a0fdcf6f829 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:13.197159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd05f8-ce2c-4ca2-bd70-4359168a24c7 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:13.230809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8826d-a47f-4f58-a833-e952a1068049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:13.231592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8826d-a47f-4f58-a833-e952a1068049 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:13.231874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8826d-a47f-4f58-a833-e952a1068049 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:13.232148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8826d-a47f-4f58-a833-e952a1068049 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:13.234552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601904bd-6f80-4abd-a81f-5a0fdcf6f829 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:13.238864 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8826d-a47f-4f58-a833-e952a1068049 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:13.240945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8826d-a47f-4f58-a833-e952a1068049 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-fdb8826d-a47f-4f58-a833-e952a1068049 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:30:13.254800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:13.255989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:13.257048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:13.257048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:13.257048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:30:13.257048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:30:13.257048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:30:13.257048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:30:13.257048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:30:13.257048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:30:13.257048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 05 15:30:13.257048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:30:13.257048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 551/1095] 10.222.0.58 () {56 vars in 1093 bytes} [Thu May 5 15:30:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:30:13.261808 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8826d-a47f-4f58-a833-e952a1068049 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:13.268801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5f672-f143-4453-8ef2-f5004e155123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:13.269672 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5f672-f143-4453-8ef2-f5004e155123 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:13.269950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5f672-f143-4453-8ef2-f5004e155123 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:13.270249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5f672-f143-4453-8ef2-f5004e155123 None admin] PATH_INFO: `/v3/users/068fa6040e704a77b7b95533da265462` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:13.271574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5f672-f143-4453-8ef2-f5004e155123 None admin] RBAC: Authorizing `identity:get_user(user_id=068fa6040e704a77b7b95533da265462)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:13.273036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5f672-f143-4453-8ef2-f5004e155123 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:13.274692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 545/1096] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:30:13 2022] GET /identity/v3/users/068fa6040e704a77b7b95533da265462 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:13.280181 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5f672-f143-4453-8ef2-f5004e155123 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:13.358573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8826d-a47f-4f58-a833-e952a1068049 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:13.376704 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5f672-f143-4453-8ef2-f5004e155123 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:13.391355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99209e66-8424-4362-bf35-0561d3382dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:13.392014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99209e66-8424-4362-bf35-0561d3382dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:13.392293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99209e66-8424-4362-bf35-0561d3382dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:13.392563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99209e66-8424-4362-bf35-0561d3382dd5 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:13.393385 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99209e66-8424-4362-bf35-0561d3382dd5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:13.393688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99209e66-8424-4362-bf35-0561d3382dd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:13.395129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99209e66-8424-4362-bf35-0561d3382dd5 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:13.408546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f39a0-7df4-4e8c-bb56-7443ed052e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:13.409184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f39a0-7df4-4e8c-bb56-7443ed052e80 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:13.409460 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f39a0-7df4-4e8c-bb56-7443ed052e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:13.409730 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f39a0-7df4-4e8c-bb56-7443ed052e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:13.411820 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 552/1097] 10.222.0.58 () {56 vars in 1133 bytes} [Thu May 5 15:30:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:13.418347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99209e66-8424-4362-bf35-0561d3382dd5 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:13.478364 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f39a0-7df4-4e8c-bb56-7443ed052e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:13.479809 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f39a0-7df4-4e8c-bb56-7443ed052e80 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:13.515675 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99209e66-8424-4362-bf35-0561d3382dd5 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:13.548312 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a353118-1485-4607-baf5-f927f8031d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:13.548950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a353118-1485-4607-baf5-f927f8031d2a None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:13.549228 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a353118-1485-4607-baf5-f927f8031d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:13.549503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a353118-1485-4607-baf5-f927f8031d2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:13.573491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 546/1098] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:30:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 15:30:13.579402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f39a0-7df4-4e8c-bb56-7443ed052e80 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:13.613844 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a353118-1485-4607-baf5-f927f8031d2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:13.615745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a353118-1485-4607-baf5-f927f8031d2a None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:13.673548 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f39a0-7df4-4e8c-bb56-7443ed052e80 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:13.706382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c9099-c1d5-4103-bcd3-29f4b34e57f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:13.707010 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 553/1099] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:30:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 15:30:13.707225 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c9099-c1d5-4103-bcd3-29f4b34e57f0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:13.707507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c9099-c1d5-4103-bcd3-29f4b34e57f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:13.707780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c9099-c1d5-4103-bcd3-29f4b34e57f0 None admin] PATH_INFO: `/v3/projects/4f260d476e5646d2a07d75871106f92c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:13.709260 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c9099-c1d5-4103-bcd3-29f4b34e57f0 None admin] RBAC: Authorizing `identity:get_project(project_id=4f260d476e5646d2a07d75871106f92c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:13.710743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c9099-c1d5-4103-bcd3-29f4b34e57f0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:13.717303 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 547/1100] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:30:13 2022] GET /identity/v3/projects/4f260d476e5646d2a07d75871106f92c => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:13.717444 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a353118-1485-4607-baf5-f927f8031d2a None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:13.718316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c9099-c1d5-4103-bcd3-29f4b34e57f0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:13.806408 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a353118-1485-4607-baf5-f927f8031d2a None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:13.811177 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c9099-c1d5-4103-bcd3-29f4b34e57f0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:13.837835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e647dc-64e8-4ea6-abda-986415fad5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:13.838644 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e647dc-64e8-4ea6-abda-986415fad5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:13.838925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e647dc-64e8-4ea6-abda-986415fad5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:13.839198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e647dc-64e8-4ea6-abda-986415fad5d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:13.843360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb8301-17a0-42dc-9715-03c6639d8887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:13.844003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8301-17a0-42dc-9715-03c6639d8887 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:13.844282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8301-17a0-42dc-9715-03c6639d8887 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:13.844558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8301-17a0-42dc-9715-03c6639d8887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:13.845373 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb8301-17a0-42dc-9715-03c6639d8887 None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=4f260d476e5646d2a07d75871106f92c, user.id=068fa6040e704a77b7b95533da265462) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:13.845683 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb8301-17a0-42dc-9715-03c6639d8887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:13.847377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb8301-17a0-42dc-9715-03c6639d8887 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:13.850225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e647dc-64e8-4ea6-abda-986415fad5d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:13.851654 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e647dc-64e8-4ea6-abda-986415fad5d5 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:13.853914 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 548/1101] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:30:13 2022] GET /identity/v3/role_assignments?user.id=068fa6040e704a77b7b95533da265462&scope.project.id=4f260d476e5646d2a07d75871106f92c&role.id=70f81a43849a47f7bf393b354a46d048 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:13.875951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-c3e647dc-64e8-4ea6-abda-986415fad5d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:30:13.875951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:13.875951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:13.875951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:13.875951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:13.875951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:13.875951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:13.875951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:13.875951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:13.875951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:13.875951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:13.875951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:13.875951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:30:13.875951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:30:13.875951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:13.877088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:13.877981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:30:13.877981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:30:13.877981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:30:13.877981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:30:13.877981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 554/1102] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:30:13.883646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb8301-17a0-42dc-9715-03c6639d8887 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:13.985488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb8301-17a0-42dc-9715-03c6639d8887 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:14.020380 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f63ff-fbb2-4eb0-9201-449430e32d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:14.021051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f63ff-fbb2-4eb0-9201-449430e32d31 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:14.021948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f63ff-fbb2-4eb0-9201-449430e32d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:14.022328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f63ff-fbb2-4eb0-9201-449430e32d31 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:14.023063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f63ff-fbb2-4eb0-9201-449430e32d31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:14.023364 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f63ff-fbb2-4eb0-9201-449430e32d31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:14.024726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f63ff-fbb2-4eb0-9201-449430e32d31 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:14.036192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 549/1103] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:14.041988 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e647dc-64e8-4ea6-abda-986415fad5d5 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:14.139290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e647dc-64e8-4ea6-abda-986415fad5d5 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:14.170522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a5813-490d-4fe1-9964-75d0855c2ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:14.171390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a5813-490d-4fe1-9964-75d0855c2ade None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:14.171691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a5813-490d-4fe1-9964-75d0855c2ade None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:14.172034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a5813-490d-4fe1-9964-75d0855c2ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:14.179323 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a5813-490d-4fe1-9964-75d0855c2ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:14.180750 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a5813-490d-4fe1-9964-75d0855c2ade None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:14.194472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-842a5813-490d-4fe1-9964-75d0855c2ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:30:14.194472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:14.194472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:14.194472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:14.194472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:14.194472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:14.194472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:14.194472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:14.194472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:14.194472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:14.194472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:14.194472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:14.194472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:30:14.194472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:30:14.194472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:14.195548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:14.196467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:30:14.196467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:30:14.196467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:30:14.196467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:30:14.196467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:30:14.196467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:30:14.196467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:30:14.196467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:30:14.196467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 555/1104] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:30:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:30:14.201413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f63ff-fbb2-4eb0-9201-449430e32d31 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:14.295534 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f63ff-fbb2-4eb0-9201-449430e32d31 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:14.328082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e811e0-17be-4e10-bb63-9d806242ab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:14.328732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e811e0-17be-4e10-bb63-9d806242ab4c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:14.329013 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e811e0-17be-4e10-bb63-9d806242ab4c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:14.329287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e811e0-17be-4e10-bb63-9d806242ab4c None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:14.330061 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e811e0-17be-4e10-bb63-9d806242ab4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:14.330402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e811e0-17be-4e10-bb63-9d806242ab4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:14.331822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e811e0-17be-4e10-bb63-9d806242ab4c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:14.343244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 550/1105] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:30:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:14.349625 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a5813-490d-4fe1-9964-75d0855c2ade None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:14.447938 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a5813-490d-4fe1-9964-75d0855c2ade None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:14.479348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f712f0b-0b76-490b-9c3f-4239789029a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:14.479991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f712f0b-0b76-490b-9c3f-4239789029a8 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:14.480270 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f712f0b-0b76-490b-9c3f-4239789029a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:14.480542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f712f0b-0b76-490b-9c3f-4239789029a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:14.481348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f712f0b-0b76-490b-9c3f-4239789029a8 None admin] RBAC: Adding query filter params (role.id=edfde1ef46e447c0bf59f670ecfef070, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=2a29a4b1b1aa45aea2e466d8f8b79365) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:14.481655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f712f0b-0b76-490b-9c3f-4239789029a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:14.483159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f712f0b-0b76-490b-9c3f-4239789029a8 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:14.488737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 556/1106] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:30:14 2022] GET /identity/v3/role_assignments?user.id=2a29a4b1b1aa45aea2e466d8f8b79365&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=edfde1ef46e447c0bf59f670ecfef070 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:16.157244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a9183-2593-4fa2-b0b4-e64f4a605d51 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:16.157825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a9183-2593-4fa2-b0b4-e64f4a605d51 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:16.157825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a9183-2593-4fa2-b0b4-e64f4a605d51 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:16.159322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 551/1107] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:16.164558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86855dcd-e48e-4920-8671-ae52a5285043 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:16.164980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86855dcd-e48e-4920-8671-ae52a5285043 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:16.165115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86855dcd-e48e-4920-8671-ae52a5285043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:16.182084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-86855dcd-e48e-4920-8671-ae52a5285043 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:16.183302 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-86855dcd-e48e-4920-8671-ae52a5285043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:16.251566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 557/1108] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:16.275722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a9183-2593-4fa2-b0b4-e64f4a605d51 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:16.374476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a9183-2593-4fa2-b0b4-e64f4a605d51 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:16.406145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58c4e8-8546-4f61-92d7-d63425dc247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:16.406939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58c4e8-8546-4f61-92d7-d63425dc247f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:16.407214 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58c4e8-8546-4f61-92d7-d63425dc247f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:16.407527 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58c4e8-8546-4f61-92d7-d63425dc247f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:16.408615 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58c4e8-8546-4f61-92d7-d63425dc247f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:16.410026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58c4e8-8546-4f61-92d7-d63425dc247f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:16.411639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 552/1109] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:16.418063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86855dcd-e48e-4920-8671-ae52a5285043 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:16.514276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86855dcd-e48e-4920-8671-ae52a5285043 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:16.551991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba8e80-8249-44ab-92a5-fc67998f33f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:16.553272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba8e80-8249-44ab-92a5-fc67998f33f5 None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:16.553556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba8e80-8249-44ab-92a5-fc67998f33f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:16.553830 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba8e80-8249-44ab-92a5-fc67998f33f5 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:16.554573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba8e80-8249-44ab-92a5-fc67998f33f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:16.555984 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba8e80-8249-44ab-92a5-fc67998f33f5 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:16.575268 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 558/1110] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:30:16 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:18.866117 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b5ce4-524d-4046-83e3-9701a826a835 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:18.866669 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b5ce4-524d-4046-83e3-9701a826a835 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:18.866783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b5ce4-524d-4046-83e3-9701a826a835 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:18.868058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 553/1111] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:18.873131 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdbf58-3988-4d48-a40d-b1a8d25560ee None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:18.873549 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdbf58-3988-4d48-a40d-b1a8d25560ee None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:18.873685 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdbf58-3988-4d48-a40d-b1a8d25560ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:18.890973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-85fdbf58-3988-4d48-a40d-b1a8d25560ee None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:18.892136 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-85fdbf58-3988-4d48-a40d-b1a8d25560ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:18.954879 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 559/1112] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:18.979190 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b5ce4-524d-4046-83e3-9701a826a835 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:19.075618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b5ce4-524d-4046-83e3-9701a826a835 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:19.107656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea820c09-d6d5-4e85-b351-d5ad8cf15c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:19.108497 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea820c09-d6d5-4e85-b351-d5ad8cf15c1a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:19.108777 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea820c09-d6d5-4e85-b351-d5ad8cf15c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:19.109050 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea820c09-d6d5-4e85-b351-d5ad8cf15c1a None admin] PATH_INFO: `/v3/roles/8b51e457da8145c6995241d379986c7c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:19.110532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea820c09-d6d5-4e85-b351-d5ad8cf15c1a None admin] RBAC: Authorizing `identity:get_role(role_id=8b51e457da8145c6995241d379986c7c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:19.111882 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea820c09-d6d5-4e85-b351-d5ad8cf15c1a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:19.113247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 554/1113] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:30:18 2022] GET /identity/v3/roles/8b51e457da8145c6995241d379986c7c => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:19.119978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdbf58-3988-4d48-a40d-b1a8d25560ee None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:19.212882 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdbf58-3988-4d48-a40d-b1a8d25560ee None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:19.246664 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fdc76-75c2-49cc-9afe-09e49f5dc05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:19.247545 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fdc76-75c2-49cc-9afe-09e49f5dc05f None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:19.247906 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fdc76-75c2-49cc-9afe-09e49f5dc05f None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:19.248182 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fdc76-75c2-49cc-9afe-09e49f5dc05f None admin] PATH_INFO: `/v3/users/0e44fbaaf5ff4b93850619dd9592d9fc` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:19.260900 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fdc76-75c2-49cc-9afe-09e49f5dc05f None admin] RBAC: Authorizing `identity:get_user(user_id=0e44fbaaf5ff4b93850619dd9592d9fc)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:19.262368 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fdc76-75c2-49cc-9afe-09e49f5dc05f None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:19.264034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 560/1114] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:30:19 2022] GET /identity/v3/users/0e44fbaaf5ff4b93850619dd9592d9fc => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:19.269789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea820c09-d6d5-4e85-b351-d5ad8cf15c1a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:19.368690 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea820c09-d6d5-4e85-b351-d5ad8cf15c1a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:19.401279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bf655-6025-4c4a-be74-9fb54e11d97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:19.401869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bf655-6025-4c4a-be74-9fb54e11d97b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:19.402148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bf655-6025-4c4a-be74-9fb54e11d97b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:19.402449 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bf655-6025-4c4a-be74-9fb54e11d97b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:19.464771 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bf655-6025-4c4a-be74-9fb54e11d97b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:19.466211 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bf655-6025-4c4a-be74-9fb54e11d97b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:19.559247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 555/1115] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:30:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:30:19.565031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fdc76-75c2-49cc-9afe-09e49f5dc05f None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:19.665879 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fdc76-75c2-49cc-9afe-09e49f5dc05f None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:19.698124 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a315f9-14cc-4b48-b3dd-ec2198907208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:19.699007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a315f9-14cc-4b48-b3dd-ec2198907208 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:19.699288 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a315f9-14cc-4b48-b3dd-ec2198907208 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:19.699558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a315f9-14cc-4b48-b3dd-ec2198907208 None admin] PATH_INFO: `/v3/projects/4f260d476e5646d2a07d75871106f92c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:19.700707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a315f9-14cc-4b48-b3dd-ec2198907208 None admin] RBAC: Authorizing `identity:get_project(project_id=4f260d476e5646d2a07d75871106f92c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:19.702121 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a315f9-14cc-4b48-b3dd-ec2198907208 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:19.703820 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 561/1116] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:30:19 2022] GET /identity/v3/projects/4f260d476e5646d2a07d75871106f92c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:19.710546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bf655-6025-4c4a-be74-9fb54e11d97b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:19.802030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bf655-6025-4c4a-be74-9fb54e11d97b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:19.834009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852515b-67ff-47c2-a259-f4b337e8344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:19.834687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852515b-67ff-47c2-a259-f4b337e8344d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:19.834966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852515b-67ff-47c2-a259-f4b337e8344d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:19.835238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852515b-67ff-47c2-a259-f4b337e8344d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:19.836046 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852515b-67ff-47c2-a259-f4b337e8344d None admin] RBAC: Adding query filter params (role.id=8b51e457da8145c6995241d379986c7c, scope.project.id=4f260d476e5646d2a07d75871106f92c, user.id=0e44fbaaf5ff4b93850619dd9592d9fc) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:19.836351 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852515b-67ff-47c2-a259-f4b337e8344d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:19.837752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852515b-67ff-47c2-a259-f4b337e8344d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:19.842937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 556/1117] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:30:19 2022] GET /identity/v3/role_assignments?user.id=0e44fbaaf5ff4b93850619dd9592d9fc&scope.project.id=4f260d476e5646d2a07d75871106f92c&role.id=8b51e457da8145c6995241d379986c7c => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:22.060697 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0b28b-a7f9-4979-b013-c9a45707d14d None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:22.061240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0b28b-a7f9-4979-b013-c9a45707d14d None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:22.061240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0b28b-a7f9-4979-b013-c9a45707d14d None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:22.064250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 562/1118] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:22.070402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762b426-9b93-47d7-a71b-0308cd32e7f6 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:22.070892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762b426-9b93-47d7-a71b-0308cd32e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:22.070985 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762b426-9b93-47d7-a71b-0308cd32e7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:22.087414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-1762b426-9b93-47d7-a71b-0308cd32e7f6 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:22.088575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-1762b426-9b93-47d7-a71b-0308cd32e7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:22.152700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 557/1119] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:22.175195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0b28b-a7f9-4979-b013-c9a45707d14d None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:22.272330 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0b28b-a7f9-4979-b013-c9a45707d14d None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:22.303957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3b7ad-be55-41f6-adb6-33644c58f472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:22.304788 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3b7ad-be55-41f6-adb6-33644c58f472 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:22.305063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3b7ad-be55-41f6-adb6-33644c58f472 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:22.305331 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3b7ad-be55-41f6-adb6-33644c58f472 None admin] PATH_INFO: `/v3/roles/8b51e457da8145c6995241d379986c7c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:22.306788 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3b7ad-be55-41f6-adb6-33644c58f472 None admin] RBAC: Authorizing `identity:get_role(role_id=8b51e457da8145c6995241d379986c7c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:22.308127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3b7ad-be55-41f6-adb6-33644c58f472 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:22.309450 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 563/1120] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:30:22 2022] GET /identity/v3/roles/8b51e457da8145c6995241d379986c7c => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:22.315266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762b426-9b93-47d7-a71b-0308cd32e7f6 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:22.408293 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762b426-9b93-47d7-a71b-0308cd32e7f6 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:22.440542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c43cc1-0819-4a2c-b6c6-8c2447bd1b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:22.441398 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c43cc1-0819-4a2c-b6c6-8c2447bd1b2d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:22.441680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c43cc1-0819-4a2c-b6c6-8c2447bd1b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:22.441954 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c43cc1-0819-4a2c-b6c6-8c2447bd1b2d None admin] PATH_INFO: `/v3/users/0e44fbaaf5ff4b93850619dd9592d9fc` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:22.443873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c43cc1-0819-4a2c-b6c6-8c2447bd1b2d None admin] RBAC: Authorizing `identity:get_user(user_id=0e44fbaaf5ff4b93850619dd9592d9fc)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:22.445304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c43cc1-0819-4a2c-b6c6-8c2447bd1b2d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:22.446984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 558/1121] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:30:22 2022] GET /identity/v3/users/0e44fbaaf5ff4b93850619dd9592d9fc => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:22.452814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3b7ad-be55-41f6-adb6-33644c58f472 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:22.546871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3b7ad-be55-41f6-adb6-33644c58f472 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:22.580618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b49098-55ab-4540-aaad-943a09e305fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:22.581394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b49098-55ab-4540-aaad-943a09e305fa None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:22.581668 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b49098-55ab-4540-aaad-943a09e305fa None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:22.581935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b49098-55ab-4540-aaad-943a09e305fa None admin] PATH_INFO: `/v3/projects/4f260d476e5646d2a07d75871106f92c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:22.583110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b49098-55ab-4540-aaad-943a09e305fa None admin] RBAC: Authorizing `identity:get_project(project_id=4f260d476e5646d2a07d75871106f92c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:22.584746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b49098-55ab-4540-aaad-943a09e305fa None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:22.586435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 564/1122] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:30:22 2022] GET /identity/v3/projects/4f260d476e5646d2a07d75871106f92c => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:22.592468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c43cc1-0819-4a2c-b6c6-8c2447bd1b2d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:22.686775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c43cc1-0819-4a2c-b6c6-8c2447bd1b2d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:22.718269 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323ed7f-469c-44b3-be2d-d989912ed1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:22.719152 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323ed7f-469c-44b3-be2d-d989912ed1a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:22.719433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323ed7f-469c-44b3-be2d-d989912ed1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:22.719705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323ed7f-469c-44b3-be2d-d989912ed1a1 None admin] PATH_INFO: `/v3/projects/4f260d476e5646d2a07d75871106f92c/users/0e44fbaaf5ff4b93850619dd9592d9fc/roles/8b51e457da8145c6995241d379986c7c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:22.722134 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323ed7f-469c-44b3-be2d-d989912ed1a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f260d476e5646d2a07d75871106f92c, user_id=0e44fbaaf5ff4b93850619dd9592d9fc, role_id=8b51e457da8145c6995241d379986c7c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:22.723582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323ed7f-469c-44b3-be2d-d989912ed1a1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:22.736572 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 559/1123] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:30:22 2022] PUT /identity/v3/projects/4f260d476e5646d2a07d75871106f92c/users/0e44fbaaf5ff4b93850619dd9592d9fc/roles/8b51e457da8145c6995241d379986c7c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:30:24.946935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384f76d-80a4-4099-811f-579331775792 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:24.947478 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384f76d-80a4-4099-811f-579331775792 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:24.947478 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384f76d-80a4-4099-811f-579331775792 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:24.948835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 565/1124] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:24.953821 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2115bbf-a224-4f00-8baa-a52945ef67d3 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:24.954218 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2115bbf-a224-4f00-8baa-a52945ef67d3 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:24.954389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2115bbf-a224-4f00-8baa-a52945ef67d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:24.970970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f2115bbf-a224-4f00-8baa-a52945ef67d3 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:24.972386 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f2115bbf-a224-4f00-8baa-a52945ef67d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:25.035396 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 560/1125] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:25.058342 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384f76d-80a4-4099-811f-579331775792 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:25.153665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384f76d-80a4-4099-811f-579331775792 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:25.186641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a9275-c668-43ad-a312-7e482daafb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:25.187480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9275-c668-43ad-a312-7e482daafb82 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:25.187761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9275-c668-43ad-a312-7e482daafb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:25.188032 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9275-c668-43ad-a312-7e482daafb82 None admin] PATH_INFO: `/v3/roles/8b51e457da8145c6995241d379986c7c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:25.189464 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a9275-c668-43ad-a312-7e482daafb82 None admin] RBAC: Authorizing `identity:get_role(role_id=8b51e457da8145c6995241d379986c7c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:25.190847 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a9275-c668-43ad-a312-7e482daafb82 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:25.192224 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 566/1126] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:30:25 2022] GET /identity/v3/roles/8b51e457da8145c6995241d379986c7c => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:25.198781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2115bbf-a224-4f00-8baa-a52945ef67d3 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:25.291387 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2115bbf-a224-4f00-8baa-a52945ef67d3 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:25.323932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25308e4c-688a-4bfc-a8c5-3a00eb606858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:25.324783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25308e4c-688a-4bfc-a8c5-3a00eb606858 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:25.325059 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25308e4c-688a-4bfc-a8c5-3a00eb606858 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:25.325326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25308e4c-688a-4bfc-a8c5-3a00eb606858 None admin] PATH_INFO: `/v3/users/0e44fbaaf5ff4b93850619dd9592d9fc` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:25.326517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25308e4c-688a-4bfc-a8c5-3a00eb606858 None admin] RBAC: Authorizing `identity:get_user(user_id=0e44fbaaf5ff4b93850619dd9592d9fc)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:25.327927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25308e4c-688a-4bfc-a8c5-3a00eb606858 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:25.329533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 561/1127] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:30:25 2022] GET /identity/v3/users/0e44fbaaf5ff4b93850619dd9592d9fc => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:25.335579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a9275-c668-43ad-a312-7e482daafb82 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:25.430290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a9275-c668-43ad-a312-7e482daafb82 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:25.462253 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6a315-f5f0-422f-8e78-59b77098d3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:25.462835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6a315-f5f0-422f-8e78-59b77098d3bb None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:25.463114 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6a315-f5f0-422f-8e78-59b77098d3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:25.463387 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6a315-f5f0-422f-8e78-59b77098d3bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:25.529180 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6a315-f5f0-422f-8e78-59b77098d3bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:25.530657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6a315-f5f0-422f-8e78-59b77098d3bb None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:25.622695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 567/1128] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:30:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:30:25.628359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25308e4c-688a-4bfc-a8c5-3a00eb606858 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:25.723187 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25308e4c-688a-4bfc-a8c5-3a00eb606858 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:25.754273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b5bab-027c-4b02-b66c-c0f2fa85441e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:25.755629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b5bab-027c-4b02-b66c-c0f2fa85441e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:25.756080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b5bab-027c-4b02-b66c-c0f2fa85441e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:25.756361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b5bab-027c-4b02-b66c-c0f2fa85441e None admin] PATH_INFO: `/v3/projects/4f260d476e5646d2a07d75871106f92c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:25.757517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b5bab-027c-4b02-b66c-c0f2fa85441e None admin] RBAC: Authorizing `identity:get_project(project_id=4f260d476e5646d2a07d75871106f92c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:25.758947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b5bab-027c-4b02-b66c-c0f2fa85441e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:25.760611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 562/1129] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:30:25 2022] GET /identity/v3/projects/4f260d476e5646d2a07d75871106f92c => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:25.766688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6a315-f5f0-422f-8e78-59b77098d3bb None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:25.858618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6a315-f5f0-422f-8e78-59b77098d3bb None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:25.890512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d8dbf-511c-4bbe-b958-22c7956353f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:25.891149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d8dbf-511c-4bbe-b958-22c7956353f9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:25.891427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d8dbf-511c-4bbe-b958-22c7956353f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:25.891698 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d8dbf-511c-4bbe-b958-22c7956353f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:25.892506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d8dbf-511c-4bbe-b958-22c7956353f9 None admin] RBAC: Adding query filter params (role.id=8b51e457da8145c6995241d379986c7c, scope.project.id=4f260d476e5646d2a07d75871106f92c, user.id=0e44fbaaf5ff4b93850619dd9592d9fc) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:25.892814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d8dbf-511c-4bbe-b958-22c7956353f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:25.894242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d8dbf-511c-4bbe-b958-22c7956353f9 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:25.899913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 568/1130] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:30:25 2022] GET /identity/v3/role_assignments?user.id=0e44fbaaf5ff4b93850619dd9592d9fc&scope.project.id=4f260d476e5646d2a07d75871106f92c&role.id=8b51e457da8145c6995241d379986c7c => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:28.153079 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32522ab5-83b3-415e-b17e-6244f3f42bab None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:28.153608 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32522ab5-83b3-415e-b17e-6244f3f42bab None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:28.153608 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32522ab5-83b3-415e-b17e-6244f3f42bab None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:28.155021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 563/1131] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:28.159973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa11de5-e528-4764-92c7-0dadf74452c1 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:28.160405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa11de5-e528-4764-92c7-0dadf74452c1 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:28.160504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa11de5-e528-4764-92c7-0dadf74452c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:28.176720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-5aa11de5-e528-4764-92c7-0dadf74452c1 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:28.177881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-5aa11de5-e528-4764-92c7-0dadf74452c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:28.240655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 569/1132] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:28.264049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32522ab5-83b3-415e-b17e-6244f3f42bab None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:28.360751 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32522ab5-83b3-415e-b17e-6244f3f42bab None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:28.395258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce5e72-9d14-450f-8784-cb4a2530cf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:28.396085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce5e72-9d14-450f-8784-cb4a2530cf24 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:28.396360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce5e72-9d14-450f-8784-cb4a2530cf24 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:28.396630 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce5e72-9d14-450f-8784-cb4a2530cf24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:28.397775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce5e72-9d14-450f-8784-cb4a2530cf24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:28.399229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce5e72-9d14-450f-8784-cb4a2530cf24 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:28.400825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 564/1133] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:28.406887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa11de5-e528-4764-92c7-0dadf74452c1 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:28.500067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa11de5-e528-4764-92c7-0dadf74452c1 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:28.532768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70db03-d050-4d7c-850c-0c77a667dd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:28.533419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70db03-d050-4d7c-850c-0c77a667dd05 None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:28.533698 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70db03-d050-4d7c-850c-0c77a667dd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:28.533967 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70db03-d050-4d7c-850c-0c77a667dd05 None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:28.534684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70db03-d050-4d7c-850c-0c77a667dd05 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:28.536478 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70db03-d050-4d7c-850c-0c77a667dd05 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:28.560390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 570/1134] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 5 15:30:28 2022] POST /identity/v3/projects => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:30.851216 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d8d35-c792-4ffa-9dc3-5838c73ccf47 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:30.851753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d8d35-c792-4ffa-9dc3-5838c73ccf47 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:30.851753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d8d35-c792-4ffa-9dc3-5838c73ccf47 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:30.853109 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 565/1135] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:30.858082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835904d-9f37-4093-84b0-6ec66dd80825 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:30.858555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835904d-9f37-4093-84b0-6ec66dd80825 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:30.858655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835904d-9f37-4093-84b0-6ec66dd80825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:30.875349 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-e835904d-9f37-4093-84b0-6ec66dd80825 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:30.876508 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e835904d-9f37-4093-84b0-6ec66dd80825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:30.938833 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 571/1136] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:30.963189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d8d35-c792-4ffa-9dc3-5838c73ccf47 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:31.061548 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d8d35-c792-4ffa-9dc3-5838c73ccf47 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:31.092851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10219abd-a6d4-4474-98f9-194e10741230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:31.093626 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10219abd-a6d4-4474-98f9-194e10741230 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:31.093907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10219abd-a6d4-4474-98f9-194e10741230 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:31.094199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10219abd-a6d4-4474-98f9-194e10741230 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:31.095355 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10219abd-a6d4-4474-98f9-194e10741230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:31.097012 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10219abd-a6d4-4474-98f9-194e10741230 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:31.099336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 566/1137] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:30:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:30:31.105089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835904d-9f37-4093-84b0-6ec66dd80825 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:31.197745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835904d-9f37-4093-84b0-6ec66dd80825 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:31.230833 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810c856-b474-4ed0-9151-3b8aa977e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:31.231486 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810c856-b474-4ed0-9151-3b8aa977e02a None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:31.231766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810c856-b474-4ed0-9151-3b8aa977e02a None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:31.232039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810c856-b474-4ed0-9151-3b8aa977e02a None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:31.232743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810c856-b474-4ed0-9151-3b8aa977e02a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:31.234153 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810c856-b474-4ed0-9151-3b8aa977e02a None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:31.254657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 572/1138] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:30:31 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:33.526668 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2524e-4bb8-49a6-ab58-cc2904a1b668 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.527089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2524e-4bb8-49a6-ab58-cc2904a1b668 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.527223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2524e-4bb8-49a6-ab58-cc2904a1b668 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.528713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 567/1139] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:33.533895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d1924-fbec-45df-9923-f1249e8322cc None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.534361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d1924-fbec-45df-9923-f1249e8322cc None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.534457 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d1924-fbec-45df-9923-f1249e8322cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.551031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-8e8d1924-fbec-45df-9923-f1249e8322cc None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:33.553061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8e8d1924-fbec-45df-9923-f1249e8322cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:33.616713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 573/1140] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:33.639956 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2524e-4bb8-49a6-ab58-cc2904a1b668 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.737352 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2524e-4bb8-49a6-ab58-cc2904a1b668 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.769631 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90dec91-07b9-461e-b288-58faf2824474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.771104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90dec91-07b9-461e-b288-58faf2824474 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.771395 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90dec91-07b9-461e-b288-58faf2824474 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.771673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90dec91-07b9-461e-b288-58faf2824474 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.781192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90dec91-07b9-461e-b288-58faf2824474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-f90dec91-07b9-461e-b288-58faf2824474 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:30:33.789432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:33.790609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:33.791536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:33.791536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:33.791536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:33.791536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:33.791536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:30:33.791536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:30:33.791536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:30:33.791536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:30:33.791536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:30:33.791536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:30:33.791536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:33.791536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:33.791536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 568/1141] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:30:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:30:33.796646 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d1924-fbec-45df-9923-f1249e8322cc None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:33.889880 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d1924-fbec-45df-9923-f1249e8322cc None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:33.921764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019d357-8ce2-486e-9b91-b6ff97692566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:33.922448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019d357-8ce2-486e-9b91-b6ff97692566 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:33.922729 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019d357-8ce2-486e-9b91-b6ff97692566 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:33.923000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019d357-8ce2-486e-9b91-b6ff97692566 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:33.923725 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019d357-8ce2-486e-9b91-b6ff97692566 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:33.924026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019d357-8ce2-486e-9b91-b6ff97692566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:33.925369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019d357-8ce2-486e-9b91-b6ff97692566 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:33.933546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 574/1142] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:30:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:33.939308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90dec91-07b9-461e-b288-58faf2824474 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.033133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90dec91-07b9-461e-b288-58faf2824474 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.068065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c3c87-aa01-4e98-ab89-7c0da2fe79cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.068923 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c3c87-aa01-4e98-ab89-7c0da2fe79cb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.069210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c3c87-aa01-4e98-ab89-7c0da2fe79cb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.069483 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c3c87-aa01-4e98-ab89-7c0da2fe79cb None admin] PATH_INFO: `/v3/users/aed922d2a21545e4be40df6148d5da3f` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.081901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c3c87-aa01-4e98-ab89-7c0da2fe79cb None admin] RBAC: Authorizing `identity:get_user(user_id=aed922d2a21545e4be40df6148d5da3f)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.083439 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c3c87-aa01-4e98-ab89-7c0da2fe79cb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.085062 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 569/1143] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:30:33 2022] GET /identity/v3/users/aed922d2a21545e4be40df6148d5da3f => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:34.090820 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019d357-8ce2-486e-9b91-b6ff97692566 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.186737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019d357-8ce2-486e-9b91-b6ff97692566 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.219235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0d6f8-7aeb-4d5b-9769-202a5533cdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.219877 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0d6f8-7aeb-4d5b-9769-202a5533cdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.220162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0d6f8-7aeb-4d5b-9769-202a5533cdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.220437 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0d6f8-7aeb-4d5b-9769-202a5533cdc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.284233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0d6f8-7aeb-4d5b-9769-202a5533cdc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.285635 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0d6f8-7aeb-4d5b-9769-202a5533cdc1 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.379421 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 575/1144] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:30:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:30:34.385414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c3c87-aa01-4e98-ab89-7c0da2fe79cb None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.480682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c3c87-aa01-4e98-ab89-7c0da2fe79cb None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.512362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0557eb-45b3-4a88-a3e1-7fa60a094670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.513000 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0557eb-45b3-4a88-a3e1-7fa60a094670 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.513275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0557eb-45b3-4a88-a3e1-7fa60a094670 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.513542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0557eb-45b3-4a88-a3e1-7fa60a094670 None admin] PATH_INFO: `/v3/projects/8b9237f611a1459d86eee40dd17166cc` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.514793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0557eb-45b3-4a88-a3e1-7fa60a094670 None admin] RBAC: Authorizing `identity:get_project(project_id=8b9237f611a1459d86eee40dd17166cc)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.516208 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0557eb-45b3-4a88-a3e1-7fa60a094670 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.517875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 570/1145] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:30:34 2022] GET /identity/v3/projects/8b9237f611a1459d86eee40dd17166cc => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:34.524571 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0d6f8-7aeb-4d5b-9769-202a5533cdc1 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:34.619322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0d6f8-7aeb-4d5b-9769-202a5533cdc1 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:34.659601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378472a-5478-4e57-92bc-d64f9feba7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:34.660251 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378472a-5478-4e57-92bc-d64f9feba7ea None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:34.660566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378472a-5478-4e57-92bc-d64f9feba7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:34.661588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378472a-5478-4e57-92bc-d64f9feba7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:34.662444 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378472a-5478-4e57-92bc-d64f9feba7ea None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=8b9237f611a1459d86eee40dd17166cc, user.id=aed922d2a21545e4be40df6148d5da3f) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:34.662758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378472a-5478-4e57-92bc-d64f9feba7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:34.664173 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378472a-5478-4e57-92bc-d64f9feba7ea None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:34.669727 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 576/1146] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:30:34 2022] GET /identity/v3/role_assignments?user.id=aed922d2a21545e4be40df6148d5da3f&scope.project.id=8b9237f611a1459d86eee40dd17166cc&role.id=70f81a43849a47f7bf393b354a46d048 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:36.888180 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b6169-5683-4f7e-b661-d4ea4fdb496a None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.888718 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b6169-5683-4f7e-b661-d4ea4fdb496a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.888718 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b6169-5683-4f7e-b661-d4ea4fdb496a None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.890074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 571/1147] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:36.895308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbfc6b-598b-413b-b00a-426ab01b4e2a None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:36.895792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbfc6b-598b-413b-b00a-426ab01b4e2a None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:36.895894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbfc6b-598b-413b-b00a-426ab01b4e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:36.913536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-9cbbfc6b-598b-413b-b00a-426ab01b4e2a None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:36.914764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9cbbfc6b-598b-413b-b00a-426ab01b4e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:36.977896 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 577/1148] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:37.000837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b6169-5683-4f7e-b661-d4ea4fdb496a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:37.096726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b6169-5683-4f7e-b661-d4ea4fdb496a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:37.129439 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d18d6c-0085-429b-af30-78f0834f8aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:37.130241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d18d6c-0085-429b-af30-78f0834f8aee None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:37.130527 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d18d6c-0085-429b-af30-78f0834f8aee None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:37.130801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d18d6c-0085-429b-af30-78f0834f8aee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:37.140325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d18d6c-0085-429b-af30-78f0834f8aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-77d18d6c-0085-429b-af30-78f0834f8aee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:30:37.147828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:37.148919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:37.150099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:37.150099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:37.150099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:37.150099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:37.150099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:30:37.150099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:30:37.150099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:30:37.150099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:30:37.150099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:30:37.150099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:30:37.150099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:37.150099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:37.150099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 572/1149] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:30:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:30:37.155136 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbfc6b-598b-413b-b00a-426ab01b4e2a None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:37.251705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbfc6b-598b-413b-b00a-426ab01b4e2a None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:37.283342 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f0dc4-bacd-4b0a-a223-cd0e88d86712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:37.283987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f0dc4-bacd-4b0a-a223-cd0e88d86712 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:37.284265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f0dc4-bacd-4b0a-a223-cd0e88d86712 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:37.284534 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f0dc4-bacd-4b0a-a223-cd0e88d86712 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:37.285255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f0dc4-bacd-4b0a-a223-cd0e88d86712 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:37.286041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f0dc4-bacd-4b0a-a223-cd0e88d86712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:37.287413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f0dc4-bacd-4b0a-a223-cd0e88d86712 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:37.295168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 578/1150] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:30:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:37.301825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d18d6c-0085-429b-af30-78f0834f8aee None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:37.397240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d18d6c-0085-429b-af30-78f0834f8aee None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:37.429233 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e60bd0-2030-4254-9203-0057a5e1e2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:37.430086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e60bd0-2030-4254-9203-0057a5e1e2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:37.430397 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e60bd0-2030-4254-9203-0057a5e1e2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:37.430671 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e60bd0-2030-4254-9203-0057a5e1e2d7 None admin] PATH_INFO: `/v3/users/aed922d2a21545e4be40df6148d5da3f` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:37.431831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e60bd0-2030-4254-9203-0057a5e1e2d7 None admin] RBAC: Authorizing `identity:get_user(user_id=aed922d2a21545e4be40df6148d5da3f)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:37.433236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e60bd0-2030-4254-9203-0057a5e1e2d7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:37.434873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 573/1151] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:30:37 2022] GET /identity/v3/users/aed922d2a21545e4be40df6148d5da3f => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:37.441083 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f0dc4-bacd-4b0a-a223-cd0e88d86712 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:37.539881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f0dc4-bacd-4b0a-a223-cd0e88d86712 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:37.572018 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e1c3e-dd6b-4f01-b4ef-3c9461106af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:37.572870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e1c3e-dd6b-4f01-b4ef-3c9461106af2 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:37.573151 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e1c3e-dd6b-4f01-b4ef-3c9461106af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:37.573422 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e1c3e-dd6b-4f01-b4ef-3c9461106af2 None admin] PATH_INFO: `/v3/projects/8b9237f611a1459d86eee40dd17166cc` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:37.574618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e1c3e-dd6b-4f01-b4ef-3c9461106af2 None admin] RBAC: Authorizing `identity:get_project(project_id=8b9237f611a1459d86eee40dd17166cc)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:37.576045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e1c3e-dd6b-4f01-b4ef-3c9461106af2 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:37.577713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 579/1152] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:30:37 2022] GET /identity/v3/projects/8b9237f611a1459d86eee40dd17166cc => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:37.584393 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e60bd0-2030-4254-9203-0057a5e1e2d7 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:37.677832 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e60bd0-2030-4254-9203-0057a5e1e2d7 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:37.709797 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04435a7-3c8f-45dc-a71d-0f9ba1a61ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:37.710711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04435a7-3c8f-45dc-a71d-0f9ba1a61ab7 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:37.710993 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04435a7-3c8f-45dc-a71d-0f9ba1a61ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:37.711266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04435a7-3c8f-45dc-a71d-0f9ba1a61ab7 None admin] PATH_INFO: `/v3/projects/8b9237f611a1459d86eee40dd17166cc/users/aed922d2a21545e4be40df6148d5da3f/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:37.713220 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04435a7-3c8f-45dc-a71d-0f9ba1a61ab7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b9237f611a1459d86eee40dd17166cc, user_id=aed922d2a21545e4be40df6148d5da3f, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:37.714673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04435a7-3c8f-45dc-a71d-0f9ba1a61ab7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:37.727032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 574/1153] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:30:37 2022] PUT /identity/v3/projects/8b9237f611a1459d86eee40dd17166cc/users/aed922d2a21545e4be40df6148d5da3f/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:30:39.942250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cd45e-ca87-480c-9cce-8988fe2fe308 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:39.942784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cd45e-ca87-480c-9cce-8988fe2fe308 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:39.942784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cd45e-ca87-480c-9cce-8988fe2fe308 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:39.944172 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 580/1154] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:39.950054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb756a2-ef76-4a53-bb88-87dad6453007 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:39.950576 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb756a2-ef76-4a53-bb88-87dad6453007 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:39.950669 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb756a2-ef76-4a53-bb88-87dad6453007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:39.967679 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-7eb756a2-ef76-4a53-bb88-87dad6453007 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:39.968842 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7eb756a2-ef76-4a53-bb88-87dad6453007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:40.035765 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 575/1155] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:40.058939 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cd45e-ca87-480c-9cce-8988fe2fe308 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:40.159231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cd45e-ca87-480c-9cce-8988fe2fe308 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:40.193732 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c864d5-e45c-4242-8019-170c0f02c5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:40.194515 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c864d5-e45c-4242-8019-170c0f02c5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:40.194793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c864d5-e45c-4242-8019-170c0f02c5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:40.195063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c864d5-e45c-4242-8019-170c0f02c5c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:40.205381 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c864d5-e45c-4242-8019-170c0f02c5c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-36c864d5-e45c-4242-8019-170c0f02c5c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:30:40.213092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:40.214322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:40.215168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:40.215168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:40.215168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:40.215168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:40.215168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:30:40.215168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:30:40.215168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:30:40.215168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:30:40.215168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:30:40.215168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:30:40.215168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:40.215168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:30:40.215168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 581/1156] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:30:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:30:40.220842 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb756a2-ef76-4a53-bb88-87dad6453007 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:40.317939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb756a2-ef76-4a53-bb88-87dad6453007 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:40.351872 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625241d-8eb2-44ed-a40f-69a5791e8ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:40.352533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625241d-8eb2-44ed-a40f-69a5791e8ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:40.352809 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625241d-8eb2-44ed-a40f-69a5791e8ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:40.353078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625241d-8eb2-44ed-a40f-69a5791e8ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:40.353811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625241d-8eb2-44ed-a40f-69a5791e8ec7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:40.354113 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625241d-8eb2-44ed-a40f-69a5791e8ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:40.355491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625241d-8eb2-44ed-a40f-69a5791e8ec7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:40.363931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 576/1157] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:30:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:40.369402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c864d5-e45c-4242-8019-170c0f02c5c1 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:40.471823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c864d5-e45c-4242-8019-170c0f02c5c1 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:40.505786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c3794-f36b-4a2d-9b72-86122c14053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:40.507215 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c3794-f36b-4a2d-9b72-86122c14053c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:40.507497 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c3794-f36b-4a2d-9b72-86122c14053c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:40.507770 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c3794-f36b-4a2d-9b72-86122c14053c None admin] PATH_INFO: `/v3/users/aed922d2a21545e4be40df6148d5da3f` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:40.509013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c3794-f36b-4a2d-9b72-86122c14053c None admin] RBAC: Authorizing `identity:get_user(user_id=aed922d2a21545e4be40df6148d5da3f)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:40.510460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c3794-f36b-4a2d-9b72-86122c14053c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:40.512138 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 582/1158] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:30:40 2022] GET /identity/v3/users/aed922d2a21545e4be40df6148d5da3f => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:40.517892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625241d-8eb2-44ed-a40f-69a5791e8ec7 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:40.617543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625241d-8eb2-44ed-a40f-69a5791e8ec7 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:40.651003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa935b9-fa87-4a47-9bf1-c0d92a19dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:40.651658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa935b9-fa87-4a47-9bf1-c0d92a19dc48 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:40.651937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa935b9-fa87-4a47-9bf1-c0d92a19dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:40.652213 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa935b9-fa87-4a47-9bf1-c0d92a19dc48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:40.718993 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa935b9-fa87-4a47-9bf1-c0d92a19dc48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:40.720695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa935b9-fa87-4a47-9bf1-c0d92a19dc48 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:40.815666 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 577/1159] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:30:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:30:40.822281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c3794-f36b-4a2d-9b72-86122c14053c None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:40.919937 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c3794-f36b-4a2d-9b72-86122c14053c None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:40.954984 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacc218-41ce-4601-8bf8-a2890c8938f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:40.955828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacc218-41ce-4601-8bf8-a2890c8938f3 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:40.956105 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacc218-41ce-4601-8bf8-a2890c8938f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:40.956374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacc218-41ce-4601-8bf8-a2890c8938f3 None admin] PATH_INFO: `/v3/projects/8b9237f611a1459d86eee40dd17166cc` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:40.957754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacc218-41ce-4601-8bf8-a2890c8938f3 None admin] RBAC: Authorizing `identity:get_project(project_id=8b9237f611a1459d86eee40dd17166cc)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:40.959257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacc218-41ce-4601-8bf8-a2890c8938f3 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:40.960921 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 583/1160] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:30:40 2022] GET /identity/v3/projects/8b9237f611a1459d86eee40dd17166cc => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:40.967165 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa935b9-fa87-4a47-9bf1-c0d92a19dc48 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:41.063533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa935b9-fa87-4a47-9bf1-c0d92a19dc48 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:41.096555 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741a89a-7605-4a67-b0a0-49f7b666db4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:41.097134 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741a89a-7605-4a67-b0a0-49f7b666db4a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:41.097418 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741a89a-7605-4a67-b0a0-49f7b666db4a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:41.097748 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741a89a-7605-4a67-b0a0-49f7b666db4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:41.099276 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741a89a-7605-4a67-b0a0-49f7b666db4a None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=8b9237f611a1459d86eee40dd17166cc, user.id=aed922d2a21545e4be40df6148d5da3f) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:41.099585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741a89a-7605-4a67-b0a0-49f7b666db4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:41.100998 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741a89a-7605-4a67-b0a0-49f7b666db4a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:41.106960 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 578/1161] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:30:40 2022] GET /identity/v3/role_assignments?user.id=aed922d2a21545e4be40df6148d5da3f&scope.project.id=8b9237f611a1459d86eee40dd17166cc&role.id=70f81a43849a47f7bf393b354a46d048 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:43.412404 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0c82f-0e17-4028-9a54-b5a3aa92f215 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:43.412934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0c82f-0e17-4028-9a54-b5a3aa92f215 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:43.412934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0c82f-0e17-4028-9a54-b5a3aa92f215 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:43.414306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 584/1162] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:43.419803 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ede280-6bdd-4ad5-a265-5e509a5b1552 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:43.420253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ede280-6bdd-4ad5-a265-5e509a5b1552 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:43.420362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ede280-6bdd-4ad5-a265-5e509a5b1552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:43.437544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a4ede280-6bdd-4ad5-a265-5e509a5b1552 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:43.438757 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a4ede280-6bdd-4ad5-a265-5e509a5b1552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:43.506600 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 579/1163] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:30:43.528850 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0c82f-0e17-4028-9a54-b5a3aa92f215 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:43.632495 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0c82f-0e17-4028-9a54-b5a3aa92f215 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:43.667016 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f5d0c-6892-4bcc-9f1d-83a6b2e5cf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:43.667599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f5d0c-6892-4bcc-9f1d-83a6b2e5cf59 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:43.667877 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f5d0c-6892-4bcc-9f1d-83a6b2e5cf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:43.668152 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f5d0c-6892-4bcc-9f1d-83a6b2e5cf59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:43.739870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f5d0c-6892-4bcc-9f1d-83a6b2e5cf59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:43.741315 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f5d0c-6892-4bcc-9f1d-83a6b2e5cf59 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:43.837259 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 585/1164] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:30:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:30:43.843260 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ede280-6bdd-4ad5-a265-5e509a5b1552 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:43.940787 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ede280-6bdd-4ad5-a265-5e509a5b1552 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:43.981786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c113b-e21b-4240-99c2-4139cfa83403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:43.982641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c113b-e21b-4240-99c2-4139cfa83403 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:43.982923 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c113b-e21b-4240-99c2-4139cfa83403 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:43.983196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c113b-e21b-4240-99c2-4139cfa83403 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:43.990986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c113b-e21b-4240-99c2-4139cfa83403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:43.992453 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c113b-e21b-4240-99c2-4139cfa83403 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-f16c113b-e21b-4240-99c2-4139cfa83403 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:44.007848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:44.009144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:44.010307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:44.010307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:30:44.010307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:44.010307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:44.010307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:44.010307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:44.010307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:44.010307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:44.010307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:44.010307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:44.010307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 05 15:30:44.010307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:30:44.010307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 05 15:30:44.010307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:30:44.010307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 580/1165] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 5 15:30:43 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:30:44.015226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f5d0c-6892-4bcc-9f1d-83a6b2e5cf59 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:44.112917 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f5d0c-6892-4bcc-9f1d-83a6b2e5cf59 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:44.147346 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071ef56-b82a-4b68-845e-c0545fc9a783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:44.148007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071ef56-b82a-4b68-845e-c0545fc9a783 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:44.148290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071ef56-b82a-4b68-845e-c0545fc9a783 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:44.148566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071ef56-b82a-4b68-845e-c0545fc9a783 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:44.149286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071ef56-b82a-4b68-845e-c0545fc9a783 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:44.149594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071ef56-b82a-4b68-845e-c0545fc9a783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:44.150995 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071ef56-b82a-4b68-845e-c0545fc9a783 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:44.158368 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 586/1166] 10.222.0.58 () {56 vars in 1115 bytes} [Thu May 5 15:30:44 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:46.411007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb9ba3-3957-4740-8f87-f8ed46579f67 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:46.411588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb9ba3-3957-4740-8f87-f8ed46579f67 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:46.411588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb9ba3-3957-4740-8f87-f8ed46579f67 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:46.412917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 581/1167] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:46.418127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f797ce-c9aa-4faf-be66-36111f97d818 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:46.418603 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f797ce-c9aa-4faf-be66-36111f97d818 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:46.418702 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f797ce-c9aa-4faf-be66-36111f97d818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:46.434728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-54f797ce-c9aa-4faf-be66-36111f97d818 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:46.435884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-54f797ce-c9aa-4faf-be66-36111f97d818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:46.499308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 587/1168] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:46.522992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb9ba3-3957-4740-8f87-f8ed46579f67 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:46.619127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb9ba3-3957-4740-8f87-f8ed46579f67 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:46.650474 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c880acf-6446-40f6-a41f-98803edeb940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:46.651112 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c880acf-6446-40f6-a41f-98803edeb940 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:46.651389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c880acf-6446-40f6-a41f-98803edeb940 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:46.651659 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c880acf-6446-40f6-a41f-98803edeb940 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:46.652374 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c880acf-6446-40f6-a41f-98803edeb940 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:46.653719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c880acf-6446-40f6-a41f-98803edeb940 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:46.668728 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 582/1169] 10.222.0.58 () {60 vars in 1138 bytes} [Thu May 5 15:30:46 2022] POST /identity/v3/domains => generated 267 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:48.920042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3498c-07eb-4d53-a0e4-a2af2c68b752 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:48.920593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3498c-07eb-4d53-a0e4-a2af2c68b752 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:48.920593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3498c-07eb-4d53-a0e4-a2af2c68b752 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:48.921953 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 588/1170] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:48.927315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88d19e-e6f6-48a8-8ebe-072d74876ec6 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:48.927727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88d19e-e6f6-48a8-8ebe-072d74876ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:48.927869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88d19e-e6f6-48a8-8ebe-072d74876ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:48.944578 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8c88d19e-e6f6-48a8-8ebe-072d74876ec6 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:48.945753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8c88d19e-e6f6-48a8-8ebe-072d74876ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:49.008861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 583/1171] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:30:49.033071 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3498c-07eb-4d53-a0e4-a2af2c68b752 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:49.133240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3498c-07eb-4d53-a0e4-a2af2c68b752 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:49.164700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c025f8-bd4a-4ca0-b237-f65dbfdc0ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:49.165542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c025f8-bd4a-4ca0-b237-f65dbfdc0ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:49.165815 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c025f8-bd4a-4ca0-b237-f65dbfdc0ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:49.166081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c025f8-bd4a-4ca0-b237-f65dbfdc0ad4 None admin] PATH_INFO: `/v3/domains/6de6f9c96dd945ecb982da91a995f4a1` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:49.175898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c025f8-bd4a-4ca0-b237-f65dbfdc0ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6de6f9c96dd945ecb982da91a995f4a1)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:49.177256 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c025f8-bd4a-4ca0-b237-f65dbfdc0ad4 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:49.178894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 589/1172] 10.222.0.58 () {56 vars in 1183 bytes} [Thu May 5 15:30:49 2022] GET /identity/v3/domains/6de6f9c96dd945ecb982da91a995f4a1 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:49.184775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88d19e-e6f6-48a8-8ebe-072d74876ec6 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:49.277889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88d19e-e6f6-48a8-8ebe-072d74876ec6 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:49.310343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bcfd7-9ee9-4ddc-a7d7-ffdd68e4d6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:49.310985 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bcfd7-9ee9-4ddc-a7d7-ffdd68e4d6f7 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:49.311264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bcfd7-9ee9-4ddc-a7d7-ffdd68e4d6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:49.311536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bcfd7-9ee9-4ddc-a7d7-ffdd68e4d6f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:49.312236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bcfd7-9ee9-4ddc-a7d7-ffdd68e4d6f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:49.313643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bcfd7-9ee9-4ddc-a7d7-ffdd68e4d6f7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:49.337723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 584/1173] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 5 15:30:49 2022] POST /identity/v3/projects => generated 361 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:51.609370 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8581db-2ff9-45a3-aec2-b5dffb3b1ed3 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:51.609912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8581db-2ff9-45a3-aec2-b5dffb3b1ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:51.609912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8581db-2ff9-45a3-aec2-b5dffb3b1ed3 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:51.611290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 590/1174] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:51.617096 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e934d-06a9-44f2-af28-22c942100c38 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:51.617479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e934d-06a9-44f2-af28-22c942100c38 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:51.617656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e934d-06a9-44f2-af28-22c942100c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:51.635919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e96e934d-06a9-44f2-af28-22c942100c38 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:51.637095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e96e934d-06a9-44f2-af28-22c942100c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:51.700209 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 585/1175] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:51.724966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8581db-2ff9-45a3-aec2-b5dffb3b1ed3 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:51.822096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8581db-2ff9-45a3-aec2-b5dffb3b1ed3 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:51.853121 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c81447-81cf-4c02-a1cb-69cfbf6454d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:51.853957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c81447-81cf-4c02-a1cb-69cfbf6454d6 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:51.854266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c81447-81cf-4c02-a1cb-69cfbf6454d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:51.854541 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c81447-81cf-4c02-a1cb-69cfbf6454d6 None admin] PATH_INFO: `/v3/domains/6de6f9c96dd945ecb982da91a995f4a1` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:51.855693 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c81447-81cf-4c02-a1cb-69cfbf6454d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6de6f9c96dd945ecb982da91a995f4a1)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:51.857104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c81447-81cf-4c02-a1cb-69cfbf6454d6 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:51.858708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 591/1176] 10.222.0.58 () {56 vars in 1183 bytes} [Thu May 5 15:30:51 2022] GET /identity/v3/domains/6de6f9c96dd945ecb982da91a995f4a1 => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:51.865052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e934d-06a9-44f2-af28-22c942100c38 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:51.963487 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e934d-06a9-44f2-af28-22c942100c38 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:51.995824 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457170b-562d-433f-8a26-6fd8922e901d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:51.996471 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457170b-562d-433f-8a26-6fd8922e901d None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:51.996747 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457170b-562d-433f-8a26-6fd8922e901d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:51.997017 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457170b-562d-433f-8a26-6fd8922e901d None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:51.997706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457170b-562d-433f-8a26-6fd8922e901d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:51.999131 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457170b-562d-433f-8a26-6fd8922e901d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:52.017417 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 586/1177] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:30:51 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:30:54.287844 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a72b9-36a1-409f-bf63-4ac4ec78ad65 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:54.288397 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a72b9-36a1-409f-bf63-4ac4ec78ad65 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:54.288397 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a72b9-36a1-409f-bf63-4ac4ec78ad65 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:54.289723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 592/1178] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:54.294864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a1a7e-7352-4ec2-88ec-9b4720348522 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:54.295252 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a1a7e-7352-4ec2-88ec-9b4720348522 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:54.295430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a1a7e-7352-4ec2-88ec-9b4720348522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:54.312655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-483a1a7e-7352-4ec2-88ec-9b4720348522 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:54.313827 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-483a1a7e-7352-4ec2-88ec-9b4720348522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:54.379506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 587/1179] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:54.403146 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a72b9-36a1-409f-bf63-4ac4ec78ad65 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:54.498641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a72b9-36a1-409f-bf63-4ac4ec78ad65 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:54.531374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5da2f-5b9a-49eb-85e1-8e85dad46e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:54.532154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5da2f-5b9a-49eb-85e1-8e85dad46e98 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:54.532434 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5da2f-5b9a-49eb-85e1-8e85dad46e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:54.532704 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5da2f-5b9a-49eb-85e1-8e85dad46e98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:54.542771 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5da2f-5b9a-49eb-85e1-8e85dad46e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-3bd5da2f-5b9a-49eb-85e1-8e85dad46e98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:30:54.550840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:54.552029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:54.553089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:54.553089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:54.553089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:54.553089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:54.553089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:30:54.553089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:30:54.553089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:30:54.553089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:30:54.553089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:30:54.553089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:30:54.553089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:54.553089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:30:54.553089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 593/1180] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:30:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:30:54.557972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a1a7e-7352-4ec2-88ec-9b4720348522 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:54.650432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a1a7e-7352-4ec2-88ec-9b4720348522 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:54.682140 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defe470-2384-4f35-a5ad-b7935e3815f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:54.682863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defe470-2384-4f35-a5ad-b7935e3815f9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:54.683147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defe470-2384-4f35-a5ad-b7935e3815f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:54.683422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defe470-2384-4f35-a5ad-b7935e3815f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:54.684387 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defe470-2384-4f35-a5ad-b7935e3815f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:54.684499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defe470-2384-4f35-a5ad-b7935e3815f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:54.685798 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defe470-2384-4f35-a5ad-b7935e3815f9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:54.694696 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 588/1181] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:30:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:54.700595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5da2f-5b9a-49eb-85e1-8e85dad46e98 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:54.796798 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5da2f-5b9a-49eb-85e1-8e85dad46e98 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:54.828927 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37e8d2-9ca4-4b67-80a4-14e37f8982a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:54.829785 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e8d2-9ca4-4b67-80a4-14e37f8982a7 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:54.830066 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e8d2-9ca4-4b67-80a4-14e37f8982a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:54.830375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e8d2-9ca4-4b67-80a4-14e37f8982a7 None admin] PATH_INFO: `/v3/users/d7dd12afc10d470c8da91ab8026eab7b` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:54.843393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37e8d2-9ca4-4b67-80a4-14e37f8982a7 None admin] RBAC: Authorizing `identity:get_user(user_id=d7dd12afc10d470c8da91ab8026eab7b)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:54.845174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37e8d2-9ca4-4b67-80a4-14e37f8982a7 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:54.847448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 594/1182] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:30:54 2022] GET /identity/v3/users/d7dd12afc10d470c8da91ab8026eab7b => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:54.853240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defe470-2384-4f35-a5ad-b7935e3815f9 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:54.945872 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defe470-2384-4f35-a5ad-b7935e3815f9 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:54.977451 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1667bb-3474-4a7a-88ea-e3d3561cf7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:54.978078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1667bb-3474-4a7a-88ea-e3d3561cf7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:54.978379 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1667bb-3474-4a7a-88ea-e3d3561cf7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:54.978649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1667bb-3474-4a7a-88ea-e3d3561cf7a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:55.040907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1667bb-3474-4a7a-88ea-e3d3561cf7a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:55.042364 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1667bb-3474-4a7a-88ea-e3d3561cf7a2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:55.133552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 589/1183] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:30:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:30:55.139441 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37e8d2-9ca4-4b67-80a4-14e37f8982a7 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:55.232876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37e8d2-9ca4-4b67-80a4-14e37f8982a7 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:55.264977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5bdfe-8350-47d7-917b-6d9adc7dbf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:55.265828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5bdfe-8350-47d7-917b-6d9adc7dbf12 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:55.266132 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5bdfe-8350-47d7-917b-6d9adc7dbf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:55.266439 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5bdfe-8350-47d7-917b-6d9adc7dbf12 None admin] PATH_INFO: `/v3/projects/5ea3933dfc864e5aa8c2445831fbe5fe` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:55.267599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5bdfe-8350-47d7-917b-6d9adc7dbf12 None admin] RBAC: Authorizing `identity:get_project(project_id=5ea3933dfc864e5aa8c2445831fbe5fe)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:55.269755 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5bdfe-8350-47d7-917b-6d9adc7dbf12 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:55.271446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 595/1184] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:30:55 2022] GET /identity/v3/projects/5ea3933dfc864e5aa8c2445831fbe5fe => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:55.277593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1667bb-3474-4a7a-88ea-e3d3561cf7a2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:55.371085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1667bb-3474-4a7a-88ea-e3d3561cf7a2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:55.402384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4921c2c-4b0d-4265-abcb-1e65e95e23d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:55.402955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4921c2c-4b0d-4265-abcb-1e65e95e23d6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:55.403230 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4921c2c-4b0d-4265-abcb-1e65e95e23d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:55.403498 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4921c2c-4b0d-4265-abcb-1e65e95e23d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:55.404299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4921c2c-4b0d-4265-abcb-1e65e95e23d6 None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=5ea3933dfc864e5aa8c2445831fbe5fe, user.id=d7dd12afc10d470c8da91ab8026eab7b) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:55.404601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4921c2c-4b0d-4265-abcb-1e65e95e23d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:55.406002 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4921c2c-4b0d-4265-abcb-1e65e95e23d6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:55.411452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 590/1185] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:30:55 2022] GET /identity/v3/role_assignments?user.id=d7dd12afc10d470c8da91ab8026eab7b&scope.project.id=5ea3933dfc864e5aa8c2445831fbe5fe&role.id=70f81a43849a47f7bf393b354a46d048 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:57.622727 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835cc9c-9c87-46f6-9d5f-1e7f6f951549 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:57.623265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835cc9c-9c87-46f6-9d5f-1e7f6f951549 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:57.623265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835cc9c-9c87-46f6-9d5f-1e7f6f951549 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:57.624587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 596/1186] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:30:57.629807 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977627f-b76b-4110-bf78-42c7d62960da None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:57.630210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977627f-b76b-4110-bf78-42c7d62960da None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:57.630377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977627f-b76b-4110-bf78-42c7d62960da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:57.647288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d977627f-b76b-4110-bf78-42c7d62960da None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:30:57.648447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d977627f-b76b-4110-bf78-42c7d62960da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:30:57.710888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 591/1187] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:30:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:30:57.733823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835cc9c-9c87-46f6-9d5f-1e7f6f951549 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:57.827290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835cc9c-9c87-46f6-9d5f-1e7f6f951549 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:57.858739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3945b-b04c-43dc-861a-7c12b5238980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:57.859504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3945b-b04c-43dc-861a-7c12b5238980 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:57.859780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3945b-b04c-43dc-861a-7c12b5238980 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:57.860048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3945b-b04c-43dc-861a-7c12b5238980 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:57.870044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3945b-b04c-43dc-861a-7c12b5238980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-fef3945b-b04c-43dc-861a-7c12b5238980 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:30:57.877399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:30:57.879061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:30:57.879955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:30:57.879955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:30:57.879955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:30:57.879955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:30:57.879955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:30:57.879955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:30:57.879955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:30:57.879955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:30:57.879955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:30:57.879955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:30:57.879955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:30:57.879955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:30:57.879955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 597/1188] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:30:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:30:57.885121 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977627f-b76b-4110-bf78-42c7d62960da None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:57.978615 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977627f-b76b-4110-bf78-42c7d62960da None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:58.010428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7dc7b-ee9f-47b0-b551-81c70b758a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:58.011077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7dc7b-ee9f-47b0-b551-81c70b758a6e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:58.011358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7dc7b-ee9f-47b0-b551-81c70b758a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:58.011628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7dc7b-ee9f-47b0-b551-81c70b758a6e None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:58.012353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7dc7b-ee9f-47b0-b551-81c70b758a6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:30:58.012657 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7dc7b-ee9f-47b0-b551-81c70b758a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:58.013994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7dc7b-ee9f-47b0-b551-81c70b758a6e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:58.021679 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 592/1189] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:30:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:58.027352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3945b-b04c-43dc-861a-7c12b5238980 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:58.123377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3945b-b04c-43dc-861a-7c12b5238980 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:58.154343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9956bd-55f8-45d9-9052-af8e71c049d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:58.155192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9956bd-55f8-45d9-9052-af8e71c049d7 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:58.155469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9956bd-55f8-45d9-9052-af8e71c049d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:58.155738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9956bd-55f8-45d9-9052-af8e71c049d7 None admin] PATH_INFO: `/v3/users/d7dd12afc10d470c8da91ab8026eab7b` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:58.156899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9956bd-55f8-45d9-9052-af8e71c049d7 None admin] RBAC: Authorizing `identity:get_user(user_id=d7dd12afc10d470c8da91ab8026eab7b)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:58.158334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9956bd-55f8-45d9-9052-af8e71c049d7 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:58.161030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 598/1190] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:30:58 2022] GET /identity/v3/users/d7dd12afc10d470c8da91ab8026eab7b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:58.166870 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7dc7b-ee9f-47b0-b551-81c70b758a6e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:58.260999 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7dc7b-ee9f-47b0-b551-81c70b758a6e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:58.292482 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42714f-5e85-40ef-a7f9-512479ebbf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:58.293341 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42714f-5e85-40ef-a7f9-512479ebbf93 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:58.293623 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42714f-5e85-40ef-a7f9-512479ebbf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:58.293895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42714f-5e85-40ef-a7f9-512479ebbf93 None admin] PATH_INFO: `/v3/projects/5ea3933dfc864e5aa8c2445831fbe5fe` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:58.295095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42714f-5e85-40ef-a7f9-512479ebbf93 None admin] RBAC: Authorizing `identity:get_project(project_id=5ea3933dfc864e5aa8c2445831fbe5fe)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:58.296510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42714f-5e85-40ef-a7f9-512479ebbf93 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:58.298189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 593/1191] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:30:58 2022] GET /identity/v3/projects/5ea3933dfc864e5aa8c2445831fbe5fe => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:30:58.304931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9956bd-55f8-45d9-9052-af8e71c049d7 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:30:58.399030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9956bd-55f8-45d9-9052-af8e71c049d7 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:30:58.430619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7f9b9-3a62-4dd8-b16c-1e6ea1b4ac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:30:58.431482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7f9b9-3a62-4dd8-b16c-1e6ea1b4ac93 None admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:30:58.431759 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7f9b9-3a62-4dd8-b16c-1e6ea1b4ac93 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:30:58.432030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7f9b9-3a62-4dd8-b16c-1e6ea1b4ac93 None admin] PATH_INFO: `/v3/projects/5ea3933dfc864e5aa8c2445831fbe5fe/users/d7dd12afc10d470c8da91ab8026eab7b/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:30:58.433934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7f9b9-3a62-4dd8-b16c-1e6ea1b4ac93 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ea3933dfc864e5aa8c2445831fbe5fe, user_id=d7dd12afc10d470c8da91ab8026eab7b, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:30:58.435369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7f9b9-3a62-4dd8-b16c-1e6ea1b4ac93 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:30:58.448034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 599/1192] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:30:58 2022] PUT /identity/v3/projects/5ea3933dfc864e5aa8c2445831fbe5fe/users/d7dd12afc10d470c8da91ab8026eab7b/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:31:00.673211 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80b916-e6bd-4c05-bd3a-68a883b46ff9 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:00.673725 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80b916-e6bd-4c05-bd3a-68a883b46ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:00.673811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80b916-e6bd-4c05-bd3a-68a883b46ff9 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:00.675673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 594/1193] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:31:00.680866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b6449-a3bf-4cf3-adba-5a63e422fcea None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:00.681238 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b6449-a3bf-4cf3-adba-5a63e422fcea None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:00.681424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b6449-a3bf-4cf3-adba-5a63e422fcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:00.698571 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-767b6449-a3bf-4cf3-adba-5a63e422fcea None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:31:00.699742 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-767b6449-a3bf-4cf3-adba-5a63e422fcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:31:00.763283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 600/1194] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:31:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:31:00.786653 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80b916-e6bd-4c05-bd3a-68a883b46ff9 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:00.884553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80b916-e6bd-4c05-bd3a-68a883b46ff9 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:00.915962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa66726-a3d6-44a0-8c28-779ecf24bdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:00.916740 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa66726-a3d6-44a0-8c28-779ecf24bdcc None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:00.917020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa66726-a3d6-44a0-8c28-779ecf24bdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:00.917297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa66726-a3d6-44a0-8c28-779ecf24bdcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:00.928731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa66726-a3d6-44a0-8c28-779ecf24bdcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-7aa66726-a3d6-44a0-8c28-779ecf24bdcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:31:00.936184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:31:00.937251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:31:00.938127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:31:00.938127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:31:00.938127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:31:00.938127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:31:00.938127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:31:00.938127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:31:00.938127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:31:00.938127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:31:00.938127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:31:00.938127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:31:00.938127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:31:00.938127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:31:00.938127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 595/1195] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:31:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:31:00.943593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b6449-a3bf-4cf3-adba-5a63e422fcea None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:01.035953 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b6449-a3bf-4cf3-adba-5a63e422fcea None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:01.067590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fe1c0-abbc-478c-a95a-214736e76001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:01.068232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fe1c0-abbc-478c-a95a-214736e76001 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:01.068512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fe1c0-abbc-478c-a95a-214736e76001 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:01.068786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fe1c0-abbc-478c-a95a-214736e76001 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:01.069518 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fe1c0-abbc-478c-a95a-214736e76001 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:01.069820 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fe1c0-abbc-478c-a95a-214736e76001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:01.071197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fe1c0-abbc-478c-a95a-214736e76001 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:01.078779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 601/1196] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:31:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:31:01.084521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa66726-a3d6-44a0-8c28-779ecf24bdcc None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:01.179722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa66726-a3d6-44a0-8c28-779ecf24bdcc None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:01.211260 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0061cd-c172-4a05-abe0-4a1499b6e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:01.212100 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0061cd-c172-4a05-abe0-4a1499b6e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:01.212378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0061cd-c172-4a05-abe0-4a1499b6e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:01.212647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0061cd-c172-4a05-abe0-4a1499b6e1c2 None admin] PATH_INFO: `/v3/users/d7dd12afc10d470c8da91ab8026eab7b` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:01.213891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0061cd-c172-4a05-abe0-4a1499b6e1c2 None admin] RBAC: Authorizing `identity:get_user(user_id=d7dd12afc10d470c8da91ab8026eab7b)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:01.215341 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0061cd-c172-4a05-abe0-4a1499b6e1c2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:01.216949 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 596/1197] 10.222.0.58 () {56 vars in 1177 bytes} [Thu May 5 15:31:01 2022] GET /identity/v3/users/d7dd12afc10d470c8da91ab8026eab7b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:31:01.223593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fe1c0-abbc-478c-a95a-214736e76001 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:01.317455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fe1c0-abbc-478c-a95a-214736e76001 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:01.349517 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3233d9-8166-4935-9b41-85358cfba31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:01.350143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3233d9-8166-4935-9b41-85358cfba31f None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:01.350458 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3233d9-8166-4935-9b41-85358cfba31f None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:01.350735 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3233d9-8166-4935-9b41-85358cfba31f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:01.412260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3233d9-8166-4935-9b41-85358cfba31f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:01.413685 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3233d9-8166-4935-9b41-85358cfba31f None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:01.505576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 602/1198] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:31:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:31:01.511665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0061cd-c172-4a05-abe0-4a1499b6e1c2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:01.605708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0061cd-c172-4a05-abe0-4a1499b6e1c2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:01.637192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b7b5a-ac7b-4508-ac54-752f54914771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:01.638038 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b7b5a-ac7b-4508-ac54-752f54914771 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:01.638350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b7b5a-ac7b-4508-ac54-752f54914771 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:01.638628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b7b5a-ac7b-4508-ac54-752f54914771 None admin] PATH_INFO: `/v3/projects/5ea3933dfc864e5aa8c2445831fbe5fe` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:01.640067 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b7b5a-ac7b-4508-ac54-752f54914771 None admin] RBAC: Authorizing `identity:get_project(project_id=5ea3933dfc864e5aa8c2445831fbe5fe)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:01.641477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b7b5a-ac7b-4508-ac54-752f54914771 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:01.643713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 597/1199] 10.222.0.58 () {56 vars in 1186 bytes} [Thu May 5 15:31:01 2022] GET /identity/v3/projects/5ea3933dfc864e5aa8c2445831fbe5fe => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:31:01.650256 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3233d9-8166-4935-9b41-85358cfba31f None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:31:01.743053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3233d9-8166-4935-9b41-85358cfba31f None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:31:01.776291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb2945-5d8f-428c-b720-938652b30719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:31:01.776936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb2945-5d8f-428c-b720-938652b30719 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:31:01.777222 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb2945-5d8f-428c-b720-938652b30719 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:31:01.777496 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb2945-5d8f-428c-b720-938652b30719 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:31:01.778356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb2945-5d8f-428c-b720-938652b30719 None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=5ea3933dfc864e5aa8c2445831fbe5fe, user.id=d7dd12afc10d470c8da91ab8026eab7b) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:31:01.778670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb2945-5d8f-428c-b720-938652b30719 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:31:01.780073 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb2945-5d8f-428c-b720-938652b30719 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:31:01.785800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 603/1200] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:31:01 2022] GET /identity/v3/role_assignments?user.id=d7dd12afc10d470c8da91ab8026eab7b&scope.project.id=5ea3933dfc864e5aa8c2445831fbe5fe&role.id=70f81a43849a47f7bf393b354a46d048 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:03.380018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd675970-acde-4665-851f-02f0f1b81c86 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:03.380622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd675970-acde-4665-851f-02f0f1b81c86 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:03.380622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd675970-acde-4665-851f-02f0f1b81c86 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:03.382093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 598/1201] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:32:03.390192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd304639-3e7f-43e2-ab12-91f837dc2a9a None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:03.390192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd304639-3e7f-43e2-ab12-91f837dc2a9a None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:03.390192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd304639-3e7f-43e2-ab12-91f837dc2a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:03.418342 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-bd304639-3e7f-43e2-ab12-91f837dc2a9a None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:03.419597 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bd304639-3e7f-43e2-ab12-91f837dc2a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:03.508400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 604/1202] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:32:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:32:03.536664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd675970-acde-4665-851f-02f0f1b81c86 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:03.662980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd675970-acde-4665-851f-02f0f1b81c86 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:03.707774 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051c936-5be9-45dc-b9a2-22dd0e02eaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:03.708746 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051c936-5be9-45dc-b9a2-22dd0e02eaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:03.709160 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051c936-5be9-45dc-b9a2-22dd0e02eaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:03.709531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051c936-5be9-45dc-b9a2-22dd0e02eaf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:03.722081 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051c936-5be9-45dc-b9a2-22dd0e02eaf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:03.723756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051c936-5be9-45dc-b9a2-22dd0e02eaf8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:03.743950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-3051c936-5be9-45dc-b9a2-22dd0e02eaf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:03.743950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:03.743950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:03.743950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:03.743950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:03.743950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:03.743950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:03.743950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:03.743950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:03.743950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:03.743950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:03.743950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:03.743950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:32:03.743950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:32:03.743950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:03.745127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:03.751629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:32:03.751629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:32:03.751629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:03.751629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:03.751629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 599/1203] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:03.755399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd304639-3e7f-43e2-ab12-91f837dc2a9a None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:03.870223 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd304639-3e7f-43e2-ab12-91f837dc2a9a None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:03.910724 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985272ac-d75b-454a-97b6-f95477f64068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:03.911430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985272ac-d75b-454a-97b6-f95477f64068 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:03.911701 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985272ac-d75b-454a-97b6-f95477f64068 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:03.911978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985272ac-d75b-454a-97b6-f95477f64068 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:03.912709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985272ac-d75b-454a-97b6-f95477f64068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:03.913072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985272ac-d75b-454a-97b6-f95477f64068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:03.914418 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985272ac-d75b-454a-97b6-f95477f64068 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:03.927871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 605/1204] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:32:03.934339 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051c936-5be9-45dc-b9a2-22dd0e02eaf8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:04.051440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051c936-5be9-45dc-b9a2-22dd0e02eaf8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:04.095664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f528c4d-3b35-431d-8fa8-cc4444b91f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:04.096643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f528c4d-3b35-431d-8fa8-cc4444b91f52 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:04.096643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f528c4d-3b35-431d-8fa8-cc4444b91f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:04.096920 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f528c4d-3b35-431d-8fa8-cc4444b91f52 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:04.097675 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f528c4d-3b35-431d-8fa8-cc4444b91f52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:04.099203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f528c4d-3b35-431d-8fa8-cc4444b91f52 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:04.130604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 600/1205] 10.222.0.58 () {60 vars in 1132 bytes} [Thu May 5 15:32:03 2022] POST /identity/v3/users => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:32:06.711930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b1a3f-852c-4ffe-842c-e958650a64c7 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:06.712470 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b1a3f-852c-4ffe-842c-e958650a64c7 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:06.712470 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b1a3f-852c-4ffe-842c-e958650a64c7 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:06.714089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 606/1206] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:32:06.720523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11284c-8542-42d3-86be-3f6e397c89fe None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:06.720985 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11284c-8542-42d3-86be-3f6e397c89fe None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:06.721103 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11284c-8542-42d3-86be-3f6e397c89fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:06.740301 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-eb11284c-8542-42d3-86be-3f6e397c89fe None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:06.741488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-eb11284c-8542-42d3-86be-3f6e397c89fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:06.816215 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 601/1207] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:32:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:32:06.844182 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b1a3f-852c-4ffe-842c-e958650a64c7 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:06.961513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b1a3f-852c-4ffe-842c-e958650a64c7 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:06.996686 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884d28d-51cd-4403-a58a-12993daec5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:06.997513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884d28d-51cd-4403-a58a-12993daec5db None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:06.998326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884d28d-51cd-4403-a58a-12993daec5db None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:06.998603 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884d28d-51cd-4403-a58a-12993daec5db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:07.009826 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884d28d-51cd-4403-a58a-12993daec5db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-f884d28d-51cd-4403-a58a-12993daec5db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:32:07.024924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:07.026250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:07.027930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:07.027930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:07.027930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:07.027930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:07.027930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:32:07.027930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:32:07.027930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:32:07.027930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:32:07.027930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:32:07.027930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:32:07.027930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:32:07.027930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:07.027930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 607/1208] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:32:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:07.032729 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11284c-8542-42d3-86be-3f6e397c89fe None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:07.153602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11284c-8542-42d3-86be-3f6e397c89fe None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:07.192119 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5c207-2d70-441d-9ba0-004fed27dc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:07.192805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5c207-2d70-441d-9ba0-004fed27dc9f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:07.193058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5c207-2d70-441d-9ba0-004fed27dc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:07.193359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5c207-2d70-441d-9ba0-004fed27dc9f None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:07.194080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5c207-2d70-441d-9ba0-004fed27dc9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:07.195334 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5c207-2d70-441d-9ba0-004fed27dc9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:07.195787 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5c207-2d70-441d-9ba0-004fed27dc9f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:07.210955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 602/1209] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:32:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:32:07.213489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884d28d-51cd-4403-a58a-12993daec5db None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:07.327135 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884d28d-51cd-4403-a58a-12993daec5db None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:07.366528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d038724-269c-4d1b-b599-67d4384f1e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:07.367410 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d038724-269c-4d1b-b599-67d4384f1e80 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:07.367723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d038724-269c-4d1b-b599-67d4384f1e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:07.367998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d038724-269c-4d1b-b599-67d4384f1e80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:07.378547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d038724-269c-4d1b-b599-67d4384f1e80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:07.379995 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d038724-269c-4d1b-b599-67d4384f1e80 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:07.399361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-1d038724-269c-4d1b-b599-67d4384f1e80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:07.399361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:07.399361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:07.399361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:07.399361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:07.399361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:07.399361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:07.399361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:07.399361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:07.399361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:07.399361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:07.399361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:07.399361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:32:07.399361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:32:07.399361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:07.400574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:07.403181 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:32:07.403181 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:32:07.403181 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:07.403181 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:07.403181 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 608/1210] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:32:07.407406 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5c207-2d70-441d-9ba0-004fed27dc9f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:07.516758 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5c207-2d70-441d-9ba0-004fed27dc9f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:07.562947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b0cbf-7dcb-4197-971d-84c77525dc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:07.563706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b0cbf-7dcb-4197-971d-84c77525dc61 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:07.564026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b0cbf-7dcb-4197-971d-84c77525dc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:07.564345 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b0cbf-7dcb-4197-971d-84c77525dc61 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:07.565160 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b0cbf-7dcb-4197-971d-84c77525dc61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:07.565471 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b0cbf-7dcb-4197-971d-84c77525dc61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:07.566911 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b0cbf-7dcb-4197-971d-84c77525dc61 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:07.586254 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 603/1211] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:07.588476 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d038724-269c-4d1b-b599-67d4384f1e80 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:07.698667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d038724-269c-4d1b-b599-67d4384f1e80 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:07.735316 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4b58d-0fa3-43c0-abdd-a034d62ea893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:07.736161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4b58d-0fa3-43c0-abdd-a034d62ea893 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:07.736388 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4b58d-0fa3-43c0-abdd-a034d62ea893 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:07.736688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4b58d-0fa3-43c0-abdd-a034d62ea893 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:07.744235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4b58d-0fa3-43c0-abdd-a034d62ea893 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:07.745781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4b58d-0fa3-43c0-abdd-a034d62ea893 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-5fa4b58d-0fa3-43c0-abdd-a034d62ea893 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:32:07.761764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:07.762994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:07.764149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:07.764149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:07.764149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:32:07.764149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:32:07.764149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:32:07.764149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:32:07.764149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:32:07.764149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:32:07.764149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:32:07.764149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:07.764149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 609/1212] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:07.770112 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b0cbf-7dcb-4197-971d-84c77525dc61 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:07.881934 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b0cbf-7dcb-4197-971d-84c77525dc61 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:07.916645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe7f4e-29e1-4225-ac06-aec33778e1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:07.917353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe7f4e-29e1-4225-ac06-aec33778e1df None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:07.917646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe7f4e-29e1-4225-ac06-aec33778e1df None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:07.917888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe7f4e-29e1-4225-ac06-aec33778e1df None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:07.918796 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe7f4e-29e1-4225-ac06-aec33778e1df None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:07.919100 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe7f4e-29e1-4225-ac06-aec33778e1df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:07.920610 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe7f4e-29e1-4225-ac06-aec33778e1df None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:07.939223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 604/1213] 10.222.0.58 () {56 vars in 1143 bytes} [Thu May 5 15:32:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:07.945127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4b58d-0fa3-43c0-abdd-a034d62ea893 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:08.053309 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4b58d-0fa3-43c0-abdd-a034d62ea893 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:08.091181 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ddd76-4f6c-490f-8676-80a329982802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:08.092308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ddd76-4f6c-490f-8676-80a329982802 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:08.092660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ddd76-4f6c-490f-8676-80a329982802 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:08.092998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ddd76-4f6c-490f-8676-80a329982802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:08.165632 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ddd76-4f6c-490f-8676-80a329982802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:08.167116 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ddd76-4f6c-490f-8676-80a329982802 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:08.284441 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 610/1214] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:32:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:32:08.285426 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe7f4e-29e1-4225-ac06-aec33778e1df None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:08.389082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe7f4e-29e1-4225-ac06-aec33778e1df None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:08.424243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a7f59-d871-4686-92d7-a1f078107949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:08.426328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a7f59-d871-4686-92d7-a1f078107949 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:08.427565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a7f59-d871-4686-92d7-a1f078107949 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:08.427565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a7f59-d871-4686-92d7-a1f078107949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:08.437914 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a7f59-d871-4686-92d7-a1f078107949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:08.439406 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a7f59-d871-4686-92d7-a1f078107949 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:08.458271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-fa8a7f59-d871-4686-92d7-a1f078107949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:08.458271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:08.458271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:08.458271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:08.458271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:08.458271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:08.458271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:08.458271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:08.458271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:08.458271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:08.458271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:08.458271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:08.458271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:32:08.458271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:32:08.458271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:08.459491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:08.465054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:32:08.465054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:32:08.465054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:08.465054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:08.465054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 605/1215] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:08.467127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ddd76-4f6c-490f-8676-80a329982802 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:08.582141 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ddd76-4f6c-490f-8676-80a329982802 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:08.621525 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e33ac-47e6-4216-a7e9-564fdcf00374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:08.622208 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e33ac-47e6-4216-a7e9-564fdcf00374 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:08.623064 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e33ac-47e6-4216-a7e9-564fdcf00374 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:08.623787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e33ac-47e6-4216-a7e9-564fdcf00374 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:08.624973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e33ac-47e6-4216-a7e9-564fdcf00374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:08.625325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e33ac-47e6-4216-a7e9-564fdcf00374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:08.627052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e33ac-47e6-4216-a7e9-564fdcf00374 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:08.646713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 611/1216] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:08.647899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a7f59-d871-4686-92d7-a1f078107949 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:08.756680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a7f59-d871-4686-92d7-a1f078107949 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:08.793089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0686e27-5cfb-4d50-9b67-393401532ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:08.793903 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0686e27-5cfb-4d50-9b67-393401532ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:08.794138 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0686e27-5cfb-4d50-9b67-393401532ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:08.794990 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0686e27-5cfb-4d50-9b67-393401532ae6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:08.802018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0686e27-5cfb-4d50-9b67-393401532ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:08.803541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0686e27-5cfb-4d50-9b67-393401532ae6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:08.817980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d0686e27-5cfb-4d50-9b67-393401532ae6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:32:08.817980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:08.817980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:08.817980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:08.817980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:08.817980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:08.817980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:08.817980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:08.817980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:08.817980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:08.817980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:08.817980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:08.817980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:32:08.817980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:32:08.817980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:08.819382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:08.820542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:32:08.820542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:32:08.820542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:32:08.820542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:32:08.820542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:32:08.820542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:32:08.820542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:32:08.820542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:08.820542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 606/1217] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:32:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:08.825088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e33ac-47e6-4216-a7e9-564fdcf00374 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:08.939798 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e33ac-47e6-4216-a7e9-564fdcf00374 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:08.980723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2073101-e87a-4ca3-9892-a7f160764485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:08.981401 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2073101-e87a-4ca3-9892-a7f160764485 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:08.981728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2073101-e87a-4ca3-9892-a7f160764485 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:08.982070 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2073101-e87a-4ca3-9892-a7f160764485 None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:08.982836 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2073101-e87a-4ca3-9892-a7f160764485 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:08.983148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2073101-e87a-4ca3-9892-a7f160764485 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:08.984653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2073101-e87a-4ca3-9892-a7f160764485 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:09.002591 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 612/1218] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:32:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:09.005656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0686e27-5cfb-4d50-9b67-393401532ae6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:09.123902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0686e27-5cfb-4d50-9b67-393401532ae6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:09.162491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc7363-19c6-4525-bfe7-9d8228116058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:09.163166 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc7363-19c6-4525-bfe7-9d8228116058 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:09.163444 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc7363-19c6-4525-bfe7-9d8228116058 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:09.163714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc7363-19c6-4525-bfe7-9d8228116058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:09.164538 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc7363-19c6-4525-bfe7-9d8228116058 None admin] RBAC: Adding query filter params (role.id=0b37e8a909204679b705bf258b1cd8f1, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=a12f5d874be84f1ca79eb439267c7b70) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:09.164847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc7363-19c6-4525-bfe7-9d8228116058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:09.166401 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc7363-19c6-4525-bfe7-9d8228116058 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:09.177078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 607/1219] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:32:09 2022] GET /identity/v3/role_assignments?user.id=a12f5d874be84f1ca79eb439267c7b70&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=0b37e8a909204679b705bf258b1cd8f1 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:32:11.630355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740481f-aeb1-4cb5-94d1-fa30efc10bfb None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:11.630912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740481f-aeb1-4cb5-94d1-fa30efc10bfb None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:11.630912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740481f-aeb1-4cb5-94d1-fa30efc10bfb None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:11.632612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 613/1220] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:32:11.639370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca1ea-8abc-4499-822e-46fc2e7f4dea None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:11.640013 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca1ea-8abc-4499-822e-46fc2e7f4dea None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:11.640013 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca1ea-8abc-4499-822e-46fc2e7f4dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:11.657208 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-aa6ca1ea-8abc-4499-822e-46fc2e7f4dea None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:11.658530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-aa6ca1ea-8abc-4499-822e-46fc2e7f4dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:11.729840 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 608/1221] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:32:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 05 15:32:11.755125 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740481f-aeb1-4cb5-94d1-fa30efc10bfb None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:11.868259 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740481f-aeb1-4cb5-94d1-fa30efc10bfb None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:11.907377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c95ff-5af4-4a6d-ba89-7cf6601cffc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:11.908198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c95ff-5af4-4a6d-ba89-7cf6601cffc9 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:11.908569 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c95ff-5af4-4a6d-ba89-7cf6601cffc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:11.908965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c95ff-5af4-4a6d-ba89-7cf6601cffc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:11.922140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c95ff-5af4-4a6d-ba89-7cf6601cffc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-ea5c95ff-5af4-4a6d-ba89-7cf6601cffc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:32:11.931794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:11.933041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:11.933925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:11.933925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:11.933925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:11.933925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:11.933925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:32:11.933925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:32:11.933925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:32:11.933925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:32:11.933925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:32:11.933925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:32:11.933925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:32:11.933925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:11.933925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 614/1222] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:32:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:11.940245 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ca1ea-8abc-4499-822e-46fc2e7f4dea None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:12.043019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ca1ea-8abc-4499-822e-46fc2e7f4dea None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:12.077238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6217b-a6b8-4a85-a14e-2778831a814b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:12.077926 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6217b-a6b8-4a85-a14e-2778831a814b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:12.078218 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6217b-a6b8-4a85-a14e-2778831a814b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:12.078495 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6217b-a6b8-4a85-a14e-2778831a814b None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:12.079307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6217b-a6b8-4a85-a14e-2778831a814b None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:12.079529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6217b-a6b8-4a85-a14e-2778831a814b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:12.080877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6217b-a6b8-4a85-a14e-2778831a814b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:12.089123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 609/1223] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:32:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:12.096069 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c95ff-5af4-4a6d-ba89-7cf6601cffc9 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:12.210977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c95ff-5af4-4a6d-ba89-7cf6601cffc9 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:12.254843 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22650dc7-6554-4547-bb2e-1e3d09028949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:12.255748 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22650dc7-6554-4547-bb2e-1e3d09028949 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:12.256070 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22650dc7-6554-4547-bb2e-1e3d09028949 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:12.256419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22650dc7-6554-4547-bb2e-1e3d09028949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:12.268132 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22650dc7-6554-4547-bb2e-1e3d09028949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:12.269781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22650dc7-6554-4547-bb2e-1e3d09028949 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:12.290026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-22650dc7-6554-4547-bb2e-1e3d09028949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:12.290026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:12.290026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:12.290026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:12.290026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:12.290026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:12.290026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:12.290026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:12.290026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:12.290026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:12.290026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:12.290026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:12.290026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:32:12.290026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:32:12.290026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:12.291203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:12.292293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:32:12.292293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:32:12.292293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:12.292293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:12.298199 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 615/1224] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:12.298383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6217b-a6b8-4a85-a14e-2778831a814b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:12.410269 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6217b-a6b8-4a85-a14e-2778831a814b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:12.445831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c73df3-bfdf-4024-b308-d4b0b8e89041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:12.446512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73df3-bfdf-4024-b308-d4b0b8e89041 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:12.446795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73df3-bfdf-4024-b308-d4b0b8e89041 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:12.447070 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73df3-bfdf-4024-b308-d4b0b8e89041 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:12.447779 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c73df3-bfdf-4024-b308-d4b0b8e89041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:12.448085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c73df3-bfdf-4024-b308-d4b0b8e89041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:12.449433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c73df3-bfdf-4024-b308-d4b0b8e89041 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:12.462635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 610/1225] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:12.469671 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22650dc7-6554-4547-bb2e-1e3d09028949 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:12.583216 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22650dc7-6554-4547-bb2e-1e3d09028949 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:12.620981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a4655-050f-4502-8747-260a8d26b66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:12.621785 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a4655-050f-4502-8747-260a8d26b66d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:12.622075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a4655-050f-4502-8747-260a8d26b66d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:12.622414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a4655-050f-4502-8747-260a8d26b66d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:12.629942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a4655-050f-4502-8747-260a8d26b66d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:12.631556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a4655-050f-4502-8747-260a8d26b66d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-f08a4655-050f-4502-8747-260a8d26b66d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:32:12.648460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:12.649661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:12.650787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:12.650787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:12.650787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:32:12.650787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:32:12.650787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:32:12.650787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:32:12.650787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:32:12.650787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:32:12.650787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:32:12.650787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:12.650787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 616/1226] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:12.656622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c73df3-bfdf-4024-b308-d4b0b8e89041 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:12.759824 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c73df3-bfdf-4024-b308-d4b0b8e89041 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:12.796738 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5d24b-a6f6-4781-87dd-59f139d9996d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:12.797468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5d24b-a6f6-4781-87dd-59f139d9996d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:12.797803 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5d24b-a6f6-4781-87dd-59f139d9996d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:12.798130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5d24b-a6f6-4781-87dd-59f139d9996d None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:12.799075 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5d24b-a6f6-4781-87dd-59f139d9996d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:12.799390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5d24b-a6f6-4781-87dd-59f139d9996d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:12.801004 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5d24b-a6f6-4781-87dd-59f139d9996d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:12.820106 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 611/1227] 10.222.0.58 () {56 vars in 1143 bytes} [Thu May 5 15:32:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:12.826125 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a4655-050f-4502-8747-260a8d26b66d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:12.930060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a4655-050f-4502-8747-260a8d26b66d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:12.968180 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208cc9d-0a26-41d7-ad0a-85e812186d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:12.969034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208cc9d-0a26-41d7-ad0a-85e812186d82 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:12.969377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208cc9d-0a26-41d7-ad0a-85e812186d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:12.969679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208cc9d-0a26-41d7-ad0a-85e812186d82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:12.981426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208cc9d-0a26-41d7-ad0a-85e812186d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:12.983118 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208cc9d-0a26-41d7-ad0a-85e812186d82 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:13.002814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-a208cc9d-0a26-41d7-ad0a-85e812186d82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:13.002814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:13.002814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:13.002814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:13.002814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:13.002814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:13.002814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:13.002814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:13.002814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:13.002814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:13.002814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:13.002814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:13.002814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:32:13.002814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:32:13.002814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:13.003960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:13.005253 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:32:13.005253 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:32:13.005253 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:13.005253 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:13.005253 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 617/1228] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:13.009997 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5d24b-a6f6-4781-87dd-59f139d9996d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:13.115944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5d24b-a6f6-4781-87dd-59f139d9996d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:13.153038 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23cf85-f519-41a3-8a76-df086e260c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:13.153757 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23cf85-f519-41a3-8a76-df086e260c19 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:13.154036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23cf85-f519-41a3-8a76-df086e260c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:13.154336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23cf85-f519-41a3-8a76-df086e260c19 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:13.155065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23cf85-f519-41a3-8a76-df086e260c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:13.155366 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23cf85-f519-41a3-8a76-df086e260c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:13.156724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23cf85-f519-41a3-8a76-df086e260c19 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:13.167986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 612/1229] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:32:13.173838 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208cc9d-0a26-41d7-ad0a-85e812186d82 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:13.281203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208cc9d-0a26-41d7-ad0a-85e812186d82 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:13.316485 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356a0be-ddfb-45ba-96dd-9ae797bb1f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:13.317462 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356a0be-ddfb-45ba-96dd-9ae797bb1f66 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:13.317796 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356a0be-ddfb-45ba-96dd-9ae797bb1f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:13.318077 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356a0be-ddfb-45ba-96dd-9ae797bb1f66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:13.325145 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356a0be-ddfb-45ba-96dd-9ae797bb1f66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:13.327191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356a0be-ddfb-45ba-96dd-9ae797bb1f66 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:13.342140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-e356a0be-ddfb-45ba-96dd-9ae797bb1f66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:32:13.342140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:13.342140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:13.342140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:13.342140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:13.342140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:13.342140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:13.342140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:13.342140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:13.342140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:13.342140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:13.342140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:13.342140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:32:13.342140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:32:13.342140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:13.343297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:13.344243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:32:13.344243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:32:13.344243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:32:13.344243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:32:13.344243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:32:13.344243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:32:13.344243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:32:13.344243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:13.344243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 618/1230] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:32:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:13.349169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23cf85-f519-41a3-8a76-df086e260c19 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:13.450580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23cf85-f519-41a3-8a76-df086e260c19 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:13.487851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef4520-71e1-4163-bb1b-78b38fd1fc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:13.488786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef4520-71e1-4163-bb1b-78b38fd1fc45 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:13.489215 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef4520-71e1-4163-bb1b-78b38fd1fc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:13.489641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef4520-71e1-4163-bb1b-78b38fd1fc45 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:13.490463 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef4520-71e1-4163-bb1b-78b38fd1fc45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:13.490766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef4520-71e1-4163-bb1b-78b38fd1fc45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:13.492311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef4520-71e1-4163-bb1b-78b38fd1fc45 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:13.505350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 613/1231] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:32:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:13.513659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356a0be-ddfb-45ba-96dd-9ae797bb1f66 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:13.619005 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356a0be-ddfb-45ba-96dd-9ae797bb1f66 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:13.656290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91190fb-fc48-4b14-8028-ede75dc78fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:13.657302 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91190fb-fc48-4b14-8028-ede75dc78fad None admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:13.657591 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91190fb-fc48-4b14-8028-ede75dc78fad None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:13.657922 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91190fb-fc48-4b14-8028-ede75dc78fad None admin] PATH_INFO: `/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/a12f5d874be84f1ca79eb439267c7b70/roles/0b37e8a909204679b705bf258b1cd8f1` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:13.672405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91190fb-fc48-4b14-8028-ede75dc78fad None admin] RBAC: Authorizing `identity:create_grant(project_id=bdd58b84c6394504beb84d13d13d60a1, user_id=a12f5d874be84f1ca79eb439267c7b70, role_id=0b37e8a909204679b705bf258b1cd8f1)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:13.673837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91190fb-fc48-4b14-8028-ede75dc78fad None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:13.686517 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 619/1232] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:32:13 2022] PUT /identity/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/a12f5d874be84f1ca79eb439267c7b70/roles/0b37e8a909204679b705bf258b1cd8f1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:16.073863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f590a-14ba-4327-9bd4-466d68f558e8 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.074479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f590a-14ba-4327-9bd4-466d68f558e8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.074479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f590a-14ba-4327-9bd4-466d68f558e8 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.076158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 614/1233] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:32:16.081417 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1495718-d399-4fd4-9b32-b0a5f3421c6a None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.081835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1495718-d399-4fd4-9b32-b0a5f3421c6a None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.081968 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1495718-d399-4fd4-9b32-b0a5f3421c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.100075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-b1495718-d399-4fd4-9b32-b0a5f3421c6a None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:16.101389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b1495718-d399-4fd4-9b32-b0a5f3421c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:16.173980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 620/1234] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:32:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:32:16.199356 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f590a-14ba-4327-9bd4-466d68f558e8 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:16.307637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f590a-14ba-4327-9bd4-466d68f558e8 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:16.347636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b4065-6dff-4721-a3de-2889bbc38cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:16.348396 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b4065-6dff-4721-a3de-2889bbc38cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.348747 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b4065-6dff-4721-a3de-2889bbc38cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.349030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b4065-6dff-4721-a3de-2889bbc38cf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.360149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b4065-6dff-4721-a3de-2889bbc38cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-4b7b4065-6dff-4721-a3de-2889bbc38cf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:32:16.368130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:16.369365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:16.370415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:16.370415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:16.370415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:16.370415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:16.370415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:32:16.370415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:32:16.370415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:32:16.370415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:32:16.370415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:32:16.370415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:32:16.370415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 05 15:32:16.370415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:16.370415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 615/1235] 10.222.0.58 () {56 vars in 1102 bytes} [Thu May 5 15:32:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:16.375518 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1495718-d399-4fd4-9b32-b0a5f3421c6a None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:16.479286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1495718-d399-4fd4-9b32-b0a5f3421c6a None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:16.519900 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f672e0-60f1-4764-8b0b-7112704a2da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:16.520582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f672e0-60f1-4764-8b0b-7112704a2da5 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.520887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f672e0-60f1-4764-8b0b-7112704a2da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.521266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f672e0-60f1-4764-8b0b-7112704a2da5 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.521871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f672e0-60f1-4764-8b0b-7112704a2da5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:16.522207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f672e0-60f1-4764-8b0b-7112704a2da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:16.523619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f672e0-60f1-4764-8b0b-7112704a2da5 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:16.533352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 621/1236] 10.222.0.58 () {56 vars in 1103 bytes} [Thu May 5 15:32:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:16.539281 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b4065-6dff-4721-a3de-2889bbc38cf2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:16.651327 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b4065-6dff-4721-a3de-2889bbc38cf2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:16.688847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f3e1a-b9c5-4258-9947-289fd139b06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:16.689689 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f3e1a-b9c5-4258-9947-289fd139b06f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.690002 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f3e1a-b9c5-4258-9947-289fd139b06f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.690273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f3e1a-b9c5-4258-9947-289fd139b06f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.704631 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f3e1a-b9c5-4258-9947-289fd139b06f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:16.706093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f3e1a-b9c5-4258-9947-289fd139b06f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:16.728441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-ab2f3e1a-b9c5-4258-9947-289fd139b06f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:16.728441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:16.728441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:16.728441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:16.728441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:16.728441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:16.728441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:16.728441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:16.728441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:16.728441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:16.728441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:16.728441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:16.728441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:32:16.728441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:32:16.728441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:16.729594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:16.736307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:32:16.736307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:32:16.736307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:16.736307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:16.736307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 616/1237] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:16.736599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f672e0-60f1-4764-8b0b-7112704a2da5 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:16.853527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f672e0-60f1-4764-8b0b-7112704a2da5 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:16.893897 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf84591-5291-4c4e-99c2-cf3792094a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:16.894603 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf84591-5291-4c4e-99c2-cf3792094a26 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:16.894891 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf84591-5291-4c4e-99c2-cf3792094a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:16.895162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf84591-5291-4c4e-99c2-cf3792094a26 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:16.895879 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf84591-5291-4c4e-99c2-cf3792094a26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:16.896183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf84591-5291-4c4e-99c2-cf3792094a26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:16.897543 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf84591-5291-4c4e-99c2-cf3792094a26 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:16.909613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 622/1238] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:32:16.915414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f3e1a-b9c5-4258-9947-289fd139b06f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:17.020478 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f3e1a-b9c5-4258-9947-289fd139b06f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:17.059598 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5265e-c563-4d7b-8203-84f87180d81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:17.060475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5265e-c563-4d7b-8203-84f87180d81b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:17.060756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5265e-c563-4d7b-8203-84f87180d81b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:17.061029 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5265e-c563-4d7b-8203-84f87180d81b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:17.070605 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5265e-c563-4d7b-8203-84f87180d81b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:17.072624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5265e-c563-4d7b-8203-84f87180d81b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-64f5265e-c563-4d7b-8203-84f87180d81b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:32:17.089709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:17.092541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:17.093781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:17.093781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:17.093781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:32:17.093781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:32:17.093781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:32:17.093781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:32:17.093781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:32:17.093781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:32:17.093781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:32:17.093781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:17.093781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 617/1239] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:17.097664 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf84591-5291-4c4e-99c2-cf3792094a26 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:17.204595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf84591-5291-4c4e-99c2-cf3792094a26 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:17.246276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750f5cf-8466-499c-a40d-a540fa8d1552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:17.247388 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750f5cf-8466-499c-a40d-a540fa8d1552 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:17.247869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750f5cf-8466-499c-a40d-a540fa8d1552 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:17.248268 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750f5cf-8466-499c-a40d-a540fa8d1552 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:17.249268 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750f5cf-8466-499c-a40d-a540fa8d1552 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:17.249691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750f5cf-8466-499c-a40d-a540fa8d1552 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:17.251327 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750f5cf-8466-499c-a40d-a540fa8d1552 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:17.273418 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 623/1240] 10.222.0.58 () {56 vars in 1143 bytes} [Thu May 5 15:32:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:17.280282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5265e-c563-4d7b-8203-84f87180d81b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:17.384589 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5265e-c563-4d7b-8203-84f87180d81b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:17.421994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca6cd4-b5a6-432b-a5b1-f8ba81d5dc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:17.422662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca6cd4-b5a6-432b-a5b1-f8ba81d5dc89 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:17.422942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca6cd4-b5a6-432b-a5b1-f8ba81d5dc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:17.423215 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca6cd4-b5a6-432b-a5b1-f8ba81d5dc89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:17.495035 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca6cd4-b5a6-432b-a5b1-f8ba81d5dc89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:17.496572 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca6cd4-b5a6-432b-a5b1-f8ba81d5dc89 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:17.604616 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 618/1241] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:32:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 05 15:32:17.610993 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750f5cf-8466-499c-a40d-a540fa8d1552 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:17.719867 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750f5cf-8466-499c-a40d-a540fa8d1552 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:17.756508 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753e0f1-5a57-49bc-a648-67710b581e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:17.757310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753e0f1-5a57-49bc-a648-67710b581e1e None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:17.757593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753e0f1-5a57-49bc-a648-67710b581e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:17.757942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753e0f1-5a57-49bc-a648-67710b581e1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:17.768939 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753e0f1-5a57-49bc-a648-67710b581e1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:17.770484 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753e0f1-5a57-49bc-a648-67710b581e1e None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:17.789021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-5753e0f1-5a57-49bc-a648-67710b581e1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:17.789021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:17.789021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:17.789021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:17.789021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:17.789021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:17.789021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:17.789021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:17.789021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:17.789021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:17.789021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:17.789021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:17.789021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:32:17.789021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:32:17.789021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:17.790267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:17.791644 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:32:17.791644 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:32:17.791644 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:17.791644 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:17.791644 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 624/1242] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:17.796884 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca6cd4-b5a6-432b-a5b1-f8ba81d5dc89 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:17.904436 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca6cd4-b5a6-432b-a5b1-f8ba81d5dc89 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:17.943808 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79bd87-4b02-473a-a8fa-c6c3deb4e1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:17.944877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79bd87-4b02-473a-a8fa-c6c3deb4e1cb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:17.945233 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79bd87-4b02-473a-a8fa-c6c3deb4e1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:17.945488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79bd87-4b02-473a-a8fa-c6c3deb4e1cb None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:17.946227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79bd87-4b02-473a-a8fa-c6c3deb4e1cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:17.946533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79bd87-4b02-473a-a8fa-c6c3deb4e1cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:17.948254 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79bd87-4b02-473a-a8fa-c6c3deb4e1cb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:17.961253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 619/1243] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:17.967581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753e0f1-5a57-49bc-a648-67710b581e1e None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:18.080762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753e0f1-5a57-49bc-a648-67710b581e1e None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:18.115904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8e572-1835-4879-beac-cba3ec6207b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:18.116811 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8e572-1835-4879-beac-cba3ec6207b4 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:18.117103 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8e572-1835-4879-beac-cba3ec6207b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:18.117379 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8e572-1835-4879-beac-cba3ec6207b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:18.125199 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8e572-1835-4879-beac-cba3ec6207b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:18.127003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8e572-1835-4879-beac-cba3ec6207b4 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:18.144712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-2dd8e572-1835-4879-beac-cba3ec6207b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:32:18.144712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:18.144712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:18.144712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:18.144712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:18.144712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:18.144712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:18.144712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:18.144712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:18.144712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:18.144712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:18.144712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:18.144712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:32:18.144712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:32:18.144712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:18.146024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:18.147162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:32:18.147162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:32:18.147162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:32:18.147162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:32:18.147162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:32:18.147162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:32:18.147162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:32:18.147162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:18.147162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 625/1244] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:32:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:18.152699 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79bd87-4b02-473a-a8fa-c6c3deb4e1cb None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:18.268902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79bd87-4b02-473a-a8fa-c6c3deb4e1cb None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:18.305774 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6bedf-637a-4233-80c5-5ba693025e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:18.306523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6bedf-637a-4233-80c5-5ba693025e16 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:18.306809 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6bedf-637a-4233-80c5-5ba693025e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:18.307110 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6bedf-637a-4233-80c5-5ba693025e16 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:18.307931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6bedf-637a-4233-80c5-5ba693025e16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:18.308326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6bedf-637a-4233-80c5-5ba693025e16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:18.310018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6bedf-637a-4233-80c5-5ba693025e16 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:18.323607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 620/1245] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:32:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:18.330407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8e572-1835-4879-beac-cba3ec6207b4 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:18.441277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8e572-1835-4879-beac-cba3ec6207b4 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:18.480678 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61f710-3a6b-4051-88b0-de325201f534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:18.482123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61f710-3a6b-4051-88b0-de325201f534 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:18.482410 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61f710-3a6b-4051-88b0-de325201f534 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:18.482917 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61f710-3a6b-4051-88b0-de325201f534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:18.483641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61f710-3a6b-4051-88b0-de325201f534 None admin] RBAC: Adding query filter params (role.id=0b37e8a909204679b705bf258b1cd8f1, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=a12f5d874be84f1ca79eb439267c7b70) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:18.484076 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61f710-3a6b-4051-88b0-de325201f534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:18.485904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61f710-3a6b-4051-88b0-de325201f534 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:18.493566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 626/1246] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:32:18 2022] GET /identity/v3/role_assignments?user.id=a12f5d874be84f1ca79eb439267c7b70&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=0b37e8a909204679b705bf258b1cd8f1 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:20.935374 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a10527-6fe5-406b-95cc-82f8b065c84d None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:20.935965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a10527-6fe5-406b-95cc-82f8b065c84d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:20.935965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a10527-6fe5-406b-95cc-82f8b065c84d None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:20.937443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 621/1247] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:32:20.943082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e3efe-e3cc-4a2b-a5aa-423ae5e1fe46 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:20.943508 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e3efe-e3cc-4a2b-a5aa-423ae5e1fe46 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:20.943615 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e3efe-e3cc-4a2b-a5aa-423ae5e1fe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:20.961612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-013e3efe-e3cc-4a2b-a5aa-423ae5e1fe46 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:20.962829 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-013e3efe-e3cc-4a2b-a5aa-423ae5e1fe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:21.033951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 627/1248] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:32:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:32:21.058613 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a10527-6fe5-406b-95cc-82f8b065c84d None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:21.167917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a10527-6fe5-406b-95cc-82f8b065c84d None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:21.212086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a833de-3381-471e-b934-d5346cd91f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:21.212982 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a833de-3381-471e-b934-d5346cd91f41 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:21.213325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a833de-3381-471e-b934-d5346cd91f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:21.213767 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a833de-3381-471e-b934-d5346cd91f41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:21.227249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a833de-3381-471e-b934-d5346cd91f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-39a833de-3381-471e-b934-d5346cd91f41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:32:21.236257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:21.238264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:21.240167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:21.240167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:21.240167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:21.240167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:21.240167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:32:21.240167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:32:21.240167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:32:21.240167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:32:21.240167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:32:21.240167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:32:21.240167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:32:21.240167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:21.240167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 622/1249] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:32:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:32:21.244296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e3efe-e3cc-4a2b-a5aa-423ae5e1fe46 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:21.353754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e3efe-e3cc-4a2b-a5aa-423ae5e1fe46 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:21.390798 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df2251-9435-44b4-ac44-223bd2a3630d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:21.391601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df2251-9435-44b4-ac44-223bd2a3630d None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:21.392065 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df2251-9435-44b4-ac44-223bd2a3630d None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:21.392475 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df2251-9435-44b4-ac44-223bd2a3630d None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:21.393514 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df2251-9435-44b4-ac44-223bd2a3630d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:21.393853 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df2251-9435-44b4-ac44-223bd2a3630d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:21.395599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df2251-9435-44b4-ac44-223bd2a3630d None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:21.405801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 628/1250] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:32:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:21.411719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a833de-3381-471e-b934-d5346cd91f41 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:21.515552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a833de-3381-471e-b934-d5346cd91f41 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:21.549603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f2832-3382-49ab-a1a3-688c118db5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:21.550412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f2832-3382-49ab-a1a3-688c118db5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:21.550694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f2832-3382-49ab-a1a3-688c118db5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:21.550970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f2832-3382-49ab-a1a3-688c118db5c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:21.562008 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f2832-3382-49ab-a1a3-688c118db5c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:21.563566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f2832-3382-49ab-a1a3-688c118db5c4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:21.580971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-ba0f2832-3382-49ab-a1a3-688c118db5c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:21.580971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:21.580971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:21.580971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:21.580971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:21.580971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:21.580971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:21.580971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:21.580971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:21.580971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:21.580971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:21.580971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:21.580971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:32:21.580971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:32:21.580971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:21.582139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:21.583207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:32:21.583207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:32:21.583207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:21.583207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:21.583207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 623/1251] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:21.588093 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df2251-9435-44b4-ac44-223bd2a3630d None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:21.690293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df2251-9435-44b4-ac44-223bd2a3630d None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:21.727013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8bea1-d1d0-43a1-82db-40bc7d6943bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:21.727678 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8bea1-d1d0-43a1-82db-40bc7d6943bf None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:21.727967 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8bea1-d1d0-43a1-82db-40bc7d6943bf None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:21.728241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8bea1-d1d0-43a1-82db-40bc7d6943bf None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:21.728990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8bea1-d1d0-43a1-82db-40bc7d6943bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:21.729296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8bea1-d1d0-43a1-82db-40bc7d6943bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:21.730699 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8bea1-d1d0-43a1-82db-40bc7d6943bf None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:21.743913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 629/1252] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:21.750008 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f2832-3382-49ab-a1a3-688c118db5c4 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:21.855170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f2832-3382-49ab-a1a3-688c118db5c4 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:21.890999 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16d717-643c-494f-856e-bea89e947ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:21.891875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16d717-643c-494f-856e-bea89e947ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:21.892154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16d717-643c-494f-856e-bea89e947ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:21.892507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16d717-643c-494f-856e-bea89e947ad8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:21.900083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16d717-643c-494f-856e-bea89e947ad8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:21.901539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16d717-643c-494f-856e-bea89e947ad8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-fc16d717-643c-494f-856e-bea89e947ad8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:32:21.919558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:21.920864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:21.921918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:21.921918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:21.921918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:32:21.921918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:32:21.921918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:32:21.921918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:32:21.921918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:32:21.921918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:32:21.921918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:32:21.921918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:21.921918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 624/1253] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:21.930179 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8bea1-d1d0-43a1-82db-40bc7d6943bf None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:22.037345 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8bea1-d1d0-43a1-82db-40bc7d6943bf None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:22.076074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031efe42-d6d2-4d3f-be0e-3f0d59326f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:22.076764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efe42-d6d2-4d3f-be0e-3f0d59326f99 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:22.077051 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efe42-d6d2-4d3f-be0e-3f0d59326f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:22.077326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efe42-d6d2-4d3f-be0e-3f0d59326f99 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:22.078152 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031efe42-d6d2-4d3f-be0e-3f0d59326f99 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:22.078488 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031efe42-d6d2-4d3f-be0e-3f0d59326f99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:22.079905 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031efe42-d6d2-4d3f-be0e-3f0d59326f99 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:22.097816 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 630/1254] 10.222.0.58 () {56 vars in 1143 bytes} [Thu May 5 15:32:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:22.103721 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16d717-643c-494f-856e-bea89e947ad8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:22.213135 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16d717-643c-494f-856e-bea89e947ad8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:22.253913 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a51a9f-fbea-4d6a-835b-42efb13fcf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:22.254599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a51a9f-fbea-4d6a-835b-42efb13fcf51 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:22.254880 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a51a9f-fbea-4d6a-835b-42efb13fcf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:22.255155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a51a9f-fbea-4d6a-835b-42efb13fcf51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:22.325241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a51a9f-fbea-4d6a-835b-42efb13fcf51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:22.326744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a51a9f-fbea-4d6a-835b-42efb13fcf51 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:22.435853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 625/1255] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:32:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:32:22.441691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031efe42-d6d2-4d3f-be0e-3f0d59326f99 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:22.540398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031efe42-d6d2-4d3f-be0e-3f0d59326f99 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:22.573623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02ac29-8944-4c1b-b7b8-f9d099ac306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:22.574437 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02ac29-8944-4c1b-b7b8-f9d099ac306c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:22.575344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02ac29-8944-4c1b-b7b8-f9d099ac306c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:22.576772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02ac29-8944-4c1b-b7b8-f9d099ac306c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:22.587152 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02ac29-8944-4c1b-b7b8-f9d099ac306c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:22.588576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02ac29-8944-4c1b-b7b8-f9d099ac306c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:22.607258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-be02ac29-8944-4c1b-b7b8-f9d099ac306c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:22.607258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:22.607258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:22.607258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:22.607258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:22.607258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:22.607258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:22.607258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:22.607258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:22.607258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:22.607258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:22.607258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:22.607258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:32:22.607258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:32:22.607258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:22.608201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:22.609093 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:32:22.609093 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:32:22.609093 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:22.609093 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:22.609093 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 631/1256] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 05 15:32:22.615254 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a51a9f-fbea-4d6a-835b-42efb13fcf51 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:22.713736 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a51a9f-fbea-4d6a-835b-42efb13fcf51 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:22.748159 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cd527-b075-4eb1-885f-4460f2b1ca1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:22.748811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cd527-b075-4eb1-885f-4460f2b1ca1c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:22.749089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cd527-b075-4eb1-885f-4460f2b1ca1c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:22.749359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cd527-b075-4eb1-885f-4460f2b1ca1c None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:22.750066 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cd527-b075-4eb1-885f-4460f2b1ca1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:22.750398 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cd527-b075-4eb1-885f-4460f2b1ca1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:22.751744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cd527-b075-4eb1-885f-4460f2b1ca1c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:22.762455 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 626/1257] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:22.767829 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02ac29-8944-4c1b-b7b8-f9d099ac306c None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:22.861832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02ac29-8944-4c1b-b7b8-f9d099ac306c None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:22.892700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc09d65-4744-4e6e-884e-0651b194fd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:22.893458 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc09d65-4744-4e6e-884e-0651b194fd09 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:22.893737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc09d65-4744-4e6e-884e-0651b194fd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:22.894008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc09d65-4744-4e6e-884e-0651b194fd09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:22.900208 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc09d65-4744-4e6e-884e-0651b194fd09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:22.901624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc09d65-4744-4e6e-884e-0651b194fd09 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:22.915033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-cdc09d65-4744-4e6e-884e-0651b194fd09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:32:22.915033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:22.915033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:22.915033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:22.915033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:22.915033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:22.915033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:22.915033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:22.915033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:22.915033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:22.915033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:22.915033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:22.915033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:32:22.915033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:32:22.915033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:22.915894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:22.916812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:32:22.916812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:32:22.916812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:32:22.916812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:32:22.916812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:32:22.916812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:32:22.916812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:32:22.916812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:22.916812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 632/1258] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:32:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:22.922177 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cd527-b075-4eb1-885f-4460f2b1ca1c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:23.017964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cd527-b075-4eb1-885f-4460f2b1ca1c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:23.050687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7d54a-6b29-471b-802a-f27b0ad8f1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:23.051327 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7d54a-6b29-471b-802a-f27b0ad8f1eb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.051611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7d54a-6b29-471b-802a-f27b0ad8f1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.051888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7d54a-6b29-471b-802a-f27b0ad8f1eb None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.052656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7d54a-6b29-471b-802a-f27b0ad8f1eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:23.052964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7d54a-6b29-471b-802a-f27b0ad8f1eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:23.054403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7d54a-6b29-471b-802a-f27b0ad8f1eb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:23.066910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 627/1259] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:32:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:23.072768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc09d65-4744-4e6e-884e-0651b194fd09 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:23.170228 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc09d65-4744-4e6e-884e-0651b194fd09 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:23.206427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba08f6-b0d1-44f5-95ed-79734f46e7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:23.207072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba08f6-b0d1-44f5-95ed-79734f46e7dc None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:23.207432 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba08f6-b0d1-44f5-95ed-79734f46e7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:23.207709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba08f6-b0d1-44f5-95ed-79734f46e7dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:23.208679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba08f6-b0d1-44f5-95ed-79734f46e7dc None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=a12f5d874be84f1ca79eb439267c7b70) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:23.209038 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba08f6-b0d1-44f5-95ed-79734f46e7dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:23.210770 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba08f6-b0d1-44f5-95ed-79734f46e7dc None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:23.217181 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 633/1260] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:32:23 2022] GET /identity/v3/role_assignments?user.id=a12f5d874be84f1ca79eb439267c7b70&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=70f81a43849a47f7bf393b354a46d048 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:25.543978 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b0b3-78a7-4bfe-b84c-abea785b1648 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:25.544504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b0b3-78a7-4bfe-b84c-abea785b1648 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:25.544504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b0b3-78a7-4bfe-b84c-abea785b1648 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:25.545853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 628/1261] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:32:25.551095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0c4e2-f6ad-4aeb-8f94-bfb600e6b1f9 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:25.551521 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0c4e2-f6ad-4aeb-8f94-bfb600e6b1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:25.551646 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0c4e2-f6ad-4aeb-8f94-bfb600e6b1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:25.568450 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-dfb0c4e2-f6ad-4aeb-8f94-bfb600e6b1f9 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:25.569616 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-dfb0c4e2-f6ad-4aeb-8f94-bfb600e6b1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:25.632324 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 634/1262] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:32:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:32:25.665560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459b0b3-78a7-4bfe-b84c-abea785b1648 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:25.762767 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459b0b3-78a7-4bfe-b84c-abea785b1648 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:25.795275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a889bcf-063b-4122-9a31-f4beef333b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:25.796046 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a889bcf-063b-4122-9a31-f4beef333b5c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:25.796323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a889bcf-063b-4122-9a31-f4beef333b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:25.796594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a889bcf-063b-4122-9a31-f4beef333b5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:25.806071 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a889bcf-063b-4122-9a31-f4beef333b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-7a889bcf-063b-4122-9a31-f4beef333b5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:32:25.813547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:25.814677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:25.815883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:25.815883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:25.815883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:25.815883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:25.815883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:32:25.815883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:32:25.815883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:32:25.815883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:32:25.815883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:32:25.815883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:32:25.815883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:32:25.815883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:25.815883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 629/1263] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:32:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:25.820827 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0c4e2-f6ad-4aeb-8f94-bfb600e6b1f9 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:25.913741 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0c4e2-f6ad-4aeb-8f94-bfb600e6b1f9 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:25.945646 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e92dbd-e141-4cdf-bb44-c9c6f43fde14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:25.946337 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e92dbd-e141-4cdf-bb44-c9c6f43fde14 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:25.946618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e92dbd-e141-4cdf-bb44-c9c6f43fde14 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:25.946892 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e92dbd-e141-4cdf-bb44-c9c6f43fde14 None admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:25.947624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e92dbd-e141-4cdf-bb44-c9c6f43fde14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:25.947925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e92dbd-e141-4cdf-bb44-c9c6f43fde14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:25.949326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e92dbd-e141-4cdf-bb44-c9c6f43fde14 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:25.956986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 635/1264] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:32:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:25.962620 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a889bcf-063b-4122-9a31-f4beef333b5c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:26.057093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a889bcf-063b-4122-9a31-f4beef333b5c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:26.088537 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849325e5-8dc1-487e-8ff2-19988ff5f3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:26.089312 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849325e5-8dc1-487e-8ff2-19988ff5f3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:26.089596 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849325e5-8dc1-487e-8ff2-19988ff5f3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:26.089941 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849325e5-8dc1-487e-8ff2-19988ff5f3a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:26.100764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849325e5-8dc1-487e-8ff2-19988ff5f3a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:26.102207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849325e5-8dc1-487e-8ff2-19988ff5f3a5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:26.119147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-849325e5-8dc1-487e-8ff2-19988ff5f3a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:26.119147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:26.119147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:26.119147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:26.119147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:26.119147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:26.119147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:26.119147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:26.119147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:26.119147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:26.119147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:26.119147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:26.119147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:32:26.119147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:32:26.119147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:26.120224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:26.122240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:32:26.122240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:32:26.122240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:26.122240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:26.122240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 630/1265] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:26.126788 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e92dbd-e141-4cdf-bb44-c9c6f43fde14 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:26.231598 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e92dbd-e141-4cdf-bb44-c9c6f43fde14 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:26.271386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c4d7f-fa4a-45ac-a1f6-1db2cdd302a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:26.272037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c4d7f-fa4a-45ac-a1f6-1db2cdd302a1 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:26.272366 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c4d7f-fa4a-45ac-a1f6-1db2cdd302a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:26.272654 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c4d7f-fa4a-45ac-a1f6-1db2cdd302a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:26.273305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c4d7f-fa4a-45ac-a1f6-1db2cdd302a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:26.273621 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c4d7f-fa4a-45ac-a1f6-1db2cdd302a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:26.275022 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c4d7f-fa4a-45ac-a1f6-1db2cdd302a1 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:26.288364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 636/1266] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:26.295009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849325e5-8dc1-487e-8ff2-19988ff5f3a5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:26.389689 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849325e5-8dc1-487e-8ff2-19988ff5f3a5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:26.421570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f96379-94e1-4d75-80c6-ce1fa73fa322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:26.422367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f96379-94e1-4d75-80c6-ce1fa73fa322 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:26.422645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f96379-94e1-4d75-80c6-ce1fa73fa322 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:26.422911 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f96379-94e1-4d75-80c6-ce1fa73fa322 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:26.429821 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f96379-94e1-4d75-80c6-ce1fa73fa322 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:26.431258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f96379-94e1-4d75-80c6-ce1fa73fa322 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-c0f96379-94e1-4d75-80c6-ce1fa73fa322 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:32:26.444753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:26.445837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:26.447128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:26.447128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:26.447128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:32:26.447128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:32:26.447128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:32:26.447128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:32:26.447128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:32:26.447128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:32:26.447128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:32:26.447128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:26.447128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 631/1267] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:26.451687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c4d7f-fa4a-45ac-a1f6-1db2cdd302a1 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:26.546143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c4d7f-fa4a-45ac-a1f6-1db2cdd302a1 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:26.579566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7bc05-541a-4e8d-bc7f-de2977b62b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:26.580220 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7bc05-541a-4e8d-bc7f-de2977b62b42 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:26.580495 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7bc05-541a-4e8d-bc7f-de2977b62b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:26.580764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7bc05-541a-4e8d-bc7f-de2977b62b42 None admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:26.581572 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7bc05-541a-4e8d-bc7f-de2977b62b42 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:26.581873 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7bc05-541a-4e8d-bc7f-de2977b62b42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:26.583308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7bc05-541a-4e8d-bc7f-de2977b62b42 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:26.600037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 637/1268] 10.222.0.58 () {56 vars in 1143 bytes} [Thu May 5 15:32:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:26.606323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f96379-94e1-4d75-80c6-ce1fa73fa322 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:26.700028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f96379-94e1-4d75-80c6-ce1fa73fa322 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:26.732186 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6229c-cb58-499b-af5a-be47f64c33aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:26.732950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6229c-cb58-499b-af5a-be47f64c33aa None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:26.733228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6229c-cb58-499b-af5a-be47f64c33aa None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:26.733498 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6229c-cb58-499b-af5a-be47f64c33aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:26.743421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6229c-cb58-499b-af5a-be47f64c33aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:26.744828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6229c-cb58-499b-af5a-be47f64c33aa None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:26.760853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-6ad6229c-cb58-499b-af5a-be47f64c33aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:26.760853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:26.760853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:26.760853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:26.760853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:26.760853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:26.760853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:26.760853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:26.760853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:26.760853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:26.760853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:26.760853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:26.760853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:32:26.760853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:32:26.760853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:26.761928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:26.763278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:32:26.763278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:32:26.763278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:26.763278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:26.763278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 632/1269] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:26.767776 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7bc05-541a-4e8d-bc7f-de2977b62b42 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:26.861101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7bc05-541a-4e8d-bc7f-de2977b62b42 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:26.892249 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f7bb1-8fe5-475d-bf66-a9e84b87e484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:26.892889 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f7bb1-8fe5-475d-bf66-a9e84b87e484 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:26.893168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f7bb1-8fe5-475d-bf66-a9e84b87e484 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:26.893440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f7bb1-8fe5-475d-bf66-a9e84b87e484 None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:26.894142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f7bb1-8fe5-475d-bf66-a9e84b87e484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:26.894497 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f7bb1-8fe5-475d-bf66-a9e84b87e484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:26.895832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f7bb1-8fe5-475d-bf66-a9e84b87e484 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:26.906881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 638/1270] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:26.912375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6229c-cb58-499b-af5a-be47f64c33aa None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:27.005892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6229c-cb58-499b-af5a-be47f64c33aa None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:27.037520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8eba4-1e60-495d-b623-a34ea4d0327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:27.038315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8eba4-1e60-495d-b623-a34ea4d0327d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:27.038598 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8eba4-1e60-495d-b623-a34ea4d0327d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:27.038870 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8eba4-1e60-495d-b623-a34ea4d0327d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:27.045782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8eba4-1e60-495d-b623-a34ea4d0327d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:27.047231 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8eba4-1e60-495d-b623-a34ea4d0327d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:27.060905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d0a8eba4-1e60-495d-b623-a34ea4d0327d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:32:27.060905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:27.060905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:27.060905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:27.060905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:27.060905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:27.060905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:27.060905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:27.060905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:27.060905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:27.060905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:27.060905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:27.060905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:32:27.060905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:32:27.060905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:27.061974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:27.063155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:32:27.063155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:32:27.063155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:32:27.063155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:32:27.063155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:32:27.063155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:32:27.063155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:32:27.063155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:27.063155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 633/1271] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:27.067674 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f7bb1-8fe5-475d-bf66-a9e84b87e484 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:27.162852 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f7bb1-8fe5-475d-bf66-a9e84b87e484 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:27.195663 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af06304-5024-452e-9cf9-ca4ac3c6f14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:27.196359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af06304-5024-452e-9cf9-ca4ac3c6f14f None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:27.196711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af06304-5024-452e-9cf9-ca4ac3c6f14f None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:27.196911 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af06304-5024-452e-9cf9-ca4ac3c6f14f None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:27.197759 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af06304-5024-452e-9cf9-ca4ac3c6f14f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:27.198068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af06304-5024-452e-9cf9-ca4ac3c6f14f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:27.199752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af06304-5024-452e-9cf9-ca4ac3c6f14f None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:27.213801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 639/1272] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:32:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:27.221098 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8eba4-1e60-495d-b623-a34ea4d0327d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:27.316865 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8eba4-1e60-495d-b623-a34ea4d0327d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:27.350281 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f0160-b9e9-4569-98aa-55232df7fee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:27.351146 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f0160-b9e9-4569-98aa-55232df7fee0 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:27.351427 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f0160-b9e9-4569-98aa-55232df7fee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:27.351701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f0160-b9e9-4569-98aa-55232df7fee0 None admin] PATH_INFO: `/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/a12f5d874be84f1ca79eb439267c7b70/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:27.353622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f0160-b9e9-4569-98aa-55232df7fee0 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdd58b84c6394504beb84d13d13d60a1, user_id=a12f5d874be84f1ca79eb439267c7b70, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:27.355063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f0160-b9e9-4569-98aa-55232df7fee0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:27.367518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 634/1273] 10.222.0.58 () {58 vars in 1439 bytes} [Thu May 5 15:32:27 2022] PUT /identity/v3/projects/bdd58b84c6394504beb84d13d13d60a1/users/a12f5d874be84f1ca79eb439267c7b70/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:32:29.594484 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45f466-40ff-4332-af20-7e76be267fe7 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:29.594993 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45f466-40ff-4332-af20-7e76be267fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:29.595070 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45f466-40ff-4332-af20-7e76be267fe7 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:29.596386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 640/1274] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:32:29.601624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba905e6-83be-476a-9b70-a9b01a4d575b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:29.602032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba905e6-83be-476a-9b70-a9b01a4d575b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:29.602198 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba905e6-83be-476a-9b70-a9b01a4d575b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:29.618644 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4ba905e6-83be-476a-9b70-a9b01a4d575b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:29.619801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4ba905e6-83be-476a-9b70-a9b01a4d575b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:29.682157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 635/1275] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:32:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:32:29.706352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45f466-40ff-4332-af20-7e76be267fe7 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:29.801627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45f466-40ff-4332-af20-7e76be267fe7 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:29.833932 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e9854-e1ae-40f8-ae81-ccfb2c3dae79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:29.834731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e9854-e1ae-40f8-ae81-ccfb2c3dae79 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:29.835014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e9854-e1ae-40f8-ae81-ccfb2c3dae79 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:29.835282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e9854-e1ae-40f8-ae81-ccfb2c3dae79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:29.845671 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e9854-e1ae-40f8-ae81-ccfb2c3dae79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-825e9854-e1ae-40f8-ae81-ccfb2c3dae79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(role_id) May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 05 15:32:29.853198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:29.854321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:29.855718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:29.855718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:29.855718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:29.855718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:29.855718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 05 15:32:29.855718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 05 15:32:29.855718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 05 15:32:29.855718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 05 15:32:29.855718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 05 15:32:29.855718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 05 15:32:29.855718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 05 15:32:29.855718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:29.855718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 641/1276] 10.222.0.58 () {56 vars in 1096 bytes} [Thu May 5 15:32:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:29.860456 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba905e6-83be-476a-9b70-a9b01a4d575b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:29.952611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba905e6-83be-476a-9b70-a9b01a4d575b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:29.984284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348cd04-37cd-4313-9abc-5ce2901753e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:29.984927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348cd04-37cd-4313-9abc-5ce2901753e1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:29.985203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348cd04-37cd-4313-9abc-5ce2901753e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:29.985474 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348cd04-37cd-4313-9abc-5ce2901753e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:29.986229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348cd04-37cd-4313-9abc-5ce2901753e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:29.986530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348cd04-37cd-4313-9abc-5ce2901753e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:29.987875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348cd04-37cd-4313-9abc-5ce2901753e1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:29.995458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 636/1277] 10.222.0.58 () {56 vars in 1099 bytes} [Thu May 5 15:32:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:30.001020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e9854-e1ae-40f8-ae81-ccfb2c3dae79 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:30.096368 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e9854-e1ae-40f8-ae81-ccfb2c3dae79 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:30.127416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2a660-d080-4cff-88a0-087ec3d650a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:30.128189 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2a660-d080-4cff-88a0-087ec3d650a4 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:30.128468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2a660-d080-4cff-88a0-087ec3d650a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:30.128739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2a660-d080-4cff-88a0-087ec3d650a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:30.139382 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2a660-d080-4cff-88a0-087ec3d650a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:30.140844 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2a660-d080-4cff-88a0-087ec3d650a4 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:30.157782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-87d2a660-d080-4cff-88a0-087ec3d650a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:30.157782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:30.157782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:30.157782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:30.157782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:30.157782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:30.157782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:30.157782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:30.157782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:30.157782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:30.157782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:30.157782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:30.157782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:32:30.157782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:32:30.157782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:30.158818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:30.159904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:32:30.159904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:32:30.159904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:30.159904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:30.159904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 642/1278] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:30.164572 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348cd04-37cd-4313-9abc-5ce2901753e1 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:30.275641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348cd04-37cd-4313-9abc-5ce2901753e1 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:30.306719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af15480-c1f8-45bf-8ef1-418c9824588f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:30.307368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af15480-c1f8-45bf-8ef1-418c9824588f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:30.307647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af15480-c1f8-45bf-8ef1-418c9824588f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:30.307917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af15480-c1f8-45bf-8ef1-418c9824588f None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:30.309221 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af15480-c1f8-45bf-8ef1-418c9824588f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:30.309521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af15480-c1f8-45bf-8ef1-418c9824588f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:30.310890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af15480-c1f8-45bf-8ef1-418c9824588f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:30.321970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 637/1279] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:30.328274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2a660-d080-4cff-88a0-087ec3d650a4 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:30.421806 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2a660-d080-4cff-88a0-087ec3d650a4 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:30.453327 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc63b78-49df-4edf-942b-ff66ed548f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:30.454097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc63b78-49df-4edf-942b-ff66ed548f62 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:30.454403 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc63b78-49df-4edf-942b-ff66ed548f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:30.454674 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc63b78-49df-4edf-942b-ff66ed548f62 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:30.461657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc63b78-49df-4edf-942b-ff66ed548f62 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:30.463105 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc63b78-49df-4edf-942b-ff66ed548f62 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-bbc63b78-49df-4edf-942b-ff66ed548f62 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_user(user_id) May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 05 15:32:30.477447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:30.478613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:30.479789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:30.479789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:30.479789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 05 15:32:30.479789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 05 15:32:30.479789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 05 15:32:30.479789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 05 15:32:30.479789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 05 15:32:30.479789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 05 15:32:30.479789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 05 15:32:30.479789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:30.479789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 643/1280] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:30.484519 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af15480-c1f8-45bf-8ef1-418c9824588f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:30.580728 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af15480-c1f8-45bf-8ef1-418c9824588f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:30.613277 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66042a-d7b5-4fc3-9317-6111838a72a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:30.613993 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66042a-d7b5-4fc3-9317-6111838a72a7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:30.614306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66042a-d7b5-4fc3-9317-6111838a72a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:30.614583 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66042a-d7b5-4fc3-9317-6111838a72a7 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:30.615403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66042a-d7b5-4fc3-9317-6111838a72a7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:30.615709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66042a-d7b5-4fc3-9317-6111838a72a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:30.617123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66042a-d7b5-4fc3-9317-6111838a72a7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:30.633915 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 638/1281] 10.222.0.58 () {56 vars in 1143 bytes} [Thu May 5 15:32:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:30.639773 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc63b78-49df-4edf-942b-ff66ed548f62 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:30.734515 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc63b78-49df-4edf-942b-ff66ed548f62 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:30.765976 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffc637-bf05-4903-913b-8e281a5d5f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:30.766632 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffc637-bf05-4903-913b-8e281a5d5f39 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:30.766914 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffc637-bf05-4903-913b-8e281a5d5f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:30.767186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffc637-bf05-4903-913b-8e281a5d5f39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:30.829509 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffc637-bf05-4903-913b-8e281a5d5f39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:30.830966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffc637-bf05-4903-913b-8e281a5d5f39 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:30.922763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 644/1282] 10.222.0.58 () {58 vars in 1282 bytes} [Thu May 5 15:32:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 05 15:32:30.928466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66042a-d7b5-4fc3-9317-6111838a72a7 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:31.021307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66042a-d7b5-4fc3-9317-6111838a72a7 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:31.052428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd7b92-1d07-4321-834a-111dda9d3747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:31.053198 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd7b92-1d07-4321-834a-111dda9d3747 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:31.053477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd7b92-1d07-4321-834a-111dda9d3747 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:31.053747 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd7b92-1d07-4321-834a-111dda9d3747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:31.064048 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd7b92-1d07-4321-834a-111dda9d3747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:31.065466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd7b92-1d07-4321-834a-111dda9d3747 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:31.082654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d6bd7b92-1d07-4321-834a-111dda9d3747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:31.082654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:31.082654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:31.082654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:31.082654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:31.082654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:31.082654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:31.082654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:31.082654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:31.082654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:31.082654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:31.082654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:31.082654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 05 15:32:31.082654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 05 15:32:31.082654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:31.083662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:31.084727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 05 15:32:31.084727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 05 15:32:31.084727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 05 15:32:31.084727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:31.084727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 639/1283] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:31.089255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffc637-bf05-4903-913b-8e281a5d5f39 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:31.184777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffc637-bf05-4903-913b-8e281a5d5f39 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:31.217857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97710478-79c1-421a-93cd-4ea7d97ed0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:31.218537 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97710478-79c1-421a-93cd-4ea7d97ed0da None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:31.218823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97710478-79c1-421a-93cd-4ea7d97ed0da None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:31.219094 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97710478-79c1-421a-93cd-4ea7d97ed0da None admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:31.219799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97710478-79c1-421a-93cd-4ea7d97ed0da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:31.220100 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97710478-79c1-421a-93cd-4ea7d97ed0da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:31.221445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97710478-79c1-421a-93cd-4ea7d97ed0da None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:31.232011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 645/1284] 10.222.0.58 () {56 vars in 1109 bytes} [Thu May 5 15:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:31.237695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd7b92-1d07-4321-834a-111dda9d3747 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:31.331265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd7b92-1d07-4321-834a-111dda9d3747 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:31.363706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053db0d6-0c01-47e5-9023-ef7faed79e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:31.364464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053db0d6-0c01-47e5-9023-ef7faed79e95 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:31.364738 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053db0d6-0c01-47e5-9023-ef7faed79e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:31.365008 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053db0d6-0c01-47e5-9023-ef7faed79e95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:31.371270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053db0d6-0c01-47e5-9023-ef7faed79e95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:31.372680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053db0d6-0c01-47e5-9023-ef7faed79e95 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:31.385603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-053db0d6-0c01-47e5-9023-ef7faed79e95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:32:31.385603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:31.385603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:31.385603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:31.385603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:31.385603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:31.385603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:31.385603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:31.385603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:31.385603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:31.385603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:31.385603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:31.385603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 05 15:32:31.385603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) May 05 15:32:31.385603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:31.387182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:31.388275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 05 15:32:31.388275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 05 15:32:31.388275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 05 15:32:31.388275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 05 15:32:31.388275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 05 15:32:31.388275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 05 15:32:31.388275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 05 15:32:31.388275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application May 05 15:32:31.388275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 640/1285] 10.222.0.58 () {56 vars in 1111 bytes} [Thu May 5 15:32:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:31.393020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97710478-79c1-421a-93cd-4ea7d97ed0da None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:31.488272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97710478-79c1-421a-93cd-4ea7d97ed0da None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:31.521063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69439dee-4029-4e4d-b447-cd67820ded19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:31.521717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69439dee-4029-4e4d-b447-cd67820ded19 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:31.521994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69439dee-4029-4e4d-b447-cd67820ded19 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:31.522296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69439dee-4029-4e4d-b447-cd67820ded19 None admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:31.523072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69439dee-4029-4e4d-b447-cd67820ded19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:31.523377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69439dee-4029-4e4d-b447-cd67820ded19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:31.524792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69439dee-4029-4e4d-b447-cd67820ded19 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:31.537789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 646/1286] 10.222.0.58 () {56 vars in 1148 bytes} [Thu May 5 15:32:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:31.543874 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053db0d6-0c01-47e5-9023-ef7faed79e95 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:31.637577 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053db0d6-0c01-47e5-9023-ef7faed79e95 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:31.668302 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc214d27-8ef2-4c31-b37e-26033ee0ac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:31.668933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc214d27-8ef2-4c31-b37e-26033ee0ac4e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:31.669214 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc214d27-8ef2-4c31-b37e-26033ee0ac4e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:31.669482 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc214d27-8ef2-4c31-b37e-26033ee0ac4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:31.670330 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc214d27-8ef2-4c31-b37e-26033ee0ac4e None admin] RBAC: Adding query filter params (role.id=70f81a43849a47f7bf393b354a46d048, scope.project.id=bdd58b84c6394504beb84d13d13d60a1, user.id=a12f5d874be84f1ca79eb439267c7b70) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:31.670634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc214d27-8ef2-4c31-b37e-26033ee0ac4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:31.672026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc214d27-8ef2-4c31-b37e-26033ee0ac4e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:31.677477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 641/1287] 10.222.0.58 () {56 vars in 1374 bytes} [Thu May 5 15:32:31 2022] GET /identity/v3/role_assignments?user.id=a12f5d874be84f1ca79eb439267c7b70&scope.project.id=bdd58b84c6394504beb84d13d13d60a1&role.id=70f81a43849a47f7bf393b354a46d048 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:33.941152 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f05c6-86b8-4fbc-b775-68a729fd1fbd None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:33.941708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f05c6-86b8-4fbc-b775-68a729fd1fbd None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:33.941708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f05c6-86b8-4fbc-b775-68a729fd1fbd None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:33.943097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 647/1288] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:32:33.948176 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8a7a-a79b-4ea4-a7c7-e4899d0439dc None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:33.948671 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8a7a-a79b-4ea4-a7c7-e4899d0439dc None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:33.948845 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8a7a-a79b-4ea4-a7c7-e4899d0439dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:33.965674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-2ddf8a7a-a79b-4ea4-a7c7-e4899d0439dc None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:33.966871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-2ddf8a7a-a79b-4ea4-a7c7-e4899d0439dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:34.028852 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 642/1289] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:32:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:32:34.051237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f05c6-86b8-4fbc-b775-68a729fd1fbd None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:34.145913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f05c6-86b8-4fbc-b775-68a729fd1fbd None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:34.178500 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ff020-915a-47f0-ad16-c7695065038c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:34.179277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ff020-915a-47f0-ad16-c7695065038c None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:34.179561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ff020-915a-47f0-ad16-c7695065038c None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:34.179839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ff020-915a-47f0-ad16-c7695065038c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:34.180476 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ff020-915a-47f0-ad16-c7695065038c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:34.181825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ff020-915a-47f0-ad16-c7695065038c None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-162ff020-915a-47f0-ad16-c7695065038c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:34.194885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:34.196377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:34.197676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:34.197676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:34.197676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:34.197676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:34.197676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:34.197676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:34.197676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:34.197676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:34.197676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:34.197676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:34.197676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:32:34.197676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:32:34.197676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:32:34.197676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:34.197676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 648/1290] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 5 15:32:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:34.203532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf8a7a-a79b-4ea4-a7c7-e4899d0439dc None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:34.311860 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf8a7a-a79b-4ea4-a7c7-e4899d0439dc None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:34.344985 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97112c-98f4-4e47-95a4-7c9e81ea8ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:34.345639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97112c-98f4-4e47-95a4-7c9e81ea8ccf None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:34.345919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97112c-98f4-4e47-95a4-7c9e81ea8ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:34.346210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97112c-98f4-4e47-95a4-7c9e81ea8ccf None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:34.346909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97112c-98f4-4e47-95a4-7c9e81ea8ccf None admin] RBAC: Adding query filter params (name=placement) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:34.347213 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97112c-98f4-4e47-95a4-7c9e81ea8ccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:34.348565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97112c-98f4-4e47-95a4-7c9e81ea8ccf None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:34.353223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 643/1291] 10.222.0.58 () {56 vars in 1116 bytes} [Thu May 5 15:32:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:34.359061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ff020-915a-47f0-ad16-c7695065038c None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:34.453663 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ff020-915a-47f0-ad16-c7695065038c None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:34.485605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbdc8a-0d00-4ad2-97bc-8c26181723bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:34.486280 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbdc8a-0d00-4ad2-97bc-8c26181723bb None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:34.486566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbdc8a-0d00-4ad2-97bc-8c26181723bb None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:34.486843 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbdc8a-0d00-4ad2-97bc-8c26181723bb None admin] PATH_INFO: `/v3/services` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:34.487540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbdc8a-0d00-4ad2-97bc-8c26181723bb None admin] RBAC: Adding query filter params (type=placement) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:34.487847 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbdc8a-0d00-4ad2-97bc-8c26181723bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:34.489201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbdc8a-0d00-4ad2-97bc-8c26181723bb None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:34.493427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 649/1292] 10.222.0.58 () {56 vars in 1116 bytes} [Thu May 5 15:32:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:36.701111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2511d9-511e-462d-9100-1277c320ab41 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:36.701673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2511d9-511e-462d-9100-1277c320ab41 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:36.701673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2511d9-511e-462d-9100-1277c320ab41 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:36.703037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 644/1293] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:32:36.707985 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f2f0c-68e9-4e45-8d90-a574a97e69f7 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:36.708367 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f2f0c-68e9-4e45-8d90-a574a97e69f7 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:36.708538 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f2f0c-68e9-4e45-8d90-a574a97e69f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:36.725610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-047f2f0c-68e9-4e45-8d90-a574a97e69f7 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:36.726791 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-047f2f0c-68e9-4e45-8d90-a574a97e69f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:36.788696 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 650/1294] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:32:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:32:36.812272 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2511d9-511e-462d-9100-1277c320ab41 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:36.908048 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2511d9-511e-462d-9100-1277c320ab41 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:36.940238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e85065-ead8-4fd8-b1fc-fb92941c61aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:36.940867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85065-ead8-4fd8-b1fc-fb92941c61aa None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:36.941146 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85065-ead8-4fd8-b1fc-fb92941c61aa None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:36.941419 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85065-ead8-4fd8-b1fc-fb92941c61aa None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:36.942137 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e85065-ead8-4fd8-b1fc-fb92941c61aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:36.943515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e85065-ead8-4fd8-b1fc-fb92941c61aa None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:36.955872 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 645/1295] 10.222.0.58 () {60 vars in 1141 bytes} [Thu May 5 15:32:36 2022] POST /identity/v3/services => generated 246 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:32:39.158304 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc2eb5-18e5-4746-bf84-e6c85616143f None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:39.158869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc2eb5-18e5-4746-bf84-e6c85616143f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:39.158869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc2eb5-18e5-4746-bf84-e6c85616143f None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:39.160188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 651/1296] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:32:39.165307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8700af7-9ea3-47b5-9179-1c5769b366b2 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:39.165718 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8700af7-9ea3-47b5-9179-1c5769b366b2 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:39.165873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8700af7-9ea3-47b5-9179-1c5769b366b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:39.182792 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e8700af7-9ea3-47b5-9179-1c5769b366b2 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:39.183962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e8700af7-9ea3-47b5-9179-1c5769b366b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:39.262897 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 646/1297] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:32:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:32:39.290049 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc2eb5-18e5-4746-bf84-e6c85616143f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:39.385197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc2eb5-18e5-4746-bf84-e6c85616143f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:39.417598 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20a970-1d75-44f9-90b6-661ecda262ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:39.418340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20a970-1d75-44f9-90b6-661ecda262ad None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:39.418673 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20a970-1d75-44f9-90b6-661ecda262ad None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:39.418957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20a970-1d75-44f9-90b6-661ecda262ad None admin] PATH_INFO: `/v3/services/placement` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:39.419600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20a970-1d75-44f9-90b6-661ecda262ad None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:39.425474 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20a970-1d75-44f9-90b6-661ecda262ad None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-5d20a970-1d75-44f9-90b6-661ecda262ad None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:39.437191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:39.438540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:39.439613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:39.439613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:39.439613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:39.439613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:39.439613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:39.439613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:39.439613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:39.439613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:39.439613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:39.439613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:39.439613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:32:39.439613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:32:39.439613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:32:39.439613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:39.440937 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 652/1298] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 5 15:32:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:39.446925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8700af7-9ea3-47b5-9179-1c5769b366b2 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:39.541129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8700af7-9ea3-47b5-9179-1c5769b366b2 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:39.574160 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a31021-b2b3-4a53-aa29-5d247a31b4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:39.574904 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a31021-b2b3-4a53-aa29-5d247a31b4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:39.575181 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a31021-b2b3-4a53-aa29-5d247a31b4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:39.575451 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a31021-b2b3-4a53-aa29-5d247a31b4c6 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:39.576143 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a31021-b2b3-4a53-aa29-5d247a31b4c6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:39.576441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a31021-b2b3-4a53-aa29-5d247a31b4c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:39.577789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a31021-b2b3-4a53-aa29-5d247a31b4c6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:39.582700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 647/1299] 10.222.0.58 () {56 vars in 1116 bytes} [Thu May 5 15:32:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:39.588592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20a970-1d75-44f9-90b6-661ecda262ad None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:39.683038 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20a970-1d75-44f9-90b6-661ecda262ad None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:39.714968 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b26827-68a3-4197-8e36-be3227fd02a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:39.715869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b26827-68a3-4197-8e36-be3227fd02a3 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:39.716144 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b26827-68a3-4197-8e36-be3227fd02a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:39.716413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b26827-68a3-4197-8e36-be3227fd02a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:39.717187 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b26827-68a3-4197-8e36-be3227fd02a3 None admin] RBAC: Adding query filter params (interface=public, service_id=424b6178465846a4927ab9d5bc7364da, region_id=RegionOne) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:39.717494 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b26827-68a3-4197-8e36-be3227fd02a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:39.718864 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b26827-68a3-4197-8e36-be3227fd02a3 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:39.723660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 653/1300] 10.222.0.58 () {56 vars in 1251 bytes} [Thu May 5 15:32:39 2022] GET /identity/v3/endpoints?service_id=424b6178465846a4927ab9d5bc7364da&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:39.729194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a31021-b2b3-4a53-aa29-5d247a31b4c6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:39.824612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a31021-b2b3-4a53-aa29-5d247a31b4c6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:39.857129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b467ff-b199-45e0-913b-d04cc4a08bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:39.857780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b467ff-b199-45e0-913b-d04cc4a08bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:39.858059 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b467ff-b199-45e0-913b-d04cc4a08bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:39.858361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b467ff-b199-45e0-913b-d04cc4a08bf7 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:39.859041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b467ff-b199-45e0-913b-d04cc4a08bf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:39.860382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b467ff-b199-45e0-913b-d04cc4a08bf7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:39.867001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 648/1301] 10.222.0.58 () {56 vars in 1087 bytes} [Thu May 5 15:32:39 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:32:42.116697 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dfc25-0a0e-41ea-b88b-3f83bc9f9afa None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:42.117230 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dfc25-0a0e-41ea-b88b-3f83bc9f9afa None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:42.117230 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dfc25-0a0e-41ea-b88b-3f83bc9f9afa None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:42.118630 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 654/1302] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:32:42.123819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb3be8-5c98-4dad-b702-ffbfaca34b0e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:42.124195 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb3be8-5c98-4dad-b702-ffbfaca34b0e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:42.124402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb3be8-5c98-4dad-b702-ffbfaca34b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:42.140970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-5ceb3be8-5c98-4dad-b702-ffbfaca34b0e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:32:42.142187 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5ceb3be8-5c98-4dad-b702-ffbfaca34b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:32:42.206541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 649/1303] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:32:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 05 15:32:42.229257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dfc25-0a0e-41ea-b88b-3f83bc9f9afa None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:42.327583 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dfc25-0a0e-41ea-b88b-3f83bc9f9afa None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:42.358718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcaffad-4005-46fc-9496-6ee02699c0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:42.359496 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaffad-4005-46fc-9496-6ee02699c0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:42.359783 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaffad-4005-46fc-9496-6ee02699c0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:42.360059 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaffad-4005-46fc-9496-6ee02699c0d7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:42.360701 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcaffad-4005-46fc-9496-6ee02699c0d7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:42.362050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcaffad-4005-46fc-9496-6ee02699c0d7 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application [None req-ffcaffad-4005-46fc-9496-6ee02699c0d7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application Traceback (most recent call last): May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 05 15:32:42.374262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._get_service(service_id) May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 05 15:32:42.375361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.get_or_create( May 05 15:32:42.376377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 05 15:32:42.376377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application with Lock( May 05 15:32:42.376377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 05 15:32:42.376377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self._enter() May 05 15:32:42.376377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 05 15:32:42.376377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 05 15:32:42.376377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 05 15:32:42.376377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application return self.creator() May 05 15:32:42.376377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 05 15:32:42.376377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application created_value = creator( May 05 15:32:42.376377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 05 15:32:42.376377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 05 15:32:42.376377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 05 15:32:42.376377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: ERROR keystone.server.flask.application May 05 15:32:42.376377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 655/1304] 10.222.0.58 () {56 vars in 1117 bytes} [Thu May 5 15:32:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 05 15:32:42.381229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb3be8-5c98-4dad-b702-ffbfaca34b0e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:42.473442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb3be8-5c98-4dad-b702-ffbfaca34b0e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:42.504594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec7ccd-99b3-48f2-9a4a-0d457b0875b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:42.505239 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec7ccd-99b3-48f2-9a4a-0d457b0875b6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:42.505516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec7ccd-99b3-48f2-9a4a-0d457b0875b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:42.505789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec7ccd-99b3-48f2-9a4a-0d457b0875b6 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:42.506531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec7ccd-99b3-48f2-9a4a-0d457b0875b6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:32:42.506830 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec7ccd-99b3-48f2-9a4a-0d457b0875b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:42.508189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec7ccd-99b3-48f2-9a4a-0d457b0875b6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:42.514341 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 650/1305] 10.222.0.58 () {56 vars in 1116 bytes} [Thu May 5 15:32:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:32:42.519930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcaffad-4005-46fc-9496-6ee02699c0d7 None admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:32:42.612817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcaffad-4005-46fc-9496-6ee02699c0d7 None admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:32:42.643833 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af629d4-8069-43b5-95c3-428c18aa48d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:32:42.644405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af629d4-8069-43b5-95c3-428c18aa48d2 None admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:32:42.644682 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af629d4-8069-43b5-95c3-428c18aa48d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:32:42.644950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af629d4-8069-43b5-95c3-428c18aa48d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:32:42.645667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af629d4-8069-43b5-95c3-428c18aa48d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:32:42.647034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af629d4-8069-43b5-95c3-428c18aa48d2 None admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:32:42.663980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 656/1306] 10.222.0.58 () {60 vars in 1144 bytes} [Thu May 5 15:32:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:33:46.558851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec6ed9-9570-4890-ba22-abd76d5d9140 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:46.559869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec6ed9-9570-4890-ba22-abd76d5d9140 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:46.560353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec6ed9-9570-4890-ba22-abd76d5d9140 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:46.565778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 651/1307] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:33:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:33:46.567062 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8c02b-b57b-481d-af87-8d291bd75925 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:46.567848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8c02b-b57b-481d-af87-8d291bd75925 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:46.568295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8c02b-b57b-481d-af87-8d291bd75925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:46.652454 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-c9d8c02b-b57b-481d-af87-8d291bd75925 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:46.654356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c9d8c02b-b57b-481d-af87-8d291bd75925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:46.769637 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 657/1308] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:46.824277 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083a942-8ec0-483b-9494-d0009a4d610a None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:46.824933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083a942-8ec0-483b-9494-d0009a4d610a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:46.825468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083a942-8ec0-483b-9494-d0009a4d610a None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:46.828548 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 652/1309] 10.222.0.58 () {54 vars in 964 bytes} [Thu May 5 15:33:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:33:46.834873 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f0232-7494-4be6-8429-8243df48224f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:46.835201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f0232-7494-4be6-8429-8243df48224f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:46.835410 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f0232-7494-4be6-8429-8243df48224f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:46.927814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-dd1f0232-7494-4be6-8429-8243df48224f None None] MFA Rules not processed for user `2fe9f8eb94c84c36ad7a49507b2c8360`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:46.929907 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-dd1f0232-7494-4be6-8429-8243df48224f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:47.026577 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 658/1310] 10.222.0.58 () {58 vars in 1061 bytes} [Thu May 5 15:33:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:47.035965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083a942-8ec0-483b-9494-d0009a4d610a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:47.038227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-1083a942-8ec0-483b-9494-d0009a4d610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:47.149864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083a942-8ec0-483b-9494-d0009a4d610a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:47.226037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5e019-5b5f-4bd8-8b05-945a172bbf4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:47.226969 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5e019-5b5f-4bd8-8b05-945a172bbf4d service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:47.227423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5e019-5b5f-4bd8-8b05-945a172bbf4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:47.227872 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5e019-5b5f-4bd8-8b05-945a172bbf4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:47.229741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-cff5e019-5b5f-4bd8-8b05-945a172bbf4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:47.339438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5e019-5b5f-4bd8-8b05-945a172bbf4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:47.340856 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5e019-5b5f-4bd8-8b05-945a172bbf4d service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:47.359251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 653/1311] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:49.996941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770e63d-9cd7-4198-a881-2cb9887e997a None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:49.997522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770e63d-9cd7-4198-a881-2cb9887e997a None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:49.997624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770e63d-9cd7-4198-a881-2cb9887e997a None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:50.002488 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 659/1312] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:33:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:33:50.009675 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948bfc7-5456-4487-b843-023bacb57fcc None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:50.010573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948bfc7-5456-4487-b843-023bacb57fcc None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:50.010920 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948bfc7-5456-4487-b843-023bacb57fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:50.093346 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-1948bfc7-5456-4487-b843-023bacb57fcc None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:50.094667 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-1948bfc7-5456-4487-b843-023bacb57fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:50.194251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 654/1313] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:33:50.234347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770e63d-9cd7-4198-a881-2cb9887e997a None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:50.236120 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-1770e63d-9cd7-4198-a881-2cb9887e997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:50.344926 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770e63d-9cd7-4198-a881-2cb9887e997a None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:50.415327 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cb04d-281e-40db-89ab-5aa0cda70560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:50.416086 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cb04d-281e-40db-89ab-5aa0cda70560 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:50.416367 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cb04d-281e-40db-89ab-5aa0cda70560 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:50.416635 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cb04d-281e-40db-89ab-5aa0cda70560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:50.418272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d22cb04d-281e-40db-89ab-5aa0cda70560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:50.539276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cb04d-281e-40db-89ab-5aa0cda70560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:50.541051 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cb04d-281e-40db-89ab-5aa0cda70560 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:50.560345 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 660/1314] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:53.146260 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497ab0-ce51-4261-bffd-11c562be2664 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:53.146969 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497ab0-ce51-4261-bffd-11c562be2664 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:53.146969 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497ab0-ce51-4261-bffd-11c562be2664 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:53.148193 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 655/1315] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:33:53.153128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0ce67-fedf-48c3-96f0-3e1c02dd37f3 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:53.153550 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0ce67-fedf-48c3-96f0-3e1c02dd37f3 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:53.153679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0ce67-fedf-48c3-96f0-3e1c02dd37f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:53.217260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-22d0ce67-fedf-48c3-96f0-3e1c02dd37f3 None None] MFA Rules not processed for user `d5392740d74041fc8ae879c1f5794f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:53.218477 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-22d0ce67-fedf-48c3-96f0-3e1c02dd37f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:53.311886 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 661/1316] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:33:53 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:53.351725 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f497ab0-ce51-4261-bffd-11c562be2664 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:53.353250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3f497ab0-ce51-4261-bffd-11c562be2664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:53.452198 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f497ab0-ce51-4261-bffd-11c562be2664 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:53.523034 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6641a-1069-4149-9a7d-c2ee5b7246fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:53.523705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6641a-1069-4149-9a7d-c2ee5b7246fb service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:53.523984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6641a-1069-4149-9a7d-c2ee5b7246fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:53.524253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6641a-1069-4149-9a7d-c2ee5b7246fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:53.525852 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-eda6641a-1069-4149-9a7d-c2ee5b7246fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:53.630376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6641a-1069-4149-9a7d-c2ee5b7246fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:53.631793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6641a-1069-4149-9a7d-c2ee5b7246fb service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:53.649155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 656/1317] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:33:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:56.405026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67865e-7af9-49d1-a949-8a9693e0b274 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:56.405562 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67865e-7af9-49d1-a949-8a9693e0b274 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:56.405679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67865e-7af9-49d1-a949-8a9693e0b274 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:56.406999 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 662/1318] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:33:56.412176 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99f06-291a-47d8-a056-995186b544a8 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:56.412572 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99f06-291a-47d8-a056-995186b544a8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:56.412731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99f06-291a-47d8-a056-995186b544a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:56.475356 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-65e99f06-291a-47d8-a056-995186b544a8 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:56.476612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-65e99f06-291a-47d8-a056-995186b544a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:56.570815 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 657/1319] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:33:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:33:56.609143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67865e-7af9-49d1-a949-8a9693e0b274 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:33:56.610692 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-2d67865e-7af9-49d1-a949-8a9693e0b274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:56.714084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67865e-7af9-49d1-a949-8a9693e0b274 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:33:56.782607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2b7f9-8b69-4fe2-a7f3-ae3cd231e691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:33:56.783239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2b7f9-8b69-4fe2-a7f3-ae3cd231e691 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:56.783519 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2b7f9-8b69-4fe2-a7f3-ae3cd231e691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:56.783796 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2b7f9-8b69-4fe2-a7f3-ae3cd231e691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:56.785389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7bc2b7f9-8b69-4fe2-a7f3-ae3cd231e691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:33:56.888754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2b7f9-8b69-4fe2-a7f3-ae3cd231e691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:33:56.890198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2b7f9-8b69-4fe2-a7f3-ae3cd231e691 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:33:56.907961 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 663/1320] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:33:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:33:59.879918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6714e6c-ae6f-4718-8fb4-7b67df0a3239 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:59.880478 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6714e6c-ae6f-4718-8fb4-7b67df0a3239 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:59.880478 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6714e6c-ae6f-4718-8fb4-7b67df0a3239 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:59.882460 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 658/1321] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:33:59.887653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3420d0-47dd-4b1b-9d2c-66045b5dc020 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:33:59.888066 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3420d0-47dd-4b1b-9d2c-66045b5dc020 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:33:59.888204 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3420d0-47dd-4b1b-9d2c-66045b5dc020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:33:59.950506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-ec3420d0-47dd-4b1b-9d2c-66045b5dc020 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:33:59.951696 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-ec3420d0-47dd-4b1b-9d2c-66045b5dc020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:00.045708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 664/1322] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:00.098358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5853236-3701-4cc3-9071-cc7becba7b0e None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:00.098644 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5853236-3701-4cc3-9071-cc7becba7b0e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:00.098917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5853236-3701-4cc3-9071-cc7becba7b0e None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:00.100295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 659/1323] 10.222.0.58 () {54 vars in 964 bytes} [Thu May 5 15:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:00.106424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1599f-b1e1-4349-9bc0-74a160d7e76b None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:00.106712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1599f-b1e1-4349-9bc0-74a160d7e76b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:00.107016 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1599f-b1e1-4349-9bc0-74a160d7e76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:00.179493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-fae1599f-b1e1-4349-9bc0-74a160d7e76b None None] MFA Rules not processed for user `2fe9f8eb94c84c36ad7a49507b2c8360`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:00.180679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-fae1599f-b1e1-4349-9bc0-74a160d7e76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:00.257281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 665/1324] 10.222.0.58 () {58 vars in 1061 bytes} [Thu May 5 15:34:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:00.266384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5853236-3701-4cc3-9071-cc7becba7b0e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:00.267941 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d5853236-3701-4cc3-9071-cc7becba7b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:00.368727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5853236-3701-4cc3-9071-cc7becba7b0e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:00.439309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb59222-f401-4b6b-a593-13b6154b047b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:00.439871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb59222-f401-4b6b-a593-13b6154b047b service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:00.440149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb59222-f401-4b6b-a593-13b6154b047b service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:00.440421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb59222-f401-4b6b-a593-13b6154b047b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:00.442020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0fb59222-f401-4b6b-a593-13b6154b047b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:00.548891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb59222-f401-4b6b-a593-13b6154b047b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:00.550358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb59222-f401-4b6b-a593-13b6154b047b service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:00.570801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 660/1325] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:03.112005 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd5e88-a9f6-4254-a2be-7fca0714558d None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:03.112545 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd5e88-a9f6-4254-a2be-7fca0714558d None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:03.112545 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd5e88-a9f6-4254-a2be-7fca0714558d None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:03.113923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 666/1326] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:03.119807 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1dde5-2485-4eb1-b0a3-4e0e849d2dfa None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:03.120235 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1dde5-2485-4eb1-b0a3-4e0e849d2dfa None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:03.120388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1dde5-2485-4eb1-b0a3-4e0e849d2dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:03.183295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d7b1dde5-2485-4eb1-b0a3-4e0e849d2dfa None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:03.184484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d7b1dde5-2485-4eb1-b0a3-4e0e849d2dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:03.277401 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 661/1327] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:34:03.313352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd5e88-a9f6-4254-a2be-7fca0714558d None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:03.314905 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-3cdd5e88-a9f6-4254-a2be-7fca0714558d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:03.418074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd5e88-a9f6-4254-a2be-7fca0714558d None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:03.494645 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d4ca8-70c2-4161-8863-219915ef2326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:03.495285 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d4ca8-70c2-4161-8863-219915ef2326 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:03.495562 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d4ca8-70c2-4161-8863-219915ef2326 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:03.495828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d4ca8-70c2-4161-8863-219915ef2326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:03.497427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-014d4ca8-70c2-4161-8863-219915ef2326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:03.605578 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d4ca8-70c2-4161-8863-219915ef2326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:03.607037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d4ca8-70c2-4161-8863-219915ef2326 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:03.625003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 667/1328] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:06.039714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210091b1-dfac-4130-b613-f3faee67fd87 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:06.040296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210091b1-dfac-4130-b613-f3faee67fd87 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:06.040296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210091b1-dfac-4130-b613-f3faee67fd87 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:06.041641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 662/1329] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:06.047023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26864b3b-1fbd-47c7-a320-3f54f6649939 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:06.047450 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26864b3b-1fbd-47c7-a320-3f54f6649939 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:06.047728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26864b3b-1fbd-47c7-a320-3f54f6649939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:06.123659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-26864b3b-1fbd-47c7-a320-3f54f6649939 None None] MFA Rules not processed for user `d5392740d74041fc8ae879c1f5794f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:06.124866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-26864b3b-1fbd-47c7-a320-3f54f6649939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:06.231068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 668/1330] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:34:06.268357 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210091b1-dfac-4130-b613-f3faee67fd87 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:06.269909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-210091b1-dfac-4130-b613-f3faee67fd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:06.370609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210091b1-dfac-4130-b613-f3faee67fd87 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:06.440954 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd29886-6490-4a3a-8ded-5d9e5df3be5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:06.441602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd29886-6490-4a3a-8ded-5d9e5df3be5a service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:06.441881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd29886-6490-4a3a-8ded-5d9e5df3be5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:06.442153 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd29886-6490-4a3a-8ded-5d9e5df3be5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:06.444601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-fbd29886-6490-4a3a-8ded-5d9e5df3be5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:06.552115 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd29886-6490-4a3a-8ded-5d9e5df3be5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:06.554461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd29886-6490-4a3a-8ded-5d9e5df3be5a service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:06.571729 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 663/1331] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:09.234443 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e84a2-9967-4c81-8361-8ba14b44d66e None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:09.234975 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e84a2-9967-4c81-8361-8ba14b44d66e None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:09.234975 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e84a2-9967-4c81-8361-8ba14b44d66e None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:09.236355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 669/1332] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:09.241946 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd82806-7a5d-47f4-a0b9-168055ce5585 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:09.242452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd82806-7a5d-47f4-a0b9-168055ce5585 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:09.242681 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd82806-7a5d-47f4-a0b9-168055ce5585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:09.309549 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ebd82806-7a5d-47f4-a0b9-168055ce5585 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:09.310806 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ebd82806-7a5d-47f4-a0b9-168055ce5585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:09.404588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 664/1333] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:34:09.439799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e84a2-9967-4c81-8361-8ba14b44d66e None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:09.441319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c36e84a2-9967-4c81-8361-8ba14b44d66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:09.545534 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e84a2-9967-4c81-8361-8ba14b44d66e None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:09.620222 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31e01c-b60b-44c1-ad16-59ddab951d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:09.620869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31e01c-b60b-44c1-ad16-59ddab951d5a service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:09.621152 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31e01c-b60b-44c1-ad16-59ddab951d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:09.621425 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31e01c-b60b-44c1-ad16-59ddab951d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:09.623090 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4d31e01c-b60b-44c1-ad16-59ddab951d5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:09.729488 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31e01c-b60b-44c1-ad16-59ddab951d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:09.730878 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31e01c-b60b-44c1-ad16-59ddab951d5a service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:09.748610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 670/1334] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:12.023011 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cc550-c16e-4830-8455-38036ff03244 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:12.023582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cc550-c16e-4830-8455-38036ff03244 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:12.023582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cc550-c16e-4830-8455-38036ff03244 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:12.024921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 665/1335] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:12.029923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f751ba-c847-4835-833b-66d8a40aa404 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:12.030377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f751ba-c847-4835-833b-66d8a40aa404 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:12.030521 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f751ba-c847-4835-833b-66d8a40aa404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:12.096724 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-c3f751ba-c847-4835-833b-66d8a40aa404 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:12.097921 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c3f751ba-c847-4835-833b-66d8a40aa404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:12.189777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 671/1336] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:12.230812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cc550-c16e-4830-8455-38036ff03244 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:12.232306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-118cc550-c16e-4830-8455-38036ff03244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:12.329084 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cc550-c16e-4830-8455-38036ff03244 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:12.399893 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a33751-7f2e-4322-850b-89a910c8697e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:12.400530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a33751-7f2e-4322-850b-89a910c8697e service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:12.400810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a33751-7f2e-4322-850b-89a910c8697e service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:12.401085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a33751-7f2e-4322-850b-89a910c8697e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:12.402797 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-93a33751-7f2e-4322-850b-89a910c8697e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:12.507535 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a33751-7f2e-4322-850b-89a910c8697e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:12.508965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a33751-7f2e-4322-850b-89a910c8697e service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:12.527125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 666/1337] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:15.232622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e842a16-4056-469b-ba01-55c98e5b63bb None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:15.233194 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e842a16-4056-469b-ba01-55c98e5b63bb None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:15.233194 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e842a16-4056-469b-ba01-55c98e5b63bb None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:15.234553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 672/1338] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:15.239768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c9161-0830-4de2-aa37-fc5a7a9e09d0 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:15.240197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c9161-0830-4de2-aa37-fc5a7a9e09d0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:15.240412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c9161-0830-4de2-aa37-fc5a7a9e09d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:15.303057 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ef9c9161-0830-4de2-aa37-fc5a7a9e09d0 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:15.304245 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ef9c9161-0830-4de2-aa37-fc5a7a9e09d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:15.395894 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 667/1339] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:15.432143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e842a16-4056-469b-ba01-55c98e5b63bb None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:15.433686 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9e842a16-4056-469b-ba01-55c98e5b63bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:15.533944 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e842a16-4056-469b-ba01-55c98e5b63bb None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:15.604456 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee8d2a-a2ca-4bea-8a1e-24a3520e830f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:15.605098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee8d2a-a2ca-4bea-8a1e-24a3520e830f service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:15.605377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee8d2a-a2ca-4bea-8a1e-24a3520e830f service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:15.605648 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee8d2a-a2ca-4bea-8a1e-24a3520e830f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:15.607313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-21ee8d2a-a2ca-4bea-8a1e-24a3520e830f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:15.712942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee8d2a-a2ca-4bea-8a1e-24a3520e830f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:15.714391 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee8d2a-a2ca-4bea-8a1e-24a3520e830f service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:15.734292 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 673/1340] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:20.042754 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093b45e-d0f0-4864-b95a-af667d9ec7fb None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:20.043281 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093b45e-d0f0-4864-b95a-af667d9ec7fb None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:20.043281 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093b45e-d0f0-4864-b95a-af667d9ec7fb None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:20.044595 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 668/1341] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:20.049648 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1c41f-63e4-42b3-bf0b-85bb3fa14234 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:20.050074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1c41f-63e4-42b3-bf0b-85bb3fa14234 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:20.050258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1c41f-63e4-42b3-bf0b-85bb3fa14234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:20.119259 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-8ca1c41f-63e4-42b3-bf0b-85bb3fa14234 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:20.120455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8ca1c41f-63e4-42b3-bf0b-85bb3fa14234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:20.224487 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 674/1342] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:20.263873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093b45e-d0f0-4864-b95a-af667d9ec7fb None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:20.266108 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5093b45e-d0f0-4864-b95a-af667d9ec7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:20.364457 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093b45e-d0f0-4864-b95a-af667d9ec7fb None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:20.368142 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2bdda-e5f6-4038-9106-e7b3fdf7feaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:20.368813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2bdda-e5f6-4038-9106-e7b3fdf7feaf service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:20.369094 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2bdda-e5f6-4038-9106-e7b3fdf7feaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:20.369367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2bdda-e5f6-4038-9106-e7b3fdf7feaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:20.378384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2bdda-e5f6-4038-9106-e7b3fdf7feaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:20.379804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2bdda-e5f6-4038-9106-e7b3fdf7feaf service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:20.389535 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 669/1343] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:23.243031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9880916-1bf7-4ad7-84cd-72234305f5b7 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:23.243585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9880916-1bf7-4ad7-84cd-72234305f5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:23.243585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9880916-1bf7-4ad7-84cd-72234305f5b7 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:23.245096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 675/1344] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:23.250886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54833c43-0e0a-468d-8d5a-c85439599be7 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:23.251347 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54833c43-0e0a-468d-8d5a-c85439599be7 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:23.251522 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54833c43-0e0a-468d-8d5a-c85439599be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:23.280098 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-54833c43-0e0a-468d-8d5a-c85439599be7 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:23.281276 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-54833c43-0e0a-468d-8d5a-c85439599be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:23.356789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 670/1345] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:34:23.393321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9880916-1bf7-4ad7-84cd-72234305f5b7 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:23.405386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9880916-1bf7-4ad7-84cd-72234305f5b7 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:23.409048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea055919-99f4-48bc-99b4-e38c5a47fc34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:23.409687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea055919-99f4-48bc-99b4-e38c5a47fc34 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:23.409976 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea055919-99f4-48bc-99b4-e38c5a47fc34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:23.410287 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea055919-99f4-48bc-99b4-e38c5a47fc34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:23.420230 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea055919-99f4-48bc-99b4-e38c5a47fc34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:23.421650 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea055919-99f4-48bc-99b4-e38c5a47fc34 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:23.431240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 676/1346] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:27.765901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e06d4b-1c41-403a-82e1-058beecf8acc None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:27.766463 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e06d4b-1c41-403a-82e1-058beecf8acc None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:27.766463 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e06d4b-1c41-403a-82e1-058beecf8acc None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:27.767769 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 671/1347] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:27.773096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0290e7-b2b8-4fa9-8ba7-2eea7fd143be None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:27.773503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0290e7-b2b8-4fa9-8ba7-2eea7fd143be None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:27.773719 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0290e7-b2b8-4fa9-8ba7-2eea7fd143be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:27.791421 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-0b0290e7-b2b8-4fa9-8ba7-2eea7fd143be None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:27.792595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-0b0290e7-b2b8-4fa9-8ba7-2eea7fd143be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:27.800516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 677/1348] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:27.838311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e06d4b-1c41-403a-82e1-058beecf8acc None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:27.848741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e06d4b-1c41-403a-82e1-058beecf8acc None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:27.853038 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154bb07-f508-43d8-95fd-55597836affa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:27.853736 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154bb07-f508-43d8-95fd-55597836affa service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:27.854088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154bb07-f508-43d8-95fd-55597836affa service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:27.854452 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154bb07-f508-43d8-95fd-55597836affa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:27.863127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154bb07-f508-43d8-95fd-55597836affa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:27.864539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154bb07-f508-43d8-95fd-55597836affa service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:27.873991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 672/1349] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:33.267204 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e091c-ee72-4eef-a856-f39e1d183849 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:33.267761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e091c-ee72-4eef-a856-f39e1d183849 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:33.267761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e091c-ee72-4eef-a856-f39e1d183849 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:33.269538 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 678/1350] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 5 15:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:33.275016 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa52b3-e418-4ec3-a83a-2372b131069d None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:33.275765 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa52b3-e418-4ec3-a83a-2372b131069d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:33.276191 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa52b3-e418-4ec3-a83a-2372b131069d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:33.350509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-64fa52b3-e418-4ec3-a83a-2372b131069d None None] MFA Rules not processed for user `a12f5d874be84f1ca79eb439267c7b70`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:33.352899 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-64fa52b3-e418-4ec3-a83a-2372b131069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:33.442686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 673/1351] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 5 15:34:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:37.667663 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704f653-317e-4c14-aaed-e4d8ebb49425 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:37.668234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704f653-317e-4c14-aaed-e4d8ebb49425 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:37.668234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704f653-317e-4c14-aaed-e4d8ebb49425 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:37.669544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 679/1352] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 5 15:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:37.674785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137e25a-1eee-4cbf-8262-5476a929b9b1 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:37.675242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137e25a-1eee-4cbf-8262-5476a929b9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:37.675333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137e25a-1eee-4cbf-8262-5476a929b9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:37.694823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e137e25a-1eee-4cbf-8262-5476a929b9b1 None None] MFA Rules not processed for user `a12f5d874be84f1ca79eb439267c7b70`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:37.696563 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e137e25a-1eee-4cbf-8262-5476a929b9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:37.705260 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 674/1353] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 5 15:34:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:39.190325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f44d9-ec79-43d7-b641-906309ffd82b None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:39.190860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f44d9-ec79-43d7-b641-906309ffd82b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:39.190860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f44d9-ec79-43d7-b641-906309ffd82b None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:39.192225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 680/1354] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 5 15:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:39.197356 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e9f7e-02bc-4bb8-b527-5700d2ebf95f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:39.197819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e9f7e-02bc-4bb8-b527-5700d2ebf95f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:39.198037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e9f7e-02bc-4bb8-b527-5700d2ebf95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:39.217130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d19e9f7e-02bc-4bb8-b527-5700d2ebf95f None None] MFA Rules not processed for user `a12f5d874be84f1ca79eb439267c7b70`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:39.218344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d19e9f7e-02bc-4bb8-b527-5700d2ebf95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:39.227502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 675/1355] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 5 15:34:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:43.149149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b4bd6-ef43-4b1b-b447-19810c1cb96e None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:43.149886 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b4bd6-ef43-4b1b-b447-19810c1cb96e None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:43.149886 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b4bd6-ef43-4b1b-b447-19810c1cb96e None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:43.151230 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 681/1356] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:43.156170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240077-4cde-48b0-a9e5-9317a4477521 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:43.156593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240077-4cde-48b0-a9e5-9317a4477521 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:43.156702 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240077-4cde-48b0-a9e5-9317a4477521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:43.174453 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-c1240077-4cde-48b0-a9e5-9317a4477521 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:43.175605 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c1240077-4cde-48b0-a9e5-9317a4477521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:43.183570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 676/1357] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:43.232098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c26635-fd60-48c6-9fb4-bdf6fa6458a4 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:43.232382 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c26635-fd60-48c6-9fb4-bdf6fa6458a4 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:43.232655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c26635-fd60-48c6-9fb4-bdf6fa6458a4 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:43.233986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 682/1358] 10.222.0.58 () {54 vars in 960 bytes} [Thu May 5 15:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:43.239171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144902b-ac18-4da0-b871-991a705c3275 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:43.239462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144902b-ac18-4da0-b871-991a705c3275 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:43.239743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144902b-ac18-4da0-b871-991a705c3275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:43.291224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4144902b-ac18-4da0-b871-991a705c3275 None None] MFA Rules not processed for user `2a29a4b1b1aa45aea2e466d8f8b79365`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:43.292433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4144902b-ac18-4da0-b871-991a705c3275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:43.389913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c26635-fd60-48c6-9fb4-bdf6fa6458a4 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:43.390552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 677/1359] 10.222.0.58 () {58 vars in 1057 bytes} [Thu May 5 15:34:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:43.407737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c26635-fd60-48c6-9fb4-bdf6fa6458a4 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:43.413548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af8da1-372a-4629-9797-611fb9ec09f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:43.414514 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af8da1-372a-4629-9797-611fb9ec09f4 service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:43.415111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af8da1-372a-4629-9797-611fb9ec09f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:43.415510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af8da1-372a-4629-9797-611fb9ec09f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:43.424280 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af8da1-372a-4629-9797-611fb9ec09f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:43.425958 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af8da1-372a-4629-9797-611fb9ec09f4 service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:43.436662 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 683/1360] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:45.928232 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52b113-b879-47ad-975d-47f3f43ab762 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:45.928730 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52b113-b879-47ad-975d-47f3f43ab762 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:45.928730 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52b113-b879-47ad-975d-47f3f43ab762 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:45.930784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 678/1361] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:45.935749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc9ba9-fea9-4c4e-8c34-977b865df06a None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:45.936146 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc9ba9-fea9-4c4e-8c34-977b865df06a None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:45.936293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc9ba9-fea9-4c4e-8c34-977b865df06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:45.955862 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-8ecc9ba9-fea9-4c4e-8c34-977b865df06a None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:45.957038 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8ecc9ba9-fea9-4c4e-8c34-977b865df06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:45.965785 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 684/1362] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:46.010411 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52b113-b879-47ad-975d-47f3f43ab762 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:46.025915 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52b113-b879-47ad-975d-47f3f43ab762 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:46.031279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba108587-5106-472b-8c32-7693e964556b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:46.031909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba108587-5106-472b-8c32-7693e964556b service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:46.032185 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba108587-5106-472b-8c32-7693e964556b service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:46.032455 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba108587-5106-472b-8c32-7693e964556b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:46.041294 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba108587-5106-472b-8c32-7693e964556b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:46.043389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba108587-5106-472b-8c32-7693e964556b service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:46.054453 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 679/1363] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:48.604509 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc866e0-5322-4f41-b395-babcfb85fecb None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:48.605012 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc866e0-5322-4f41-b395-babcfb85fecb None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:48.605123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc866e0-5322-4f41-b395-babcfb85fecb None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:48.606447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 685/1364] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:48.612017 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be2ad6-03ec-44b6-909f-3dffd8c3d397 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:48.612457 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be2ad6-03ec-44b6-909f-3dffd8c3d397 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:48.612548 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be2ad6-03ec-44b6-909f-3dffd8c3d397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:48.636766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-44be2ad6-03ec-44b6-909f-3dffd8c3d397 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:48.638665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-44be2ad6-03ec-44b6-909f-3dffd8c3d397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:48.651702 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 680/1365] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:34:48.696461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942a3f9-a6b4-49ed-bb69-d7ab3188ca7d None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:48.696787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942a3f9-a6b4-49ed-bb69-d7ab3188ca7d None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:48.697070 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942a3f9-a6b4-49ed-bb69-d7ab3188ca7d None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:48.698485 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 686/1366] 10.222.0.58 () {54 vars in 960 bytes} [Thu May 5 15:34:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:48.703667 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a0043-32eb-48fa-9ff0-e16b7a136724 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:48.703956 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a0043-32eb-48fa-9ff0-e16b7a136724 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:48.704228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a0043-32eb-48fa-9ff0-e16b7a136724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:48.722462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-c09a0043-32eb-48fa-9ff0-e16b7a136724 None None] MFA Rules not processed for user `2a29a4b1b1aa45aea2e466d8f8b79365`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:48.723663 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c09a0043-32eb-48fa-9ff0-e16b7a136724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:48.733089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 681/1367] 10.222.0.58 () {58 vars in 1057 bytes} [Thu May 5 15:34:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:48.740655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942a3f9-a6b4-49ed-bb69-d7ab3188ca7d None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:48.754532 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942a3f9-a6b4-49ed-bb69-d7ab3188ca7d None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:48.762095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75e0af-5d40-4326-9fb9-5b4069e734df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:48.763300 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75e0af-5d40-4326-9fb9-5b4069e734df service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:48.763777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75e0af-5d40-4326-9fb9-5b4069e734df service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:48.764237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75e0af-5d40-4326-9fb9-5b4069e734df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:48.777041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75e0af-5d40-4326-9fb9-5b4069e734df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:48.778648 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75e0af-5d40-4326-9fb9-5b4069e734df service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:48.787810 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 687/1368] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:51.131878 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc56a43-b3f5-4f99-b26b-f56559a90763 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:51.131878 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc56a43-b3f5-4f99-b26b-f56559a90763 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:51.131878 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc56a43-b3f5-4f99-b26b-f56559a90763 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:51.134858 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 682/1369] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:51.136454 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4485-e0df-4a73-8064-36c737ba10fb None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:51.136894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4485-e0df-4a73-8064-36c737ba10fb None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:51.137358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4485-e0df-4a73-8064-36c737ba10fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:51.160180 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-dc4e4485-e0df-4a73-8064-36c737ba10fb None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:51.161379 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-dc4e4485-e0df-4a73-8064-36c737ba10fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:51.171127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 688/1370] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:51.217415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc56a43-b3f5-4f99-b26b-f56559a90763 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:51.233532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc56a43-b3f5-4f99-b26b-f56559a90763 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:51.239589 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520b765-efe6-48bd-9d50-19f4a064b0ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:51.240252 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520b765-efe6-48bd-9d50-19f4a064b0ca service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:51.240532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520b765-efe6-48bd-9d50-19f4a064b0ca service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:51.240805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520b765-efe6-48bd-9d50-19f4a064b0ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:51.250552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520b765-efe6-48bd-9d50-19f4a064b0ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:51.252129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520b765-efe6-48bd-9d50-19f4a064b0ca service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:51.261941 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 683/1371] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:51.404445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47840472-8d01-4ce8-a8ae-baecc8b71745 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:51.405694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47840472-8d01-4ce8-a8ae-baecc8b71745 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:51.406068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47840472-8d01-4ce8-a8ae-baecc8b71745 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:51.407990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 689/1372] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:51.415086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956787dd-f01e-4b02-8ec2-2a8ac0f610ad None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:51.415706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956787dd-f01e-4b02-8ec2-2a8ac0f610ad None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:51.415991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956787dd-f01e-4b02-8ec2-2a8ac0f610ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:51.435224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-956787dd-f01e-4b02-8ec2-2a8ac0f610ad None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:51.436510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-956787dd-f01e-4b02-8ec2-2a8ac0f610ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:51.445096 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 684/1373] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:51.742278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacc42e-67fa-43db-8be4-0ad40175a3c5 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:51.742703 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacc42e-67fa-43db-8be4-0ad40175a3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:51.742974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacc42e-67fa-43db-8be4-0ad40175a3c5 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:51.744595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 690/1374] 10.222.0.58 () {54 vars in 963 bytes} [Thu May 5 15:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:51.749764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbd823-c95c-4c12-8f07-806f920b13d8 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:51.750197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbd823-c95c-4c12-8f07-806f920b13d8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:51.750651 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbd823-c95c-4c12-8f07-806f920b13d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:51.803179 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b9cbd823-c95c-4c12-8f07-806f920b13d8 None None] MFA Rules not processed for user `bb9a301df6534b499d60486060df7068`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:51.804357 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b9cbd823-c95c-4c12-8f07-806f920b13d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:51.867212 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 685/1375] 10.222.0.58 () {58 vars in 1060 bytes} [Thu May 5 15:34:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:51.875430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacc42e-67fa-43db-8be4-0ad40175a3c5 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:51.886917 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacc42e-67fa-43db-8be4-0ad40175a3c5 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:51.890524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd6b26-95e9-4205-a4dd-ff4cc5e0dd4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:51.891155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd6b26-95e9-4205-a4dd-ff4cc5e0dd4b service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:51.891437 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd6b26-95e9-4205-a4dd-ff4cc5e0dd4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:51.891711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd6b26-95e9-4205-a4dd-ff4cc5e0dd4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:51.900831 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd6b26-95e9-4205-a4dd-ff4cc5e0dd4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:51.902271 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd6b26-95e9-4205-a4dd-ff4cc5e0dd4b service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:51.911797 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 691/1376] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:53.540055 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c3ed7-e23c-487d-86b1-cb0d848c8d6b None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:53.540645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c3ed7-e23c-487d-86b1-cb0d848c8d6b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:53.540645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c3ed7-e23c-487d-86b1-cb0d848c8d6b None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:53.542037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 686/1377] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:53.547944 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38810ea0-c899-4281-89cc-34406f82a32c None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:53.548458 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38810ea0-c899-4281-89cc-34406f82a32c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:53.548591 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38810ea0-c899-4281-89cc-34406f82a32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:53.567657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-38810ea0-c899-4281-89cc-34406f82a32c None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:53.568891 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-38810ea0-c899-4281-89cc-34406f82a32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:53.577913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 692/1378] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:53.623969 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c3ed7-e23c-487d-86b1-cb0d848c8d6b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:53.639425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c3ed7-e23c-487d-86b1-cb0d848c8d6b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:53.644995 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5138c4-fea0-4c90-a641-ee0c6819d13d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:53.645665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5138c4-fea0-4c90-a641-ee0c6819d13d service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:53.645943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5138c4-fea0-4c90-a641-ee0c6819d13d service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:53.646253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5138c4-fea0-4c90-a641-ee0c6819d13d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:53.655423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5138c4-fea0-4c90-a641-ee0c6819d13d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:53.657033 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5138c4-fea0-4c90-a641-ee0c6819d13d service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:53.667936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 687/1379] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:55.963813 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeb4cf-f68f-49c8-877a-297969e0e07a None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:55.964715 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeb4cf-f68f-49c8-877a-297969e0e07a None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:55.965158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeb4cf-f68f-49c8-877a-297969e0e07a None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:55.966705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 693/1380] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:55.972271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb341d-b020-48e5-9bc0-38a04ab465a0 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:55.972675 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb341d-b020-48e5-9bc0-38a04ab465a0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:55.972999 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb341d-b020-48e5-9bc0-38a04ab465a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:55.991114 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4ddb341d-b020-48e5-9bc0-38a04ab465a0 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:55.992270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4ddb341d-b020-48e5-9bc0-38a04ab465a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:56.000262 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 688/1381] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:34:56.044207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eeb4cf-f68f-49c8-877a-297969e0e07a None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:56.058200 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eeb4cf-f68f-49c8-877a-297969e0e07a None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:56.063533 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee441e76-095e-4871-8dc9-659b253083a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:56.064163 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee441e76-095e-4871-8dc9-659b253083a9 service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:56.064446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee441e76-095e-4871-8dc9-659b253083a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:56.064832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee441e76-095e-4871-8dc9-659b253083a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:56.073983 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee441e76-095e-4871-8dc9-659b253083a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:56.076024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee441e76-095e-4871-8dc9-659b253083a9 service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:56.085354 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 694/1382] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:34:58.374284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6f82e-bc3c-48fc-a0f7-6112965d75bb None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:58.374845 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6f82e-bc3c-48fc-a0f7-6112965d75bb None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:58.375115 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6f82e-bc3c-48fc-a0f7-6112965d75bb None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:58.376719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 689/1383] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:34:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:34:58.381795 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d307c-c78f-46fa-9bd7-35387b910e10 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:58.382232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d307c-c78f-46fa-9bd7-35387b910e10 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:58.382385 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d307c-c78f-46fa-9bd7-35387b910e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:58.400613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-7d5d307c-c78f-46fa-9bd7-35387b910e10 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:34:58.402265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7d5d307c-c78f-46fa-9bd7-35387b910e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:34:58.410893 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 695/1384] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:34:58.455722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6f82e-bc3c-48fc-a0f7-6112965d75bb None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:34:58.472146 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6f82e-bc3c-48fc-a0f7-6112965d75bb None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:34:58.478248 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba328424-e10c-49f0-b1e0-b41bb488e7d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:34:58.479276 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba328424-e10c-49f0-b1e0-b41bb488e7d7 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:34:58.479697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba328424-e10c-49f0-b1e0-b41bb488e7d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:34:58.480077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba328424-e10c-49f0-b1e0-b41bb488e7d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:34:58.489725 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba328424-e10c-49f0-b1e0-b41bb488e7d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:34:58.491537 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba328424-e10c-49f0-b1e0-b41bb488e7d7 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:34:58.502396 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 690/1385] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:00.777794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a60bee-cdf9-42e7-a13d-ff9a927928dd None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:00.778375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a60bee-cdf9-42e7-a13d-ff9a927928dd None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:00.778375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a60bee-cdf9-42e7-a13d-ff9a927928dd None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:00.779634 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 696/1386] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:00.784738 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817d1f3-3a20-4d55-a94e-e34ec9a7f068 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:00.785209 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817d1f3-3a20-4d55-a94e-e34ec9a7f068 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:00.785320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817d1f3-3a20-4d55-a94e-e34ec9a7f068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:00.802768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8817d1f3-3a20-4d55-a94e-e34ec9a7f068 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:00.803946 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8817d1f3-3a20-4d55-a94e-e34ec9a7f068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:00.812397 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 691/1387] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:00.857815 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a60bee-cdf9-42e7-a13d-ff9a927928dd None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:00.876860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a60bee-cdf9-42e7-a13d-ff9a927928dd None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:00.884720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08da6e-d8b8-4151-8eee-e662bfee5291 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:00.885709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08da6e-d8b8-4151-8eee-e662bfee5291 service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:00.886072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08da6e-d8b8-4151-8eee-e662bfee5291 service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:00.886475 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08da6e-d8b8-4151-8eee-e662bfee5291 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:00.897316 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08da6e-d8b8-4151-8eee-e662bfee5291 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:00.899417 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08da6e-d8b8-4151-8eee-e662bfee5291 service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:00.911734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 697/1388] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:03.193842 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271adff-988a-4c83-9fab-8b3a9913d986 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:03.194430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271adff-988a-4c83-9fab-8b3a9913d986 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:03.194589 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271adff-988a-4c83-9fab-8b3a9913d986 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:03.196508 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 692/1389] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:35:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:03.202455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79c404-831b-47e0-8b36-f252b72402c6 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:03.203239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79c404-831b-47e0-8b36-f252b72402c6 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:03.203559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79c404-831b-47e0-8b36-f252b72402c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:03.222798 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-1e79c404-831b-47e0-8b36-f252b72402c6 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:03.223988 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-1e79c404-831b-47e0-8b36-f252b72402c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:03.233086 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 698/1390] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:03.279977 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271adff-988a-4c83-9fab-8b3a9913d986 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:03.297116 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271adff-988a-4c83-9fab-8b3a9913d986 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:03.303562 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393eb15-562f-4082-8a7a-863ea90028f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:03.304281 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393eb15-562f-4082-8a7a-863ea90028f2 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:03.304626 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393eb15-562f-4082-8a7a-863ea90028f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:03.304968 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393eb15-562f-4082-8a7a-863ea90028f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:03.315006 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393eb15-562f-4082-8a7a-863ea90028f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:03.317537 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393eb15-562f-4082-8a7a-863ea90028f2 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:03.328910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 693/1391] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:05.921197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476edccf-6e9a-4e14-acf0-042efe5baf71 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:05.921804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476edccf-6e9a-4e14-acf0-042efe5baf71 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:05.921804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476edccf-6e9a-4e14-acf0-042efe5baf71 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:05.923368 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 699/1392] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:05.929166 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33682ec8-d121-442f-8045-0a9b6ae2a66b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:05.929643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33682ec8-d121-442f-8045-0a9b6ae2a66b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:05.929833 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33682ec8-d121-442f-8045-0a9b6ae2a66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:05.950580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-33682ec8-d121-442f-8045-0a9b6ae2a66b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:05.951796 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-33682ec8-d121-442f-8045-0a9b6ae2a66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:05.960709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 694/1393] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:06.012164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476edccf-6e9a-4e14-acf0-042efe5baf71 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:06.027771 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476edccf-6e9a-4e14-acf0-042efe5baf71 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:06.033969 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3fd31-ad13-4fac-bc85-0038002a1167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:06.034650 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3fd31-ad13-4fac-bc85-0038002a1167 service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:06.034933 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3fd31-ad13-4fac-bc85-0038002a1167 service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:06.035209 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3fd31-ad13-4fac-bc85-0038002a1167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:06.044820 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3fd31-ad13-4fac-bc85-0038002a1167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:06.046453 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3fd31-ad13-4fac-bc85-0038002a1167 service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:06.056857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 700/1394] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:07.987734 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae6243-75fd-45e5-9b01-2cd4a75f27c7 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:07.988305 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae6243-75fd-45e5-9b01-2cd4a75f27c7 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:07.988305 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae6243-75fd-45e5-9b01-2cd4a75f27c7 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:07.989647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 695/1395] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:07.995431 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158d600-4073-4c00-99dc-1cb9ec91f1f8 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:07.995858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158d600-4073-4c00-99dc-1cb9ec91f1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:07.995989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158d600-4073-4c00-99dc-1cb9ec91f1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:08.013721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-9158d600-4073-4c00-99dc-1cb9ec91f1f8 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:08.014937 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9158d600-4073-4c00-99dc-1cb9ec91f1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:08.022942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 701/1396] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:08.078282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b34e91-b149-4204-8f97-fd8a53c84763 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:08.078575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b34e91-b149-4204-8f97-fd8a53c84763 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:08.078855 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b34e91-b149-4204-8f97-fd8a53c84763 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:08.080211 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 696/1397] 10.222.0.58 () {54 vars in 962 bytes} [Thu May 5 15:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:08.085194 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc931f-e27f-45f3-8651-024ea3578efa None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:08.085546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc931f-e27f-45f3-8651-024ea3578efa None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:08.085904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc931f-e27f-45f3-8651-024ea3578efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:08.134719 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-64dc931f-e27f-45f3-8651-024ea3578efa None None] MFA Rules not processed for user `ab6c13dc02ba49d0be523fa9a73fdf5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:08.135950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-64dc931f-e27f-45f3-8651-024ea3578efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:08.197711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 702/1398] 10.222.0.58 () {58 vars in 1059 bytes} [Thu May 5 15:35:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:08.206025 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b34e91-b149-4204-8f97-fd8a53c84763 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:08.217409 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b34e91-b149-4204-8f97-fd8a53c84763 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:08.221349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62677961-1891-45d2-98cc-14f01e3da114 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab6c13dc02ba49d0be523fa9a73fdf5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:08.222013 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62677961-1891-45d2-98cc-14f01e3da114 service glance] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:08.222332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62677961-1891-45d2-98cc-14f01e3da114 service glance] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:08.222611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62677961-1891-45d2-98cc-14f01e3da114 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:08.233345 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62677961-1891-45d2-98cc-14f01e3da114 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:08.234827 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62677961-1891-45d2-98cc-14f01e3da114 service glance] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:08.245667 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 697/1399] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:08.382542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3240435-327f-40d0-a35c-f2da73ee361c None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:08.382914 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3240435-327f-40d0-a35c-f2da73ee361c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:08.383132 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3240435-327f-40d0-a35c-f2da73ee361c None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:08.384918 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 703/1400] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:35:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:08.390620 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82e7b6-1b9a-428c-8226-663107eab5c5 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:08.390909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82e7b6-1b9a-428c-8226-663107eab5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:08.391205 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82e7b6-1b9a-428c-8226-663107eab5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:08.408886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4d82e7b6-1b9a-428c-8226-663107eab5c5 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:08.410111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4d82e7b6-1b9a-428c-8226-663107eab5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:08.418785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 698/1401] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:08.463233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3240435-327f-40d0-a35c-f2da73ee361c None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:08.478079 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3240435-327f-40d0-a35c-f2da73ee361c None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:08.483443 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a91077-f96e-4b93-b975-a4dee6f77bd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:08.484081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a91077-f96e-4b93-b975-a4dee6f77bd0 service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:08.484357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a91077-f96e-4b93-b975-a4dee6f77bd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:08.484627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a91077-f96e-4b93-b975-a4dee6f77bd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:08.492467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a91077-f96e-4b93-b975-a4dee6f77bd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:08.494050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a91077-f96e-4b93-b975-a4dee6f77bd0 service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:08.503368 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 704/1402] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:08.672258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2feb9-09ba-4b38-a499-91d8ccab51a4 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:08.672546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2feb9-09ba-4b38-a499-91d8ccab51a4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:08.672823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2feb9-09ba-4b38-a499-91d8ccab51a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:08.725740 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-3aa2feb9-09ba-4b38-a499-91d8ccab51a4 None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:08.727002 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3aa2feb9-09ba-4b38-a499-91d8ccab51a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:08.789481 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 699/1403] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 5 15:35:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:08.832499 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85135-81d5-4f00-bdb6-c49e8417038b None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:08.832785 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85135-81d5-4f00-bdb6-c49e8417038b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:08.833060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85135-81d5-4f00-bdb6-c49e8417038b None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:08.834507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 705/1404] 10.222.0.58 () {54 vars in 942 bytes} [Thu May 5 15:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:08.841243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932ab19-c35d-4d45-ab94-dcda44444451 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:08.841599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932ab19-c35d-4d45-ab94-dcda44444451 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:08.841937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932ab19-c35d-4d45-ab94-dcda44444451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:08.888892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8932ab19-c35d-4d45-ab94-dcda44444451 None None] MFA Rules not processed for user `a90b5737f2c345b08460d291ccf49466`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:08.890074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8932ab19-c35d-4d45-ab94-dcda44444451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:08.957842 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 700/1405] 10.222.0.58 () {58 vars in 1039 bytes} [Thu May 5 15:35:08 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:08.967684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85135-81d5-4f00-bdb6-c49e8417038b None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:08.981209 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85135-81d5-4f00-bdb6-c49e8417038b None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:08.986158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038b41a-eb02-4f82-8acf-b0379ff10e69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:08.986809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038b41a-eb02-4f82-8acf-b0379ff10e69 service swift] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:08.987087 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038b41a-eb02-4f82-8acf-b0379ff10e69 service swift] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:08.987358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038b41a-eb02-4f82-8acf-b0379ff10e69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:08.996178 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038b41a-eb02-4f82-8acf-b0379ff10e69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:08.997774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038b41a-eb02-4f82-8acf-b0379ff10e69 service swift] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:09.009177 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 706/1406] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:35:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:35:10.807700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f547a8-84e7-4aa3-bd1f-c2b6427378a7 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:10.808594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f547a8-84e7-4aa3-bd1f-c2b6427378a7 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:10.808867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f547a8-84e7-4aa3-bd1f-c2b6427378a7 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:10.810426 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 701/1407] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:35:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:10.815871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f07a5-2e78-4697-a24a-d4a7fd6713ef None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:10.816299 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f07a5-2e78-4697-a24a-d4a7fd6713ef None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:10.816420 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f07a5-2e78-4697-a24a-d4a7fd6713ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:10.835142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-667f07a5-2e78-4697-a24a-d4a7fd6713ef None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:10.836626 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-667f07a5-2e78-4697-a24a-d4a7fd6713ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:10.854921 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 707/1408] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:10.890872 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f547a8-84e7-4aa3-bd1f-c2b6427378a7 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:10.909347 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f547a8-84e7-4aa3-bd1f-c2b6427378a7 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:10.916061 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f9f73-1453-4cfa-b60f-b78d9aeb039e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:10.916818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f9f73-1453-4cfa-b60f-b78d9aeb039e service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:10.917201 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f9f73-1453-4cfa-b60f-b78d9aeb039e service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:10.917591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f9f73-1453-4cfa-b60f-b78d9aeb039e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:10.926837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f9f73-1453-4cfa-b60f-b78d9aeb039e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:10.928530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f9f73-1453-4cfa-b60f-b78d9aeb039e service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:10.949950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 702/1409] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:32.478295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27878dbc-6184-44bf-860a-4685d289ecbb None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:32.478920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27878dbc-6184-44bf-860a-4685d289ecbb None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:32.478920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27878dbc-6184-44bf-860a-4685d289ecbb None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:32.480254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 708/1410] 10.222.0.58 () {54 vars in 918 bytes} [Thu May 5 15:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:32.485558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d286f9-ce6e-4f7c-8b35-d5b8fe4f7e86 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:32.485983 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d286f9-ce6e-4f7c-8b35-d5b8fe4f7e86 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:32.486240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d286f9-ce6e-4f7c-8b35-d5b8fe4f7e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:32.504333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-46d286f9-ce6e-4f7c-8b35-d5b8fe4f7e86 None None] MFA Rules not processed for user `a12f5d874be84f1ca79eb439267c7b70`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:32.505546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-46d286f9-ce6e-4f7c-8b35-d5b8fe4f7e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:32.514760 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 703/1411] 10.222.0.58 () {58 vars in 1015 bytes} [Thu May 5 15:35:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:32.529186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaebbb-bc61-405b-a4f0-dce0538063c2 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:32.529489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaebbb-bc61-405b-a4f0-dce0538063c2 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:32.529849 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaebbb-bc61-405b-a4f0-dce0538063c2 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:32.531227 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 709/1412] 10.222.0.58 () {54 vars in 918 bytes} [Thu May 5 15:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:32.535701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01119bf0-6ea0-4836-a3d5-b1a6511b3c23 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:32.535991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01119bf0-6ea0-4836-a3d5-b1a6511b3c23 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:32.536292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01119bf0-6ea0-4836-a3d5-b1a6511b3c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:32.553564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-01119bf0-6ea0-4836-a3d5-b1a6511b3c23 None None] MFA Rules not processed for user `2a29a4b1b1aa45aea2e466d8f8b79365`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:32.554779 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-01119bf0-6ea0-4836-a3d5-b1a6511b3c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:32.564410 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 704/1413] 10.222.0.58 () {58 vars in 1015 bytes} [Thu May 5 15:35:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:35.273427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61839138-11e9-4a9d-82eb-1d908e9178d6 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:35.274004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61839138-11e9-4a9d-82eb-1d908e9178d6 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:35.274004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61839138-11e9-4a9d-82eb-1d908e9178d6 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:35.276031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:35.281407 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d6664-d02f-48b4-a925-3431744c739e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:35.281809 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d6664-d02f-48b4-a925-3431744c739e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:35.281960 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d6664-d02f-48b4-a925-3431744c739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:35.299041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-6d2d6664-d02f-48b4-a925-3431744c739e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:35.300208 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6d2d6664-d02f-48b4-a925-3431744c739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:35.307894 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:35.349982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61839138-11e9-4a9d-82eb-1d908e9178d6 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:35.364007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61839138-11e9-4a9d-82eb-1d908e9178d6 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:35.369846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484055d-2554-4c52-8427-47720abdd8a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:35.370503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484055d-2554-4c52-8427-47720abdd8a2 service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:35.370779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484055d-2554-4c52-8427-47720abdd8a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:35.371044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484055d-2554-4c52-8427-47720abdd8a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:35.378771 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484055d-2554-4c52-8427-47720abdd8a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:35.380313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484055d-2554-4c52-8427-47720abdd8a2 service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:35.390052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 711/1416] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:36.692603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86428c-4b68-47ac-8d65-cc41135a82b0 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:36.693061 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86428c-4b68-47ac-8d65-cc41135a82b0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:36.693173 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86428c-4b68-47ac-8d65-cc41135a82b0 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:36.694586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:36.699527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6e441-40a0-42ed-be21-196e38bcfe9b None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:36.699937 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6e441-40a0-42ed-be21-196e38bcfe9b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:36.700076 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6e441-40a0-42ed-be21-196e38bcfe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:36.717713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-32e6e441-40a0-42ed-be21-196e38bcfe9b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:36.718911 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-32e6e441-40a0-42ed-be21-196e38bcfe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:36.726553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:36.899685 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86428c-4b68-47ac-8d65-cc41135a82b0 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:36.914406 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86428c-4b68-47ac-8d65-cc41135a82b0 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:36.920386 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26e19d-662b-43c2-84c5-dc35bfadafa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:36.921016 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26e19d-662b-43c2-84c5-dc35bfadafa9 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:36.921298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26e19d-662b-43c2-84c5-dc35bfadafa9 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:36.921573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26e19d-662b-43c2-84c5-dc35bfadafa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:36.929350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26e19d-662b-43c2-84c5-dc35bfadafa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:36.930958 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26e19d-662b-43c2-84c5-dc35bfadafa9 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:36.940076 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 707/1419] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:38.193340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2ffcb-db4a-497e-9f9e-9c6ce9d4d85d None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:38.193982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2ffcb-db4a-497e-9f9e-9c6ce9d4d85d None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:38.193982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2ffcb-db4a-497e-9f9e-9c6ce9d4d85d None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:38.195351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:38.200687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c0ebe-ef4b-426f-baa5-9ae098602a60 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:38.201130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c0ebe-ef4b-426f-baa5-9ae098602a60 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:38.201276 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c0ebe-ef4b-426f-baa5-9ae098602a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:38.220098 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-402c0ebe-ef4b-426f-baa5-9ae098602a60 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:38.221291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-402c0ebe-ef4b-426f-baa5-9ae098602a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:38.229145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:38.380938 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2ffcb-db4a-497e-9f9e-9c6ce9d4d85d None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:38.395477 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2ffcb-db4a-497e-9f9e-9c6ce9d4d85d None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:38.400746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac5747-7473-40d2-938e-a852ba4d90a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:38.401366 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac5747-7473-40d2-938e-a852ba4d90a2 service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:38.401643 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac5747-7473-40d2-938e-a852ba4d90a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:38.401913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac5747-7473-40d2-938e-a852ba4d90a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:38.410016 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac5747-7473-40d2-938e-a852ba4d90a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:38.411631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac5747-7473-40d2-938e-a852ba4d90a2 service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:38.421340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 714/1422] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:39.664031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5349ed-77d8-4ca6-bea3-fd5b85a49780 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:39.664611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5349ed-77d8-4ca6-bea3-fd5b85a49780 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:39.664611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5349ed-77d8-4ca6-bea3-fd5b85a49780 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:39.666466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:35:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:39.671552 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5b4c7-dac7-4c6a-b279-c9c12a2f881b None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:39.671986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5b4c7-dac7-4c6a-b279-c9c12a2f881b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:39.672104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5b4c7-dac7-4c6a-b279-c9c12a2f881b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:39.689908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-11e5b4c7-dac7-4c6a-b279-c9c12a2f881b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:39.691122 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-11e5b4c7-dac7-4c6a-b279-c9c12a2f881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:39.698738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:39.845681 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5349ed-77d8-4ca6-bea3-fd5b85a49780 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:39.860209 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5349ed-77d8-4ca6-bea3-fd5b85a49780 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:39.865530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ff32c-853d-47d9-a884-9dcf90671266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:39.866157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ff32c-853d-47d9-a884-9dcf90671266 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:39.866470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ff32c-853d-47d9-a884-9dcf90671266 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:39.866745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ff32c-853d-47d9-a884-9dcf90671266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:39.875389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ff32c-853d-47d9-a884-9dcf90671266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:39.876989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ff32c-853d-47d9-a884-9dcf90671266 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:39.886187 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 710/1425] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:41.125660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a914e0-ebe2-4a06-a0bc-8c1919cb21f6 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:41.126256 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a914e0-ebe2-4a06-a0bc-8c1919cb21f6 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:41.126256 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a914e0-ebe2-4a06-a0bc-8c1919cb21f6 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:41.127611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:41.132412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86c9f1-ecd2-4822-b88f-996e14118106 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:41.132827 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86c9f1-ecd2-4822-b88f-996e14118106 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:41.132962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86c9f1-ecd2-4822-b88f-996e14118106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:41.151620 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-1a86c9f1-ecd2-4822-b88f-996e14118106 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:41.152801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-1a86c9f1-ecd2-4822-b88f-996e14118106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:41.160719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:41.309460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a914e0-ebe2-4a06-a0bc-8c1919cb21f6 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:41.324268 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a914e0-ebe2-4a06-a0bc-8c1919cb21f6 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:41.329761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87f9df-8cd4-4c43-9076-8d2f1d79afeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:41.330425 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87f9df-8cd4-4c43-9076-8d2f1d79afeb service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:41.330709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87f9df-8cd4-4c43-9076-8d2f1d79afeb service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:41.330985 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87f9df-8cd4-4c43-9076-8d2f1d79afeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:41.339721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87f9df-8cd4-4c43-9076-8d2f1d79afeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:41.341548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87f9df-8cd4-4c43-9076-8d2f1d79afeb service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:41.350828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 717/1428] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:42.539182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68eec7-20b2-4ae6-a4cb-7f86ba0ef81f None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:42.539674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68eec7-20b2-4ae6-a4cb-7f86ba0ef81f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:42.539781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68eec7-20b2-4ae6-a4cb-7f86ba0ef81f None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:42.541262 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:42.546151 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74de88-6806-425b-8184-cac6fd417aa0 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:42.546593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74de88-6806-425b-8184-cac6fd417aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:42.546730 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74de88-6806-425b-8184-cac6fd417aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:42.563901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-ca74de88-6806-425b-8184-cac6fd417aa0 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:42.565063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-ca74de88-6806-425b-8184-cac6fd417aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:42.573259 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:42.722497 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68eec7-20b2-4ae6-a4cb-7f86ba0ef81f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:42.737695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68eec7-20b2-4ae6-a4cb-7f86ba0ef81f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:42.743030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03027b05-3033-4ee9-9600-9a093e485b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:42.743655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03027b05-3033-4ee9-9600-9a093e485b4e service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:42.743933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03027b05-3033-4ee9-9600-9a093e485b4e service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:42.744821 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03027b05-3033-4ee9-9600-9a093e485b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:42.752626 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03027b05-3033-4ee9-9600-9a093e485b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:42.754191 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03027b05-3033-4ee9-9600-9a093e485b4e service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:42.763175 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 713/1431] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:43.945095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32171bdd-9863-4f1c-8223-27ebe55fd46d None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:43.945672 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32171bdd-9863-4f1c-8223-27ebe55fd46d None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:43.945672 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32171bdd-9863-4f1c-8223-27ebe55fd46d None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:43.947043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:43.952632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f736622-8bd4-40ef-8ee2-af53820bef29 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:43.953077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f736622-8bd4-40ef-8ee2-af53820bef29 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:43.953175 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f736622-8bd4-40ef-8ee2-af53820bef29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:43.970982 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4f736622-8bd4-40ef-8ee2-af53820bef29 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:43.972158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4f736622-8bd4-40ef-8ee2-af53820bef29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:43.980338 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:44.131261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32171bdd-9863-4f1c-8223-27ebe55fd46d None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:44.145306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32171bdd-9863-4f1c-8223-27ebe55fd46d None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:44.150745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91a66a-2eec-4820-a8d7-8bcfb645468e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:44.151323 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91a66a-2eec-4820-a8d7-8bcfb645468e service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:44.151602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91a66a-2eec-4820-a8d7-8bcfb645468e service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:44.151875 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91a66a-2eec-4820-a8d7-8bcfb645468e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:44.159937 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91a66a-2eec-4820-a8d7-8bcfb645468e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:44.161541 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91a66a-2eec-4820-a8d7-8bcfb645468e service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:44.172045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 720/1434] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:45.393833 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb1a01-c243-402f-b21f-338c014cf5da None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:45.394422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb1a01-c243-402f-b21f-338c014cf5da None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:45.394693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb1a01-c243-402f-b21f-338c014cf5da None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:45.396879 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:35:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:45.402626 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff3d38-8c2e-4f65-8e5e-485040263f58 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:45.403098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff3d38-8c2e-4f65-8e5e-485040263f58 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:45.403193 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff3d38-8c2e-4f65-8e5e-485040263f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:45.422289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-e2ff3d38-8c2e-4f65-8e5e-485040263f58 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:45.423503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e2ff3d38-8c2e-4f65-8e5e-485040263f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:45.431288 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:45.583544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb1a01-c243-402f-b21f-338c014cf5da None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:45.599717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb1a01-c243-402f-b21f-338c014cf5da None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:45.605575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f005c6-bf90-4007-9e31-f06490bcdbe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:45.606234 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f005c6-bf90-4007-9e31-f06490bcdbe4 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:45.606521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f005c6-bf90-4007-9e31-f06490bcdbe4 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:45.606795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f005c6-bf90-4007-9e31-f06490bcdbe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:45.614702 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f005c6-bf90-4007-9e31-f06490bcdbe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:45.616274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f005c6-bf90-4007-9e31-f06490bcdbe4 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:45.625985 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 716/1437] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:46.835140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abae18-9dee-4aee-9c84-0c564c344229 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:46.835665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abae18-9dee-4aee-9c84-0c564c344229 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:46.835665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abae18-9dee-4aee-9c84-0c564c344229 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:46.837030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:46.842090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0335f-4d3e-48e9-b74e-3c555d76f751 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:46.842510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0335f-4d3e-48e9-b74e-3c555d76f751 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:46.842674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0335f-4d3e-48e9-b74e-3c555d76f751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:46.860697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ddf0335f-4d3e-48e9-b74e-3c555d76f751 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:46.861873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ddf0335f-4d3e-48e9-b74e-3c555d76f751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:46.870031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:47.017858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abae18-9dee-4aee-9c84-0c564c344229 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:47.032298 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abae18-9dee-4aee-9c84-0c564c344229 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:47.037567 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043b2b5-f66e-45bc-8fd6-59cfef62a73c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:47.038210 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043b2b5-f66e-45bc-8fd6-59cfef62a73c service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:47.038498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043b2b5-f66e-45bc-8fd6-59cfef62a73c service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:47.038805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043b2b5-f66e-45bc-8fd6-59cfef62a73c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:47.047303 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043b2b5-f66e-45bc-8fd6-59cfef62a73c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:47.048861 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043b2b5-f66e-45bc-8fd6-59cfef62a73c service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:47.058149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 723/1440] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:49.178046 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6362d-ab41-4fb2-b013-623d87d3ce6f None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:49.178656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6362d-ab41-4fb2-b013-623d87d3ce6f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:49.178656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6362d-ab41-4fb2-b013-623d87d3ce6f None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:49.179957 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:49.185155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c2a74-2b0d-42b8-8185-30db2c01df43 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:49.185587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c2a74-2b0d-42b8-8185-30db2c01df43 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:49.185694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c2a74-2b0d-42b8-8185-30db2c01df43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:49.203641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-e61c2a74-2b0d-42b8-8185-30db2c01df43 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:49.204817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e61c2a74-2b0d-42b8-8185-30db2c01df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:49.212508 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:49.252370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6362d-ab41-4fb2-b013-623d87d3ce6f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:49.263380 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6362d-ab41-4fb2-b013-623d87d3ce6f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:49.266853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23ca01-85b8-4311-9d5c-ce3447f7a172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:49.267477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23ca01-85b8-4311-9d5c-ce3447f7a172 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:49.267755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23ca01-85b8-4311-9d5c-ce3447f7a172 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:49.268031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23ca01-85b8-4311-9d5c-ce3447f7a172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:49.276643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23ca01-85b8-4311-9d5c-ce3447f7a172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:49.278039 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23ca01-85b8-4311-9d5c-ce3447f7a172 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:49.287006 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 719/1443] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:51.686022 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41959219-dc58-4d4b-af6e-eb0492ba254a None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:51.686619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41959219-dc58-4d4b-af6e-eb0492ba254a None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:51.686619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41959219-dc58-4d4b-af6e-eb0492ba254a None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:51.688022 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:51.693229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a823854-b15d-4a9d-9830-8f2eea078cdc None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:51.693644 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a823854-b15d-4a9d-9830-8f2eea078cdc None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:51.693784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a823854-b15d-4a9d-9830-8f2eea078cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:51.711662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-3a823854-b15d-4a9d-9830-8f2eea078cdc None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:51.712835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3a823854-b15d-4a9d-9830-8f2eea078cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:51.721291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:51.760736 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41959219-dc58-4d4b-af6e-eb0492ba254a None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:51.762471 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-41959219-dc58-4d4b-af6e-eb0492ba254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:51.775195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41959219-dc58-4d4b-af6e-eb0492ba254a None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:51.778763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c64ace-df8e-4164-b111-d8fec8bd1630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:51.779394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c64ace-df8e-4164-b111-d8fec8bd1630 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:51.779677 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c64ace-df8e-4164-b111-d8fec8bd1630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:51.779954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c64ace-df8e-4164-b111-d8fec8bd1630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:51.788720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c64ace-df8e-4164-b111-d8fec8bd1630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:51.790140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c64ace-df8e-4164-b111-d8fec8bd1630 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:51.799729 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 726/1446] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:54.362833 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a6ff-880c-4516-b33b-db50e58b6d20 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:54.363440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a6ff-880c-4516-b33b-db50e58b6d20 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:54.363440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a6ff-880c-4516-b33b-db50e58b6d20 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:54.364776 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:54.370527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1de84b-ae63-471f-9c6f-e92c12574159 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:54.370960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1de84b-ae63-471f-9c6f-e92c12574159 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:54.371068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1de84b-ae63-471f-9c6f-e92c12574159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:54.388151 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-dc1de84b-ae63-471f-9c6f-e92c12574159 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:54.389326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-dc1de84b-ae63-471f-9c6f-e92c12574159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:54.396987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:54.435323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a6ff-880c-4516-b33b-db50e58b6d20 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:54.445659 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a6ff-880c-4516-b33b-db50e58b6d20 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:54.449315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fe1fa-0d43-4509-9647-ed2d844a74b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:54.449959 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fe1fa-0d43-4509-9647-ed2d844a74b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:54.450255 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fe1fa-0d43-4509-9647-ed2d844a74b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:54.450535 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fe1fa-0d43-4509-9647-ed2d844a74b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:54.459127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fe1fa-0d43-4509-9647-ed2d844a74b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:54.460531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fe1fa-0d43-4509-9647-ed2d844a74b0 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:54.469846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 722/1449] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:56.830773 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459f1a-3a43-4bd1-921a-25d2e5570165 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:56.831320 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459f1a-3a43-4bd1-921a-25d2e5570165 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:56.831320 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459f1a-3a43-4bd1-921a-25d2e5570165 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:56.832689 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:56.837869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fa0a7-2c3e-4595-b208-555b94089907 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:56.838827 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fa0a7-2c3e-4595-b208-555b94089907 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:56.838962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fa0a7-2c3e-4595-b208-555b94089907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:56.856948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-604fa0a7-2c3e-4595-b208-555b94089907 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:56.858140 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-604fa0a7-2c3e-4595-b208-555b94089907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:56.865779 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:35:56.904361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63459f1a-3a43-4bd1-921a-25d2e5570165 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:56.914717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63459f1a-3a43-4bd1-921a-25d2e5570165 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:56.918344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc210b-7d3f-461b-b32e-c81d1ff27309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:56.918973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc210b-7d3f-461b-b32e-c81d1ff27309 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:56.919250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc210b-7d3f-461b-b32e-c81d1ff27309 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:56.919524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc210b-7d3f-461b-b32e-c81d1ff27309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:56.928019 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc210b-7d3f-461b-b32e-c81d1ff27309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:56.929436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc210b-7d3f-461b-b32e-c81d1ff27309 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:56.939158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 729/1452] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:35:59.230990 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e5bb2-be55-4ff9-b8ba-d70a654a812a None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:59.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e5bb2-be55-4ff9-b8ba-d70a654a812a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:59.231548 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e5bb2-be55-4ff9-b8ba-d70a654a812a None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:59.232947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:35:59.238122 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b7bc1-ca6f-47b5-ad79-569e95e7eede None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:59.238546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b7bc1-ca6f-47b5-ad79-569e95e7eede None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:59.238712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b7bc1-ca6f-47b5-ad79-569e95e7eede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:59.257322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-3d0b7bc1-ca6f-47b5-ad79-569e95e7eede None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:35:59.258554 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-3d0b7bc1-ca6f-47b5-ad79-569e95e7eede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:35:59.267015 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:35:59.303933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e5bb2-be55-4ff9-b8ba-d70a654a812a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:35:59.314935 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e5bb2-be55-4ff9-b8ba-d70a654a812a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:35:59.318363 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66b9b3-9694-42bd-badc-86dc11cce3c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:35:59.318985 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66b9b3-9694-42bd-badc-86dc11cce3c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:35:59.319260 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66b9b3-9694-42bd-badc-86dc11cce3c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:35:59.319528 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66b9b3-9694-42bd-badc-86dc11cce3c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:35:59.328834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66b9b3-9694-42bd-badc-86dc11cce3c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:35:59.330253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66b9b3-9694-42bd-badc-86dc11cce3c1 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:35:59.339288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 725/1455] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:35:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:01.642766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3333c5-4f78-4eed-85d3-eacd02914609 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:01.643331 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3333c5-4f78-4eed-85d3-eacd02914609 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:01.643331 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3333c5-4f78-4eed-85d3-eacd02914609 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:01.644657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:36:01.649746 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d13d1d-7ee6-440d-9e8b-626d1d2dc49e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:01.650160 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d13d1d-7ee6-440d-9e8b-626d1d2dc49e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:01.650338 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d13d1d-7ee6-440d-9e8b-626d1d2dc49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:01.667743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-71d13d1d-7ee6-440d-9e8b-626d1d2dc49e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:01.668910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-71d13d1d-7ee6-440d-9e8b-626d1d2dc49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:01.676434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:01.714781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3333c5-4f78-4eed-85d3-eacd02914609 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:01.726363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3333c5-4f78-4eed-85d3-eacd02914609 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:01.729885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f87d69-3478-4b36-853c-929f46c53341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:01.730551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f87d69-3478-4b36-853c-929f46c53341 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:01.730835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f87d69-3478-4b36-853c-929f46c53341 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:01.731107 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f87d69-3478-4b36-853c-929f46c53341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:01.739990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f87d69-3478-4b36-853c-929f46c53341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:01.741407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f87d69-3478-4b36-853c-929f46c53341 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:01.752562 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 732/1458] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:04.064970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d851c0-514b-4dcf-82e7-8891abdb27a0 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:04.065539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d851c0-514b-4dcf-82e7-8891abdb27a0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:04.065539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d851c0-514b-4dcf-82e7-8891abdb27a0 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:04.066932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:36:04.072153 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c3a5a-48c8-4ff4-9b11-94ec9ca8a7ab None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:04.073127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c3a5a-48c8-4ff4-9b11-94ec9ca8a7ab None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:04.073281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c3a5a-48c8-4ff4-9b11-94ec9ca8a7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:04.090414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-c21c3a5a-48c8-4ff4-9b11-94ec9ca8a7ab None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:04.091586 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c21c3a5a-48c8-4ff4-9b11-94ec9ca8a7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:04.099865 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:04.139142 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d851c0-514b-4dcf-82e7-8891abdb27a0 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:04.149494 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d851c0-514b-4dcf-82e7-8891abdb27a0 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:04.153328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d54a8f-cd8c-4a0a-bf51-adf035b5b42f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:04.153952 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d54a8f-cd8c-4a0a-bf51-adf035b5b42f service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:04.154265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d54a8f-cd8c-4a0a-bf51-adf035b5b42f service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:04.154541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d54a8f-cd8c-4a0a-bf51-adf035b5b42f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:04.162991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d54a8f-cd8c-4a0a-bf51-adf035b5b42f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:04.164389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d54a8f-cd8c-4a0a-bf51-adf035b5b42f service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:04.173473 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 728/1461] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:06.628935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307344-6b9f-4d9f-b59f-bdc3a6753cd0 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:06.629500 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307344-6b9f-4d9f-b59f-bdc3a6753cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:06.629500 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307344-6b9f-4d9f-b59f-bdc3a6753cd0 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:06.630896 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:36:06.636179 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cafbc-46a4-4a73-bb4f-709f0d10ba97 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:06.636637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cafbc-46a4-4a73-bb4f-709f0d10ba97 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:06.636738 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cafbc-46a4-4a73-bb4f-709f0d10ba97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:06.653697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-106cafbc-46a4-4a73-bb4f-709f0d10ba97 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:06.654922 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-106cafbc-46a4-4a73-bb4f-709f0d10ba97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:06.662634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:06.700397 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307344-6b9f-4d9f-b59f-bdc3a6753cd0 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:06.711015 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307344-6b9f-4d9f-b59f-bdc3a6753cd0 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:06.714683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5f6a3-42a1-43eb-b3ee-00bea32b9826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:06.715307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5f6a3-42a1-43eb-b3ee-00bea32b9826 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:06.715585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5f6a3-42a1-43eb-b3ee-00bea32b9826 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:06.715860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5f6a3-42a1-43eb-b3ee-00bea32b9826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:06.724572 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5f6a3-42a1-43eb-b3ee-00bea32b9826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:06.725980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5f6a3-42a1-43eb-b3ee-00bea32b9826 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:06.737015 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 735/1464] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:09.024200 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ac468-fc4b-4dfc-a5b9-4e83881b5f4e None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:09.024771 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ac468-fc4b-4dfc-a5b9-4e83881b5f4e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:09.024771 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ac468-fc4b-4dfc-a5b9-4e83881b5f4e None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:09.026268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:36:09.031654 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f6b2f-56c3-4a4b-930d-fd68e94b125f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:09.032087 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f6b2f-56c3-4a4b-930d-fd68e94b125f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:09.032206 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f6b2f-56c3-4a4b-930d-fd68e94b125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:09.049462 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-5c7f6b2f-56c3-4a4b-930d-fd68e94b125f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:09.050667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-5c7f6b2f-56c3-4a4b-930d-fd68e94b125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:09.058985 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:09.094457 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ac468-fc4b-4dfc-a5b9-4e83881b5f4e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:09.105735 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ac468-fc4b-4dfc-a5b9-4e83881b5f4e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:09.109248 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f95cb-683a-4431-a6b3-8a14fa43f0ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:09.109886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f95cb-683a-4431-a6b3-8a14fa43f0ab service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:09.110199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f95cb-683a-4431-a6b3-8a14fa43f0ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:09.110476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f95cb-683a-4431-a6b3-8a14fa43f0ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:09.119137 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f95cb-683a-4431-a6b3-8a14fa43f0ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:09.121154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f95cb-683a-4431-a6b3-8a14fa43f0ab service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:09.130602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 731/1467] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:36:11.449044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a78d1-aab6-40f2-a1d4-4558c6132513 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:11.449551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a78d1-aab6-40f2-a1d4-4558c6132513 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:11.449551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a78d1-aab6-40f2-a1d4-4558c6132513 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:11.450892 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:36:11.456139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541d72f-c64d-4780-8d9d-46d60e3782c9 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:11.456543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541d72f-c64d-4780-8d9d-46d60e3782c9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:11.456687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541d72f-c64d-4780-8d9d-46d60e3782c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:11.474927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4541d72f-c64d-4780-8d9d-46d60e3782c9 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:11.476094 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4541d72f-c64d-4780-8d9d-46d60e3782c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:11.484456 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:11.520619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a78d1-aab6-40f2-a1d4-4558c6132513 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:11.531546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a78d1-aab6-40f2-a1d4-4558c6132513 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:11.535024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8d270-6a95-43dc-b48c-e75f89a3c36e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:11.535646 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8d270-6a95-43dc-b48c-e75f89a3c36e service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:11.535925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8d270-6a95-43dc-b48c-e75f89a3c36e service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:11.536199 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8d270-6a95-43dc-b48c-e75f89a3c36e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:11.545592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8d270-6a95-43dc-b48c-e75f89a3c36e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:11.547048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8d270-6a95-43dc-b48c-e75f89a3c36e service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:11.556108 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 738/1470] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:45.072022 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e0fa7-6138-4c7e-b1c5-105fb25057df None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:45.072589 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e0fa7-6138-4c7e-b1c5-105fb25057df None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:45.072589 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e0fa7-6138-4c7e-b1c5-105fb25057df None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:45.074070 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 733/1471] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:36:45.079330 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7a1a4-7243-4532-ba04-fcfd6a1ffede None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:45.079779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7a1a4-7243-4532-ba04-fcfd6a1ffede None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:45.079876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7a1a4-7243-4532-ba04-fcfd6a1ffede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:45.097475 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-86c7a1a4-7243-4532-ba04-fcfd6a1ffede None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:45.098668 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-86c7a1a4-7243-4532-ba04-fcfd6a1ffede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:45.106868 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 739/1472] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:36:45.153370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173aa38-c6dc-49bb-bd7f-b02094b1f721 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:45.153660 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173aa38-c6dc-49bb-bd7f-b02094b1f721 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:45.153940 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173aa38-c6dc-49bb-bd7f-b02094b1f721 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:45.155340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 734/1473] 10.222.0.58 () {54 vars in 962 bytes} [Thu May 5 15:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:36:45.160067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37716376-132c-45e3-8fc2-31dab34af278 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:45.160355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37716376-132c-45e3-8fc2-31dab34af278 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:45.160632 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37716376-132c-45e3-8fc2-31dab34af278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:45.178608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-37716376-132c-45e3-8fc2-31dab34af278 None None] MFA Rules not processed for user `ab6c13dc02ba49d0be523fa9a73fdf5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:45.179767 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-37716376-132c-45e3-8fc2-31dab34af278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:45.186489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 740/1474] 10.222.0.58 () {58 vars in 1059 bytes} [Thu May 5 15:36:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:45.193525 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173aa38-c6dc-49bb-bd7f-b02094b1f721 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:45.204508 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173aa38-c6dc-49bb-bd7f-b02094b1f721 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:45.208041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bac2c-5d62-4f4d-ad05-021e2553ef3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab6c13dc02ba49d0be523fa9a73fdf5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:45.208665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bac2c-5d62-4f4d-ad05-021e2553ef3a service glance] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:45.208946 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bac2c-5d62-4f4d-ad05-021e2553ef3a service glance] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:45.209219 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bac2c-5d62-4f4d-ad05-021e2553ef3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:45.218635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bac2c-5d62-4f4d-ad05-021e2553ef3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:45.220295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bac2c-5d62-4f4d-ad05-021e2553ef3a service glance] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:45.229840 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 735/1475] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:47.567621 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927958b-d5a9-42cb-aa76-618ca8d238ee None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:47.568188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927958b-d5a9-42cb-aa76-618ca8d238ee None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:47.568188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927958b-d5a9-42cb-aa76-618ca8d238ee None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:47.569565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 741/1476] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:36:47.575566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d5dd4-0fb9-47d8-9dd9-dd4ff9901fcb None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:47.575971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d5dd4-0fb9-47d8-9dd9-dd4ff9901fcb None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:47.576120 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d5dd4-0fb9-47d8-9dd9-dd4ff9901fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:47.594529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-258d5dd4-0fb9-47d8-9dd9-dd4ff9901fcb None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:47.595715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-258d5dd4-0fb9-47d8-9dd9-dd4ff9901fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:47.603346 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 736/1477] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:47.626260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927958b-d5a9-42cb-aa76-618ca8d238ee None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:47.639246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927958b-d5a9-42cb-aa76-618ca8d238ee None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:47.643615 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67b806-b106-4b49-9974-a8fe24001c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:47.644254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67b806-b106-4b49-9974-a8fe24001c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:47.644535 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67b806-b106-4b49-9974-a8fe24001c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:47.644814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67b806-b106-4b49-9974-a8fe24001c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:47.645536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67b806-b106-4b49-9974-a8fe24001c63 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:47.647308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: WARNING py.warnings [None req-2f67b806-b106-4b49-9974-a8fe24001c63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:36:47.647308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: warnings.warn(msg) May 05 15:36:47.647308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: May 05 15:36:47.648437 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67b806-b106-4b49-9974-a8fe24001c63 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:47.667647 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 742/1478] 10.222.0.58 () {56 vars in 1108 bytes} [Thu May 5 15:36:47 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:36:49.929563 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2ac5a-4e5d-4399-8a19-5f0f5861cba8 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:49.930307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2ac5a-4e5d-4399-8a19-5f0f5861cba8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:49.930307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2ac5a-4e5d-4399-8a19-5f0f5861cba8 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:49.931698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 737/1479] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:36:49.936966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1391c-f56b-4532-9c89-4bd4801c64ae None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:49.937396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1391c-f56b-4532-9c89-4bd4801c64ae None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:49.937563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1391c-f56b-4532-9c89-4bd4801c64ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:49.955357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-61a1391c-f56b-4532-9c89-4bd4801c64ae None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:49.956577 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-61a1391c-f56b-4532-9c89-4bd4801c64ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:49.965409 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 743/1480] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:50.007522 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2ac5a-4e5d-4399-8a19-5f0f5861cba8 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:50.022505 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2ac5a-4e5d-4399-8a19-5f0f5861cba8 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:50.027869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacdbe8-1ca5-43e0-8b19-369ca53c5423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:50.028491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacdbe8-1ca5-43e0-8b19-369ca53c5423 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:50.028768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacdbe8-1ca5-43e0-8b19-369ca53c5423 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:50.029037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacdbe8-1ca5-43e0-8b19-369ca53c5423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:50.037085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacdbe8-1ca5-43e0-8b19-369ca53c5423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:50.038672 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacdbe8-1ca5-43e0-8b19-369ca53c5423 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:50.048157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 738/1481] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:52.476684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d51bb3-2f57-4592-a1b6-25219159f877 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:52.477264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d51bb3-2f57-4592-a1b6-25219159f877 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:52.477264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d51bb3-2f57-4592-a1b6-25219159f877 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:52.478624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 744/1482] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:36:52.484655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fa238-ea03-40b6-9f39-c402a4e16467 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:52.485103 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fa238-ea03-40b6-9f39-c402a4e16467 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:52.485210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fa238-ea03-40b6-9f39-c402a4e16467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:52.502533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-560fa238-ea03-40b6-9f39-c402a4e16467 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:52.503721 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-560fa238-ea03-40b6-9f39-c402a4e16467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:52.512020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 739/1483] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:52.547790 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d51bb3-2f57-4592-a1b6-25219159f877 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:52.558089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d51bb3-2f57-4592-a1b6-25219159f877 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:52.561536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548a7b3-30b7-47c9-96b3-2164177ebacc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:52.562158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548a7b3-30b7-47c9-96b3-2164177ebacc service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:52.562463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548a7b3-30b7-47c9-96b3-2164177ebacc service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:52.562735 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548a7b3-30b7-47c9-96b3-2164177ebacc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:52.571251 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548a7b3-30b7-47c9-96b3-2164177ebacc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:52.572656 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548a7b3-30b7-47c9-96b3-2164177ebacc service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:52.581647 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 745/1484] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:54.925508 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e042e-378c-42eb-bd82-aaeb20f0c675 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:54.926129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e042e-378c-42eb-bd82-aaeb20f0c675 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:54.926129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e042e-378c-42eb-bd82-aaeb20f0c675 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:54.927451 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 740/1485] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:36:54.932969 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb70185-df73-4747-850b-2be5a8ec3ffd None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:54.933420 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb70185-df73-4747-850b-2be5a8ec3ffd None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:54.933533 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb70185-df73-4747-850b-2be5a8ec3ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:54.951393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-4cb70185-df73-4747-850b-2be5a8ec3ffd None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:54.952586 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4cb70185-df73-4747-850b-2be5a8ec3ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:54.960319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 746/1486] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:54.998532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e042e-378c-42eb-bd82-aaeb20f0c675 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:55.008838 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e042e-378c-42eb-bd82-aaeb20f0c675 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:55.013191 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e5916-cc1d-46e7-b4e2-fdc2c381a96e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:55.013814 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e5916-cc1d-46e7-b4e2-fdc2c381a96e service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:55.014094 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e5916-cc1d-46e7-b4e2-fdc2c381a96e service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:55.014396 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e5916-cc1d-46e7-b4e2-fdc2c381a96e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:55.023025 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e5916-cc1d-46e7-b4e2-fdc2c381a96e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:55.024422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e5916-cc1d-46e7-b4e2-fdc2c381a96e service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:55.034252 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 741/1487] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:36:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:57.352763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472587f-e84e-491f-81ce-ce1129c26651 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:57.353372 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472587f-e84e-491f-81ce-ce1129c26651 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:57.353372 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472587f-e84e-491f-81ce-ce1129c26651 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:57.355450 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 747/1488] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:36:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:36:57.360616 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc2a1e-2d8b-42ca-b295-caf59fb300ed None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:57.361024 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc2a1e-2d8b-42ca-b295-caf59fb300ed None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:57.361216 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc2a1e-2d8b-42ca-b295-caf59fb300ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:57.378862 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-29dc2a1e-2d8b-42ca-b295-caf59fb300ed None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:57.380049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-29dc2a1e-2d8b-42ca-b295-caf59fb300ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:57.387844 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 742/1489] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:36:57.427084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472587f-e84e-491f-81ce-ce1129c26651 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:57.438263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472587f-e84e-491f-81ce-ce1129c26651 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:57.441698 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684b795-c162-481f-be81-915436aef85f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:57.442357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b795-c162-481f-be81-915436aef85f service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:57.442640 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b795-c162-481f-be81-915436aef85f service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:57.442912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b795-c162-481f-be81-915436aef85f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:57.451635 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684b795-c162-481f-be81-915436aef85f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:57.453099 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684b795-c162-481f-be81-915436aef85f service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:57.462169 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 748/1490] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:36:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:36:59.880512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537988e-73c5-480d-a229-03e33e028fa3 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:59.881082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537988e-73c5-480d-a229-03e33e028fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:59.881082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537988e-73c5-480d-a229-03e33e028fa3 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:59.882546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 743/1491] 10.222.0.58 () {54 vars in 926 bytes} [Thu May 5 15:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:36:59.888437 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2feb20-cb31-4576-81fe-c8c488448f37 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:59.888865 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2feb20-cb31-4576-81fe-c8c488448f37 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:59.888983 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2feb20-cb31-4576-81fe-c8c488448f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:59.906509 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-fd2feb20-cb31-4576-81fe-c8c488448f37 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:36:59.907688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-fd2feb20-cb31-4576-81fe-c8c488448f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:36:59.915305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 749/1492] 10.222.0.58 () {58 vars in 1023 bytes} [Thu May 5 15:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:36:59.953400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537988e-73c5-480d-a229-03e33e028fa3 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:36:59.964924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537988e-73c5-480d-a229-03e33e028fa3 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:36:59.968421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3457e2-766e-4179-8660-9f0238cb6349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:36:59.969049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3457e2-766e-4179-8660-9f0238cb6349 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:36:59.969571 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3457e2-766e-4179-8660-9f0238cb6349 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:36:59.969852 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3457e2-766e-4179-8660-9f0238cb6349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:36:59.978541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3457e2-766e-4179-8660-9f0238cb6349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:36:59.980682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3457e2-766e-4179-8660-9f0238cb6349 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:36:59.989838 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 744/1493] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:27.715417 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741631-d2c0-418e-bdd2-645fd83f2ea6 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:27.716002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741631-d2c0-418e-bdd2-645fd83f2ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:27.716002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741631-d2c0-418e-bdd2-645fd83f2ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:27.734037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-8e741631-d2c0-418e-bdd2-645fd83f2ea6 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:27.735240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8e741631-d2c0-418e-bdd2-645fd83f2ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:27.742962 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 750/1494] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:27.750920 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c93d7-192b-4a80-a186-521d11bcec44 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:27.751395 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c93d7-192b-4a80-a186-521d11bcec44 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:27.751503 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c93d7-192b-4a80-a186-521d11bcec44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:27.768599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8b8c93d7-192b-4a80-a186-521d11bcec44 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:27.769721 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8b8c93d7-192b-4a80-a186-521d11bcec44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:27.778000 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 745/1495] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:27.782365 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e741631-d2c0-418e-bdd2-645fd83f2ea6 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:27.792353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e741631-d2c0-418e-bdd2-645fd83f2ea6 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:27.796850 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809c1cb-f535-4077-ba96-9a14b0855821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:27.797487 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809c1cb-f535-4077-ba96-9a14b0855821 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:27.797768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809c1cb-f535-4077-ba96-9a14b0855821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:27.798037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809c1cb-f535-4077-ba96-9a14b0855821 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:27.798781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809c1cb-f535-4077-ba96-9a14b0855821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:38:27.799081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809c1cb-f535-4077-ba96-9a14b0855821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:27.800074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: WARNING py.warnings [None req-f809c1cb-f535-4077-ba96-9a14b0855821 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 15:38:27.800074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: warnings.warn(msg) May 05 15:38:27.800074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: May 05 15:38:27.800936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809c1cb-f535-4077-ba96-9a14b0855821 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:27.812056 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 751/1496] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:38:27.819911 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c93d7-192b-4a80-a186-521d11bcec44 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:27.828928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c93d7-192b-4a80-a186-521d11bcec44 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:27.833348 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a0e74-92a8-4127-8501-89efdeee1514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:27.833981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a0e74-92a8-4127-8501-89efdeee1514 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:27.834296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a0e74-92a8-4127-8501-89efdeee1514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:27.834573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a0e74-92a8-4127-8501-89efdeee1514 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:27.835255 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a0e74-92a8-4127-8501-89efdeee1514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:27.837007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: WARNING py.warnings [None req-7c1a0e74-92a8-4127-8501-89efdeee1514 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:38:27.837007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: warnings.warn(msg) May 05 15:38:27.837007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: May 05 15:38:27.838927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a0e74-92a8-4127-8501-89efdeee1514 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:27.873825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 746/1497] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:38:27 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:38:27.878287 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809c1cb-f535-4077-ba96-9a14b0855821 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:27.887803 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809c1cb-f535-4077-ba96-9a14b0855821 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:27.943740 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47707ce3-7260-45b0-b8f7-a1b4f9275912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:27.944542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47707ce3-7260-45b0-b8f7-a1b4f9275912 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:27.944918 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47707ce3-7260-45b0-b8f7-a1b4f9275912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:27.945297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47707ce3-7260-45b0-b8f7-a1b4f9275912 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:27.946094 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47707ce3-7260-45b0-b8f7-a1b4f9275912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:27.947931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: WARNING py.warnings [None req-47707ce3-7260-45b0-b8f7-a1b4f9275912 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:38:27.947931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: warnings.warn(msg) May 05 15:38:27.947931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: May 05 15:38:27.949133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47707ce3-7260-45b0-b8f7-a1b4f9275912 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:27.968597 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 752/1498] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:38:27 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:38:27.972918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a0e74-92a8-4127-8501-89efdeee1514 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:27.983322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a0e74-92a8-4127-8501-89efdeee1514 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:27.987881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577428e-3e7b-4bc8-a063-5fa70a55fbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:27.988534 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577428e-3e7b-4bc8-a063-5fa70a55fbbe admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:27.988816 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577428e-3e7b-4bc8-a063-5fa70a55fbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:27.989090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577428e-3e7b-4bc8-a063-5fa70a55fbbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:27.989810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577428e-3e7b-4bc8-a063-5fa70a55fbbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:27.990885 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: WARNING py.warnings [None req-e577428e-3e7b-4bc8-a063-5fa70a55fbbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 15:38:27.990885 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: warnings.warn(msg) May 05 15:38:27.990885 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: May 05 15:38:27.991743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577428e-3e7b-4bc8-a063-5fa70a55fbbe admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:28.004845 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 747/1499] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:38:28.008671 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47707ce3-7260-45b0-b8f7-a1b4f9275912 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:28.018728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47707ce3-7260-45b0-b8f7-a1b4f9275912 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:28.023188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa3530-46ee-4de4-8491-8c4c02fb3f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:28.023854 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa3530-46ee-4de4-8491-8c4c02fb3f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:28.024441 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa3530-46ee-4de4-8491-8c4c02fb3f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:28.024745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa3530-46ee-4de4-8491-8c4c02fb3f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:28.026285 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa3530-46ee-4de4-8491-8c4c02fb3f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:28.027317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: WARNING py.warnings [None req-c7fa3530-46ee-4de4-8491-8c4c02fb3f20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 15:38:28.027317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: warnings.warn(msg) May 05 15:38:28.027317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: May 05 15:38:28.028222 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa3530-46ee-4de4-8491-8c4c02fb3f20 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:28.041511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 753/1500] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:38:28.045506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577428e-3e7b-4bc8-a063-5fa70a55fbbe admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:28.055200 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577428e-3e7b-4bc8-a063-5fa70a55fbbe admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:28.060475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53f7c2-77ed-4f48-8c51-1123f7ac9439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:28.061414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53f7c2-77ed-4f48-8c51-1123f7ac9439 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:28.061692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53f7c2-77ed-4f48-8c51-1123f7ac9439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:28.061968 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53f7c2-77ed-4f48-8c51-1123f7ac9439 admin admin] PATH_INFO: `/v3/projects/1971f0d374014fa7838b2d5aa2ab2337/users/952bcd29e13f4f7f83bb6c4f6612a2e9/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:28.077496 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53f7c2-77ed-4f48-8c51-1123f7ac9439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1971f0d374014fa7838b2d5aa2ab2337, user_id=952bcd29e13f4f7f83bb6c4f6612a2e9, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:28.078546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: WARNING py.warnings [None req-8b53f7c2-77ed-4f48-8c51-1123f7ac9439 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:38:28.078546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: warnings.warn(msg) May 05 15:38:28.078546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: May 05 15:38:28.080458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53f7c2-77ed-4f48-8c51-1123f7ac9439 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:28.094446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 748/1501] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:38:28 2022] PUT /identity/v3/projects/1971f0d374014fa7838b2d5aa2ab2337/users/952bcd29e13f4f7f83bb6c4f6612a2e9/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:28.105925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78271f-f6ac-47e1-9194-bff6185239c3 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:28.106234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78271f-f6ac-47e1-9194-bff6185239c3 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:28.106510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78271f-f6ac-47e1-9194-bff6185239c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:28.132919 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-7a78271f-f6ac-47e1-9194-bff6185239c3 None None] MFA Rules not processed for user `952bcd29e13f4f7f83bb6c4f6612a2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:28.134660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7a78271f-f6ac-47e1-9194-bff6185239c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:28.195347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 754/1502] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:38:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:28.206851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53f7c2-77ed-4f48-8c51-1123f7ac9439 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:28.277997 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53f7c2-77ed-4f48-8c51-1123f7ac9439 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:28.283360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78fbe4-c6da-4870-a84c-5ca33a1292dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:28.284007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78fbe4-c6da-4870-a84c-5ca33a1292dc service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:28.284288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78fbe4-c6da-4870-a84c-5ca33a1292dc service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:28.284562 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78fbe4-c6da-4870-a84c-5ca33a1292dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:28.292907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78fbe4-c6da-4870-a84c-5ca33a1292dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:28.294512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78fbe4-c6da-4870-a84c-5ca33a1292dc service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:28.303056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 749/1503] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:38:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:28.375089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a446301-7183-40ac-9987-dda8abdd3f33 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:28.375384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a446301-7183-40ac-9987-dda8abdd3f33 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:28.375669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a446301-7183-40ac-9987-dda8abdd3f33 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:28.376960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 755/1504] 10.222.0.58 () {52 vars in 829 bytes} [Thu May 5 15:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:38:28.380515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78fbe4-c6da-4870-a84c-5ca33a1292dc service nova] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:28.440323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78fbe4-c6da-4870-a84c-5ca33a1292dc service nova] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:28.444875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2427a6-e689-4f0f-b11d-087c29666061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:28.445729 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2427a6-e689-4f0f-b11d-087c29666061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:28.446005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2427a6-e689-4f0f-b11d-087c29666061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:28.446304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2427a6-e689-4f0f-b11d-087c29666061 admin admin] PATH_INFO: `/v3/users/952bcd29e13f4f7f83bb6c4f6612a2e9` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:28.447533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2427a6-e689-4f0f-b11d-087c29666061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=952bcd29e13f4f7f83bb6c4f6612a2e9)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:28.448531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: WARNING py.warnings [None req-ff2427a6-e689-4f0f-b11d-087c29666061 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:38:28.448531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: warnings.warn(msg) May 05 15:38:28.448531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: May 05 15:38:28.449711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2427a6-e689-4f0f-b11d-087c29666061 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:28.512841 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-ff2427a6-e689-4f0f-b11d-087c29666061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '952bcd29e13f4f7f83bb6c4f6612a2e9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:28.526017 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-ff2427a6-e689-4f0f-b11d-087c29666061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '952bcd29e13f4f7f83bb6c4f6612a2e9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:28.526842 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-ff2427a6-e689-4f0f-b11d-087c29666061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '952bcd29e13f4f7f83bb6c4f6612a2e9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:28.527467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-ff2427a6-e689-4f0f-b11d-087c29666061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '952bcd29e13f4f7f83bb6c4f6612a2e9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:28.545903 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-ff2427a6-e689-4f0f-b11d-087c29666061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '952bcd29e13f4f7f83bb6c4f6612a2e9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:28.560877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 750/1505] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:38:28 2022] DELETE /identity/v3/users/952bcd29e13f4f7f83bb6c4f6612a2e9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:38:28.565234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0b16d-15fa-4126-b515-a7ce00ad569b None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:28.565521 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0b16d-15fa-4126-b515-a7ce00ad569b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:28.565799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0b16d-15fa-4126-b515-a7ce00ad569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:28.583021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-bba0b16d-15fa-4126-b515-a7ce00ad569b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:38:28.584188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bba0b16d-15fa-4126-b515-a7ce00ad569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:28.640392 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 756/1506] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:38:28.649897 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2427a6-e689-4f0f-b11d-087c29666061 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:28.651903 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ff2427a6-e689-4f0f-b11d-087c29666061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:28.708984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2427a6-e689-4f0f-b11d-087c29666061 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:28.712666 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329cb96-7807-4171-aec2-d10c1ac17d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:28.714090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329cb96-7807-4171-aec2-d10c1ac17d3b service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:28.714404 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329cb96-7807-4171-aec2-d10c1ac17d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:28.714678 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329cb96-7807-4171-aec2-d10c1ac17d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:28.723669 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329cb96-7807-4171-aec2-d10c1ac17d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:28.725086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329cb96-7807-4171-aec2-d10c1ac17d3b service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:28.734982 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 751/1507] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:38:29.055489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0b16d-15fa-4126-b515-a7ce00ad569b None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:38:29.057027 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bba0b16d-15fa-4126-b515-a7ce00ad569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:38:29.068380 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0b16d-15fa-4126-b515-a7ce00ad569b None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:38:29.072934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de3a7a-38f7-46d8-857c-f33f8e102044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:38:29.073788 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de3a7a-38f7-46d8-857c-f33f8e102044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:38:29.074067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de3a7a-38f7-46d8-857c-f33f8e102044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:38:29.074373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de3a7a-38f7-46d8-857c-f33f8e102044 admin admin] PATH_INFO: `/v3/projects/1971f0d374014fa7838b2d5aa2ab2337` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:38:29.075600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de3a7a-38f7-46d8-857c-f33f8e102044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1971f0d374014fa7838b2d5aa2ab2337)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:38:29.076552 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: WARNING py.warnings [None req-42de3a7a-38f7-46d8-857c-f33f8e102044 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:38:29.076552 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: warnings.warn(msg) May 05 15:38:29.076552 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: May 05 15:38:29.077713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de3a7a-38f7-46d8-857c-f33f8e102044 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:38:29.136395 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-42de3a7a-38f7-46d8-857c-f33f8e102044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1971f0d374014fa7838b2d5aa2ab2337', 'request_id': 'req-42de3a7a-38f7-46d8-857c-f33f8e102044'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:29.142070 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-42de3a7a-38f7-46d8-857c-f33f8e102044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1971f0d374014fa7838b2d5aa2ab2337', 'request_id': 'req-42de3a7a-38f7-46d8-857c-f33f8e102044'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:29.155436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-42de3a7a-38f7-46d8-857c-f33f8e102044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1971f0d374014fa7838b2d5aa2ab2337', 'request_id': 'req-42de3a7a-38f7-46d8-857c-f33f8e102044'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:29.169501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-42de3a7a-38f7-46d8-857c-f33f8e102044 admin admin] The token cache is being invalidate because project 1971f0d374014fa7838b2d5aa2ab2337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:38:29.169786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-42de3a7a-38f7-46d8-857c-f33f8e102044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:29.170501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-42de3a7a-38f7-46d8-857c-f33f8e102044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:38:29.172335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 757/1508] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:38:29 2022] DELETE /identity/v3/projects/1971f0d374014fa7838b2d5aa2ab2337 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:40:10.025012 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676de24-8881-47f7-ad48-9e3b4cf11cad None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:10.025612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676de24-8881-47f7-ad48-9e3b4cf11cad None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:10.025612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676de24-8881-47f7-ad48-9e3b4cf11cad None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:10.027062 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 752/1509] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:40:10.031933 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f3e8-5b48-4c6d-834d-ff2517846582 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:10.032336 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f3e8-5b48-4c6d-834d-ff2517846582 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:10.032481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f3e8-5b48-4c6d-834d-ff2517846582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:10.050439 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-8102f3e8-5b48-4c6d-834d-ff2517846582 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:10.051623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8102f3e8-5b48-4c6d-834d-ff2517846582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:10.108055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 758/1510] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:10.260737 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676de24-8881-47f7-ad48-9e3b4cf11cad None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:10.263643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8676de24-8881-47f7-ad48-9e3b4cf11cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:10.334109 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676de24-8881-47f7-ad48-9e3b4cf11cad None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:10.339980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fd0de-5bbd-4cf6-a25b-c8637a7a6599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:10.340624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fd0de-5bbd-4cf6-a25b-c8637a7a6599 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:10.340905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fd0de-5bbd-4cf6-a25b-c8637a7a6599 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:10.341176 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fd0de-5bbd-4cf6-a25b-c8637a7a6599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:10.349248 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2fd0de-5bbd-4cf6-a25b-c8637a7a6599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:10.350907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2fd0de-5bbd-4cf6-a25b-c8637a7a6599 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:10.361004 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 753/1511] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:10.635197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd9297-3c2a-4f26-b869-e321f3481de6 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:10.635479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd9297-3c2a-4f26-b869-e321f3481de6 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:10.635758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd9297-3c2a-4f26-b869-e321f3481de6 None None] PATH_INFO: `/v3` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:10.637641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 759/1512] 10.222.0.41 () {54 vars in 925 bytes} [Thu May 5 15:40:10 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:40:10.643694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058d390-c99e-49e6-aa73-e70add956e48 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:10.644057 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058d390-c99e-49e6-aa73-e70add956e48 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:10.644426 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058d390-c99e-49e6-aa73-e70add956e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:10.662637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8058d390-c99e-49e6-aa73-e70add956e48 None None] MFA Rules not processed for user `a12f5d874be84f1ca79eb439267c7b70`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:10.663832 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8058d390-c99e-49e6-aa73-e70add956e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:10.723364 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 754/1513] 10.222.0.41 () {58 vars in 1015 bytes} [Thu May 5 15:40:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:11.593538 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97340de-fbad-4603-8abb-218044ec3359 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:11.594115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97340de-fbad-4603-8abb-218044ec3359 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:11.594115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97340de-fbad-4603-8abb-218044ec3359 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:11.595476 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:40:11.600515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2d02e-a005-45b9-b067-0adbcc3c0eaa None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:11.600922 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2d02e-a005-45b9-b067-0adbcc3c0eaa None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:11.601071 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2d02e-a005-45b9-b067-0adbcc3c0eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:11.622024 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b3c2d02e-a005-45b9-b067-0adbcc3c0eaa None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:11.623227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b3c2d02e-a005-45b9-b067-0adbcc3c0eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:11.631121 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:11.782757 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97340de-fbad-4603-8abb-218044ec3359 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:11.797185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97340de-fbad-4603-8abb-218044ec3359 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:11.802429 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88dacd-f08f-42c8-bbd1-6d3699231e50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:11.803051 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88dacd-f08f-42c8-bbd1-6d3699231e50 service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:11.803325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88dacd-f08f-42c8-bbd1-6d3699231e50 service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:11.803593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88dacd-f08f-42c8-bbd1-6d3699231e50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:11.811531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88dacd-f08f-42c8-bbd1-6d3699231e50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:11.813140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88dacd-f08f-42c8-bbd1-6d3699231e50 service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:11.822257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 761/1516] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:14.543760 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aaf793-a9a6-4e06-a918-bc682b1ad52a None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:14.544265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aaf793-a9a6-4e06-a918-bc682b1ad52a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:14.544375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aaf793-a9a6-4e06-a918-bc682b1ad52a None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:14.545660 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 756/1517] 10.222.0.58 () {54 vars in 960 bytes} [Thu May 5 15:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:40:14.550546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91033d8-b489-4e14-a498-802eb9325e35 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:14.550990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91033d8-b489-4e14-a498-802eb9325e35 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:14.551101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91033d8-b489-4e14-a498-802eb9325e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:14.569917 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-f91033d8-b489-4e14-a498-802eb9325e35 None None] MFA Rules not processed for user `a12f5d874be84f1ca79eb439267c7b70`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:14.572233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-f91033d8-b489-4e14-a498-802eb9325e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:14.582251 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 762/1518] 10.222.0.58 () {58 vars in 1057 bytes} [Thu May 5 15:40:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:14.590199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aaf793-a9a6-4e06-a918-bc682b1ad52a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:14.604244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aaf793-a9a6-4e06-a918-bc682b1ad52a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:14.609399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365c6d8-2d83-443e-9a25-b5aee8e5fa76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12f5d874be84f1ca79eb439267c7b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:14.610042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365c6d8-2d83-443e-9a25-b5aee8e5fa76 service placement] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:14.610365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365c6d8-2d83-443e-9a25-b5aee8e5fa76 service placement] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:14.610647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365c6d8-2d83-443e-9a25-b5aee8e5fa76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:14.619077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365c6d8-2d83-443e-9a25-b5aee8e5fa76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:14.620752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365c6d8-2d83-443e-9a25-b5aee8e5fa76 service placement] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:14.630565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 757/1519] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:40:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:23.473111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f49c1a-a6f0-4e8a-9684-feabd7cd355f None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:23.473694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f49c1a-a6f0-4e8a-9684-feabd7cd355f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:23.473694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f49c1a-a6f0-4e8a-9684-feabd7cd355f None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:23.475046 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 763/1520] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:40:23.480238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab351829-908a-40bb-8ef2-c42dd710cb8e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:23.480752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab351829-908a-40bb-8ef2-c42dd710cb8e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:23.480752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab351829-908a-40bb-8ef2-c42dd710cb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:23.497955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ab351829-908a-40bb-8ef2-c42dd710cb8e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:23.499160 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ab351829-908a-40bb-8ef2-c42dd710cb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:23.507046 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 758/1521] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:40:23.655918 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f49c1a-a6f0-4e8a-9684-feabd7cd355f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:23.670576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f49c1a-a6f0-4e8a-9684-feabd7cd355f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:23.675888 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768164e-5f39-43c2-b386-36c5ffe09d98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:23.676512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768164e-5f39-43c2-b386-36c5ffe09d98 service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:23.676794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768164e-5f39-43c2-b386-36c5ffe09d98 service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:23.677069 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768164e-5f39-43c2-b386-36c5ffe09d98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:23.685835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768164e-5f39-43c2-b386-36c5ffe09d98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:23.687449 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768164e-5f39-43c2-b386-36c5ffe09d98 service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:23.696845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 764/1522] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:24.926482 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb00d5-a404-46f6-8304-1322b0de5238 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:24.927037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb00d5-a404-46f6-8304-1322b0de5238 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:24.927037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb00d5-a404-46f6-8304-1322b0de5238 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:24.928412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 759/1523] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 5 15:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:40:24.933774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839c587-e4f0-4ed2-a7b7-9cb84b572926 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:24.934249 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839c587-e4f0-4ed2-a7b7-9cb84b572926 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:24.934365 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839c587-e4f0-4ed2-a7b7-9cb84b572926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:24.952883 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-f839c587-e4f0-4ed2-a7b7-9cb84b572926 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:24.954101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-f839c587-e4f0-4ed2-a7b7-9cb84b572926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:24.961946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 765/1524] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 5 15:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:25.114881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb00d5-a404-46f6-8304-1322b0de5238 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:25.129184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb00d5-a404-46f6-8304-1322b0de5238 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:25.134574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d1b39-ab1b-471f-b8d0-456b0592ee59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:25.135236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1b39-ab1b-471f-b8d0-456b0592ee59 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:25.135520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1b39-ab1b-471f-b8d0-456b0592ee59 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:25.136288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1b39-ab1b-471f-b8d0-456b0592ee59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:25.144442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d1b39-ab1b-471f-b8d0-456b0592ee59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:25.146009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d1b39-ab1b-471f-b8d0-456b0592ee59 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:25.155907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 760/1525] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:29.265159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4ddf3-b8bb-496a-9e36-a514e37329f9 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:29.265761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4ddf3-b8bb-496a-9e36-a514e37329f9 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:29.265761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4ddf3-b8bb-496a-9e36-a514e37329f9 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:29.267186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 766/1526] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:40:29.272285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cea1ac-6c0a-4b0c-ad7c-1a38f71810f1 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:29.272721 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cea1ac-6c0a-4b0c-ad7c-1a38f71810f1 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:29.272831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cea1ac-6c0a-4b0c-ad7c-1a38f71810f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:29.290376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-07cea1ac-6c0a-4b0c-ad7c-1a38f71810f1 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:29.291586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-07cea1ac-6c0a-4b0c-ad7c-1a38f71810f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:29.300022 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 761/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:29.336274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4ddf3-b8bb-496a-9e36-a514e37329f9 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:29.337940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-70a4ddf3-b8bb-496a-9e36-a514e37329f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:29.395547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4ddf3-b8bb-496a-9e36-a514e37329f9 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:29.399058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fc4f7-5548-4ac3-affa-225130ac8bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:29.399696 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fc4f7-5548-4ac3-affa-225130ac8bec service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:29.399975 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fc4f7-5548-4ac3-affa-225130ac8bec service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:29.400247 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fc4f7-5548-4ac3-affa-225130ac8bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:29.409190 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fc4f7-5548-4ac3-affa-225130ac8bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:29.410638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fc4f7-5548-4ac3-affa-225130ac8bec service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:29.420307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 767/1528] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:31.660356 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4bc4e-ba0f-420c-8646-49a22ed1c909 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:31.660889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4bc4e-ba0f-420c-8646-49a22ed1c909 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:31.660889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4bc4e-ba0f-420c-8646-49a22ed1c909 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:31.662272 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 762/1529] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:40:31.668009 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37352a-bff2-4a06-81c3-935a071b2957 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:31.668422 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37352a-bff2-4a06-81c3-935a071b2957 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:31.668553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37352a-bff2-4a06-81c3-935a071b2957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:31.687708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-5c37352a-bff2-4a06-81c3-935a071b2957 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:31.688885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-5c37352a-bff2-4a06-81c3-935a071b2957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:31.696457 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 768/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:31.732830 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4bc4e-ba0f-420c-8646-49a22ed1c909 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:31.743245 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4bc4e-ba0f-420c-8646-49a22ed1c909 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:31.746781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb8997-4e94-405a-a82f-2b16f3e8a073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:31.747404 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb8997-4e94-405a-a82f-2b16f3e8a073 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:31.747686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb8997-4e94-405a-a82f-2b16f3e8a073 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:31.747957 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb8997-4e94-405a-a82f-2b16f3e8a073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:31.756368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb8997-4e94-405a-a82f-2b16f3e8a073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:31.757771 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb8997-4e94-405a-a82f-2b16f3e8a073 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:31.766901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 763/1531] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:35.614617 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed97d2-4ee5-4b1a-a1e9-1d5c1d0ae9f6 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:35.615174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed97d2-4ee5-4b1a-a1e9-1d5c1d0ae9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:35.615174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed97d2-4ee5-4b1a-a1e9-1d5c1d0ae9f6 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:35.616492 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 769/1532] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:40:35.621764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db08dd6-835b-437b-aafc-f18fcbd8ae01 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:35.622223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db08dd6-835b-437b-aafc-f18fcbd8ae01 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:35.622340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db08dd6-835b-437b-aafc-f18fcbd8ae01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:35.639412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-2db08dd6-835b-437b-aafc-f18fcbd8ae01 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:35.640584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-2db08dd6-835b-437b-aafc-f18fcbd8ae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:35.648152 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 764/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:35.919344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed97d2-4ee5-4b1a-a1e9-1d5c1d0ae9f6 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:35.921018 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b7ed97d2-4ee5-4b1a-a1e9-1d5c1d0ae9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:35.976811 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed97d2-4ee5-4b1a-a1e9-1d5c1d0ae9f6 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:35.980622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced973e5-33b2-46d7-8c78-7b39c92b46b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:35.981257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced973e5-33b2-46d7-8c78-7b39c92b46b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:35.981539 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced973e5-33b2-46d7-8c78-7b39c92b46b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:35.981815 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced973e5-33b2-46d7-8c78-7b39c92b46b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:35.990585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced973e5-33b2-46d7-8c78-7b39c92b46b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:35.991998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced973e5-33b2-46d7-8c78-7b39c92b46b2 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:36.001129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 770/1534] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:40:38.295296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7c68f-df87-4e08-acdb-5fc40327b7ad None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:38.295866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7c68f-df87-4e08-acdb-5fc40327b7ad None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:38.295866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7c68f-df87-4e08-acdb-5fc40327b7ad None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:38.297197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 765/1535] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 5 15:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:40:38.302553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b965a8e-f816-4452-a2b6-761c4ad576f4 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:38.302970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b965a8e-f816-4452-a2b6-761c4ad576f4 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:38.303104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b965a8e-f816-4452-a2b6-761c4ad576f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:38.321233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-1b965a8e-f816-4452-a2b6-761c4ad576f4 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:38.322436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-1b965a8e-f816-4452-a2b6-761c4ad576f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:38.330590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 771/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 5 15:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:38.600797 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71117e-6462-4549-a9f0-4f72c34e9bcc None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:38.601084 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71117e-6462-4549-a9f0-4f72c34e9bcc None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:38.601359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71117e-6462-4549-a9f0-4f72c34e9bcc None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:38.602748 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 766/1537] 10.222.0.58 () {54 vars in 963 bytes} [Thu May 5 15:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:40:38.607779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c5451-8dea-43df-aedf-f0323e464fce None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:38.608065 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c5451-8dea-43df-aedf-f0323e464fce None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:38.608342 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c5451-8dea-43df-aedf-f0323e464fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:38.626096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-7d3c5451-8dea-43df-aedf-f0323e464fce None None] MFA Rules not processed for user `bb9a301df6534b499d60486060df7068`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:40:38.627283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7d3c5451-8dea-43df-aedf-f0323e464fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:40:38.633462 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 772/1538] 10.222.0.58 () {58 vars in 1060 bytes} [Thu May 5 15:40:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:40:38.641400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71117e-6462-4549-a9f0-4f72c34e9bcc None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:40:38.651688 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71117e-6462-4549-a9f0-4f72c34e9bcc None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:40:38.655164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b6d0c-72b4-454d-8534-68f2876a22f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:40:38.655778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b6d0c-72b4-454d-8534-68f2876a22f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:40:38.656055 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b6d0c-72b4-454d-8534-68f2876a22f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:40:38.656331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b6d0c-72b4-454d-8534-68f2876a22f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:40:38.664802 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b6d0c-72b4-454d-8534-68f2876a22f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:40:38.666256 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b6d0c-72b4-454d-8534-68f2876a22f1 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:40:38.675354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 767/1539] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:42:08.472429 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e93ac-bcbd-492b-a458-298bcb08fdd3 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.473639 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e93ac-bcbd-492b-a458-298bcb08fdd3 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.474138 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e93ac-bcbd-492b-a458-298bcb08fdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.503514 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-e70e93ac-bcbd-492b-a458-298bcb08fdd3 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:08.505122 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e70e93ac-bcbd-492b-a458-298bcb08fdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:08.524483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 773/1540] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:08.535464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72696c1-d3a8-4a42-954b-1722e9fba97a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.536090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72696c1-d3a8-4a42-954b-1722e9fba97a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.536090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72696c1-d3a8-4a42-954b-1722e9fba97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.567508 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a72696c1-d3a8-4a42-954b-1722e9fba97a None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:08.568829 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a72696c1-d3a8-4a42-954b-1722e9fba97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:08.580544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 768/1541] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:08.585556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e93ac-bcbd-492b-a458-298bcb08fdd3 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:08.588654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f96be6-3970-42e4-ba7d-fe0b79e47283 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.588941 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f96be6-3970-42e4-ba7d-fe0b79e47283 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.589359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f96be6-3970-42e4-ba7d-fe0b79e47283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.601991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e93ac-bcbd-492b-a458-298bcb08fdd3 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:08.610544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900e16a-0d16-48f1-9b0a-9b5bf374fd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:08.611513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900e16a-0d16-48f1-9b0a-9b5bf374fd49 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.612040 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900e16a-0d16-48f1-9b0a-9b5bf374fd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.612523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900e16a-0d16-48f1-9b0a-9b5bf374fd49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.613448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900e16a-0d16-48f1-9b0a-9b5bf374fd49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:08.613963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900e16a-0d16-48f1-9b0a-9b5bf374fd49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:08.619471 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900e16a-0d16-48f1-9b0a-9b5bf374fd49 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:08.622879 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-93f96be6-3970-42e4-ba7d-fe0b79e47283 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:08.624073 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-93f96be6-3970-42e4-ba7d-fe0b79e47283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:08.637788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 769/1542] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:42:08.642244 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 774/1543] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:08.648352 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539f680-3d71-4be4-841d-f74362f84bb0 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.648639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539f680-3d71-4be4-841d-f74362f84bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.649158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539f680-3d71-4be4-841d-f74362f84bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.651572 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900e16a-0d16-48f1-9b0a-9b5bf374fd49 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:08.666373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900e16a-0d16-48f1-9b0a-9b5bf374fd49 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:08.673196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f539f680-3d71-4be4-841d-f74362f84bb0 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:08.674759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f539f680-3d71-4be4-841d-f74362f84bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:08.675502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458fef4-cce9-40c3-a27a-5f18aad74d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:08.676269 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458fef4-cce9-40c3-a27a-5f18aad74d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.676669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458fef4-cce9-40c3-a27a-5f18aad74d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.677042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458fef4-cce9-40c3-a27a-5f18aad74d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.677842 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458fef4-cce9-40c3-a27a-5f18aad74d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:08.678978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: WARNING py.warnings [None req-9458fef4-cce9-40c3-a27a-5f18aad74d38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:42:08.678978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: warnings.warn(msg) May 05 15:42:08.678978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: May 05 15:42:08.680477 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458fef4-cce9-40c3-a27a-5f18aad74d38 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:08.698428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 770/1544] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:08.699858 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c292e1d-3dc4-43aa-8976-e138e6697f34 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.700145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c292e1d-3dc4-43aa-8976-e138e6697f34 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.700421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c292e1d-3dc4-43aa-8976-e138e6697f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.737288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8c292e1d-3dc4-43aa-8976-e138e6697f34 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:08.738581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8c292e1d-3dc4-43aa-8976-e138e6697f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:08.750097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 775/1545] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:08 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:42:08.751191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458fef4-cce9-40c3-a27a-5f18aad74d38 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:08.766639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 771/1546] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:08.768355 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4ad4-e97c-485f-ba48-7ec80fdc154f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.769141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4ad4-e97c-485f-ba48-7ec80fdc154f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.769612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4ad4-e97c-485f-ba48-7ec80fdc154f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.794046 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a56b4ad4-e97c-485f-ba48-7ec80fdc154f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:08.795369 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a56b4ad4-e97c-485f-ba48-7ec80fdc154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:08.831762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458fef4-cce9-40c3-a27a-5f18aad74d38 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:08.836874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e63272-6028-4949-8f10-6be1396b10e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:08.837652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e63272-6028-4949-8f10-6be1396b10e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.837937 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e63272-6028-4949-8f10-6be1396b10e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.838271 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e63272-6028-4949-8f10-6be1396b10e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.839006 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e63272-6028-4949-8f10-6be1396b10e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:08.839310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e63272-6028-4949-8f10-6be1396b10e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:08.840909 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e63272-6028-4949-8f10-6be1396b10e6 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:08.854500 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 776/1547] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:08.855781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220ef9a-9b0c-4da5-8e6e-cc386c2d909c None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.856077 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220ef9a-9b0c-4da5-8e6e-cc386c2d909c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.856355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220ef9a-9b0c-4da5-8e6e-cc386c2d909c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.871123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 772/1548] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:08.871948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b4ad4-e97c-485f-ba48-7ec80fdc154f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:08.874258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-9220ef9a-9b0c-4da5-8e6e-cc386c2d909c None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:08.875528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9220ef9a-9b0c-4da5-8e6e-cc386c2d909c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:08.881218 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b4ad4-e97c-485f-ba48-7ec80fdc154f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:08.884338 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 777/1549] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:08.885569 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d81405-9d0a-4838-a880-0ebc7ee80728 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.885861 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d81405-9d0a-4838-a880-0ebc7ee80728 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.886123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d81405-9d0a-4838-a880-0ebc7ee80728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.887035 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671a8f9-6b97-4052-9152-a91d0d5f5d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:08.887695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671a8f9-6b97-4052-9152-a91d0d5f5d71 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.887978 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671a8f9-6b97-4052-9152-a91d0d5f5d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.888250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671a8f9-6b97-4052-9152-a91d0d5f5d71 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.888924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671a8f9-6b97-4052-9152-a91d0d5f5d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:08.889959 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: WARNING py.warnings [None req-c671a8f9-6b97-4052-9152-a91d0d5f5d71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:42:08.889959 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: warnings.warn(msg) May 05 15:42:08.889959 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: May 05 15:42:08.891380 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671a8f9-6b97-4052-9152-a91d0d5f5d71 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:08.907470 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-50d81405-9d0a-4838-a880-0ebc7ee80728 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:08.908674 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-50d81405-9d0a-4838-a880-0ebc7ee80728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:08.912209 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 773/1550] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:08 2022] POST /identity/v3/users => generated 296 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:08.913464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7756788-89cb-43b3-8efd-d2be72e47b12 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.913776 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7756788-89cb-43b3-8efd-d2be72e47b12 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.914054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7756788-89cb-43b3-8efd-d2be72e47b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.921205 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 778/1551] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:08.922725 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32464522-d41c-4f05-98dc-ffae437e8699 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.923007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32464522-d41c-4f05-98dc-ffae437e8699 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.923382 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32464522-d41c-4f05-98dc-ffae437e8699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.934883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f7756788-89cb-43b3-8efd-d2be72e47b12 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:08.936091 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f7756788-89cb-43b3-8efd-d2be72e47b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:08.941791 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-32464522-d41c-4f05-98dc-ffae437e8699 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:08.942962 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-32464522-d41c-4f05-98dc-ffae437e8699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:08.944077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 774/1552] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:08.945483 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3b4f-c77c-42f1-81e8-74e9e80b0f92 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.945717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3b4f-c77c-42f1-81e8-74e9e80b0f92 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.945995 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3b4f-c77c-42f1-81e8-74e9e80b0f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.951486 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 779/1553] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:08.955062 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32464522-d41c-4f05-98dc-ffae437e8699 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:08.964803 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-901d3b4f-c77c-42f1-81e8-74e9e80b0f92 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:08.966029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32464522-d41c-4f05-98dc-ffae437e8699 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:08.966196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-901d3b4f-c77c-42f1-81e8-74e9e80b0f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:08.970931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b80ab-ff3b-4e00-b543-8d33026855b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:08.971584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b80ab-ff3b-4e00-b543-8d33026855b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.971864 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b80ab-ff3b-4e00-b543-8d33026855b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.972140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b80ab-ff3b-4e00-b543-8d33026855b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.972828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b80ab-ff3b-4e00-b543-8d33026855b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:08.974065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 775/1554] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:08.974815 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b80ab-ff3b-4e00-b543-8d33026855b5 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:08.975383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96593228-1d93-4a7e-9f6b-970224155da4 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:08.975674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96593228-1d93-4a7e-9f6b-970224155da4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:08.975955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96593228-1d93-4a7e-9f6b-970224155da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:08.997374 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-96593228-1d93-4a7e-9f6b-970224155da4 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:08.998623 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-96593228-1d93-4a7e-9f6b-970224155da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:09.004973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 780/1555] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:08 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:09.004973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf3993-947e-4274-8c0f-43042b612c41 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.004973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf3993-947e-4274-8c0f-43042b612c41 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.004973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf3993-947e-4274-8c0f-43042b612c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.022128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-0faf3993-947e-4274-8c0f-43042b612c41 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:09.023836 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-0faf3993-947e-4274-8c0f-43042b612c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:09.062764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 776/1556] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:09.063615 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96593228-1d93-4a7e-9f6b-970224155da4 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.072299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96593228-1d93-4a7e-9f6b-970224155da4 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.076816 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101277f-f3cd-4c1e-aae7-68e4e7c8ea3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.077462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101277f-f3cd-4c1e-aae7-68e4e7c8ea3f admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.077741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101277f-f3cd-4c1e-aae7-68e4e7c8ea3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.078013 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101277f-f3cd-4c1e-aae7-68e4e7c8ea3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.078755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101277f-f3cd-4c1e-aae7-68e4e7c8ea3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.080336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101277f-f3cd-4c1e-aae7-68e4e7c8ea3f admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.090446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 777/1557] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:09.091625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7ab27-0fec-4670-a104-442915a8367f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.091917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7ab27-0fec-4670-a104-442915a8367f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.092188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7ab27-0fec-4670-a104-442915a8367f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.093346 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 781/1558] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:09.095648 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf3993-947e-4274-8c0f-43042b612c41 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.105405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf3993-947e-4274-8c0f-43042b612c41 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.110040 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c1c3d-1611-42ab-9d0c-46109a55c0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.110213 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-36e7ab27-0fec-4670-a104-442915a8367f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:09.110718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c1c3d-1611-42ab-9d0c-46109a55c0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.110996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c1c3d-1611-42ab-9d0c-46109a55c0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.111264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c1c3d-1611-42ab-9d0c-46109a55c0ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.111367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-36e7ab27-0fec-4670-a104-442915a8367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:09.111976 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c1c3d-1611-42ab-9d0c-46109a55c0ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:09.112276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c1c3d-1611-42ab-9d0c-46109a55c0ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.113849 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c1c3d-1611-42ab-9d0c-46109a55c0ee admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.119451 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 778/1559] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:09.120666 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f3b03-0eb5-40f9-95d5-eac801968529 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.120938 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f3b03-0eb5-40f9-95d5-eac801968529 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.121648 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f3b03-0eb5-40f9-95d5-eac801968529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.134013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 782/1560] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:09.134013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907ff74-d596-4d8f-9e79-780c34f68eb3 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.134013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907ff74-d596-4d8f-9e79-780c34f68eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.134013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907ff74-d596-4d8f-9e79-780c34f68eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.139790 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-226f3b03-0eb5-40f9-95d5-eac801968529 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:09.140989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-226f3b03-0eb5-40f9-95d5-eac801968529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:09.149455 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 779/1561] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:09.150271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f3b03-0eb5-40f9-95d5-eac801968529 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.151045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-d907ff74-d596-4d8f-9e79-780c34f68eb3 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:09.152214 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d907ff74-d596-4d8f-9e79-780c34f68eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:09.163412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 783/1562] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:09.163412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907ff74-d596-4d8f-9e79-780c34f68eb3 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.164167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f3b03-0eb5-40f9-95d5-eac801968529 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.167594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600310d0-bccd-4213-8b6e-a74dda28fb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.168363 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600310d0-bccd-4213-8b6e-a74dda28fb06 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.168648 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600310d0-bccd-4213-8b6e-a74dda28fb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.168921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600310d0-bccd-4213-8b6e-a74dda28fb06 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.169601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600310d0-bccd-4213-8b6e-a74dda28fb06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.170153 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907ff74-d596-4d8f-9e79-780c34f68eb3 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.171542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600310d0-bccd-4213-8b6e-a74dda28fb06 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.174574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a7f71-40ff-44d5-9675-a909f317c22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.175209 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a7f71-40ff-44d5-9675-a909f317c22d admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.175476 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a7f71-40ff-44d5-9675-a909f317c22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.175775 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a7f71-40ff-44d5-9675-a909f317c22d admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.176473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a7f71-40ff-44d5-9675-a909f317c22d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:09.176772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a7f71-40ff-44d5-9675-a909f317c22d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.178361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a7f71-40ff-44d5-9675-a909f317c22d admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.190650 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 784/1563] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:09.194521 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a7f71-40ff-44d5-9675-a909f317c22d admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.194665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 780/1564] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:09.194665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600310d0-bccd-4213-8b6e-a74dda28fb06 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.202923 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600310d0-bccd-4213-8b6e-a74dda28fb06 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.204424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a7f71-40ff-44d5-9675-a909f317c22d admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.207567 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec505f9-fa20-4ae7-bf7a-d09f4280356a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.208296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec505f9-fa20-4ae7-bf7a-d09f4280356a admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.208580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec505f9-fa20-4ae7-bf7a-d09f4280356a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.208854 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec505f9-fa20-4ae7-bf7a-d09f4280356a admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.209034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde473e-1870-4748-8cc1-6d2a494f4779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.209569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec505f9-fa20-4ae7-bf7a-d09f4280356a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:09.209683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde473e-1870-4748-8cc1-6d2a494f4779 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.209901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec505f9-fa20-4ae7-bf7a-d09f4280356a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.210012 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde473e-1870-4748-8cc1-6d2a494f4779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.210244 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde473e-1870-4748-8cc1-6d2a494f4779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.211057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde473e-1870-4748-8cc1-6d2a494f4779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.211238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: WARNING py.warnings [None req-8ec505f9-fa20-4ae7-bf7a-d09f4280356a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 15:42:09.211238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: warnings.warn(msg) May 05 15:42:09.211238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: May 05 15:42:09.212146 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec505f9-fa20-4ae7-bf7a-d09f4280356a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.212875 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde473e-1870-4748-8cc1-6d2a494f4779 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.223341 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 785/1565] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:09.224323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 781/1566] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:09.225749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde473e-1870-4748-8cc1-6d2a494f4779 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.225886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec505f9-fa20-4ae7-bf7a-d09f4280356a admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.235639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec505f9-fa20-4ae7-bf7a-d09f4280356a admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.237836 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde473e-1870-4748-8cc1-6d2a494f4779 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.240319 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661596b4-1bad-4ccd-873f-03bc0e39f6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.240972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661596b4-1bad-4ccd-873f-03bc0e39f6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.241254 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661596b4-1bad-4ccd-873f-03bc0e39f6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.241531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661596b4-1bad-4ccd-873f-03bc0e39f6d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.242316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661596b4-1bad-4ccd-873f-03bc0e39f6d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.242980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd95744-9599-4384-9656-beef3a354874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.243637 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd95744-9599-4384-9656-beef3a354874 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.243926 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd95744-9599-4384-9656-beef3a354874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.244209 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661596b4-1bad-4ccd-873f-03bc0e39f6d4 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.244323 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd95744-9599-4384-9656-beef3a354874 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.244956 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd95744-9599-4384-9656-beef3a354874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:09.245263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd95744-9599-4384-9656-beef3a354874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.246927 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd95744-9599-4384-9656-beef3a354874 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.260511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 786/1567] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:09.261221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd95744-9599-4384-9656-beef3a354874 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.272672 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd95744-9599-4384-9656-beef3a354874 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.279371 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 782/1568] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:09.279371 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661596b4-1bad-4ccd-873f-03bc0e39f6d4 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.335057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb61d1d-1ec5-454a-a448-f393ad2c6170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.336538 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb61d1d-1ec5-454a-a448-f393ad2c6170 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.336908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb61d1d-1ec5-454a-a448-f393ad2c6170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.337248 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb61d1d-1ec5-454a-a448-f393ad2c6170 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.338039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb61d1d-1ec5-454a-a448-f393ad2c6170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:09.338386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb61d1d-1ec5-454a-a448-f393ad2c6170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.340012 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb61d1d-1ec5-454a-a448-f393ad2c6170 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.343070 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661596b4-1bad-4ccd-873f-03bc0e39f6d4 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.347810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f00825-d726-4c94-813f-131d17a389a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.348462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f00825-d726-4c94-813f-131d17a389a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.348752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f00825-d726-4c94-813f-131d17a389a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.349015 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f00825-d726-4c94-813f-131d17a389a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.349724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f00825-d726-4c94-813f-131d17a389a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:09.350027 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f00825-d726-4c94-813f-131d17a389a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.351694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f00825-d726-4c94-813f-131d17a389a8 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.354242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 787/1569] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:09.354242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb61d1d-1ec5-454a-a448-f393ad2c6170 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.364259 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb61d1d-1ec5-454a-a448-f393ad2c6170 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.366923 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 783/1570] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:09.367731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f00825-d726-4c94-813f-131d17a389a8 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.375115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1dcc8-b5c8-4c91-a10b-f8b26eb51f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.375771 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1dcc8-b5c8-4c91-a10b-f8b26eb51f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.376049 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1dcc8-b5c8-4c91-a10b-f8b26eb51f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.376318 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1dcc8-b5c8-4c91-a10b-f8b26eb51f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.377029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1dcc8-b5c8-4c91-a10b-f8b26eb51f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.377366 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f00825-d726-4c94-813f-131d17a389a8 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.378641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1dcc8-b5c8-4c91-a10b-f8b26eb51f0a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.381893 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d68e09-7557-4ed9-be63-6913dd2ea0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.383114 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d68e09-7557-4ed9-be63-6913dd2ea0be admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.383400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d68e09-7557-4ed9-be63-6913dd2ea0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.383669 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d68e09-7557-4ed9-be63-6913dd2ea0be admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.384339 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d68e09-7557-4ed9-be63-6913dd2ea0be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.386361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d68e09-7557-4ed9-be63-6913dd2ea0be admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.389942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 788/1571] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:09.390577 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1dcc8-b5c8-4c91-a10b-f8b26eb51f0a admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.400471 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1dcc8-b5c8-4c91-a10b-f8b26eb51f0a admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.405000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb20b33-d427-4635-8ea5-667ec629e8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.406090 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20b33-d427-4635-8ea5-667ec629e8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.406521 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20b33-d427-4635-8ea5-667ec629e8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.406836 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20b33-d427-4635-8ea5-667ec629e8aa admin admin] PATH_INFO: `/v3/projects/39d949f289df486faadefe44a5063929/users/e2e0f15742ea49bba055538ae4e99303/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.416031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 784/1572] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:09.416973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d68e09-7557-4ed9-be63-6913dd2ea0be admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.424854 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb20b33-d427-4635-8ea5-667ec629e8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d949f289df486faadefe44a5063929, user_id=e2e0f15742ea49bba055538ae4e99303, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.425874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: WARNING py.warnings [None req-ccb20b33-d427-4635-8ea5-667ec629e8aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:42:09.425874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: warnings.warn(msg) May 05 15:42:09.425874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: May 05 15:42:09.427893 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb20b33-d427-4635-8ea5-667ec629e8aa admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.440042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 789/1573] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:09 2022] PUT /identity/v3/projects/39d949f289df486faadefe44a5063929/users/e2e0f15742ea49bba055538ae4e99303/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:09.440800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb20b33-d427-4635-8ea5-667ec629e8aa admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.480189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d68e09-7557-4ed9-be63-6913dd2ea0be admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.508098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb20b33-d427-4635-8ea5-667ec629e8aa admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.513582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a560d-4db9-4736-87be-82d636ade2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.514275 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a560d-4db9-4736-87be-82d636ade2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.514592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a560d-4db9-4736-87be-82d636ade2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.514870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a560d-4db9-4736-87be-82d636ade2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.515574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a560d-4db9-4736-87be-82d636ade2f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.517505 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a560d-4db9-4736-87be-82d636ade2f2 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.538754 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de207cb-2788-4d34-84d9-7b90894d4fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.539761 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de207cb-2788-4d34-84d9-7b90894d4fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.540020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de207cb-2788-4d34-84d9-7b90894d4fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.540406 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de207cb-2788-4d34-84d9-7b90894d4fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.541118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de207cb-2788-4d34-84d9-7b90894d4fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.543074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de207cb-2788-4d34-84d9-7b90894d4fa6 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.543993 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 790/1574] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:09.544782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a560d-4db9-4736-87be-82d636ade2f2 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.569321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 785/1575] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:09.571087 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de207cb-2788-4d34-84d9-7b90894d4fa6 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.608722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a560d-4db9-4736-87be-82d636ade2f2 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.629298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de207cb-2788-4d34-84d9-7b90894d4fa6 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.634882 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5261a-ebf1-45e6-beeb-179dc117b91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.635574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5261a-ebf1-45e6-beeb-179dc117b91e admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.635854 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5261a-ebf1-45e6-beeb-179dc117b91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.636128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5261a-ebf1-45e6-beeb-179dc117b91e admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.636815 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5261a-ebf1-45e6-beeb-179dc117b91e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.638794 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5261a-ebf1-45e6-beeb-179dc117b91e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.664234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76769a-fe01-4da5-a4fe-1b7fc4c9d724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.668013 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 786/1576] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:09.668137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76769a-fe01-4da5-a4fe-1b7fc4c9d724 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.668137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76769a-fe01-4da5-a4fe-1b7fc4c9d724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.668321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5261a-ebf1-45e6-beeb-179dc117b91e admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.668419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76769a-fe01-4da5-a4fe-1b7fc4c9d724 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.668419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76769a-fe01-4da5-a4fe-1b7fc4c9d724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.668419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76769a-fe01-4da5-a4fe-1b7fc4c9d724 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.687865 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 791/1577] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/users => generated 303 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:09.688786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76769a-fe01-4da5-a4fe-1b7fc4c9d724 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.699242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76769a-fe01-4da5-a4fe-1b7fc4c9d724 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.727830 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5261a-ebf1-45e6-beeb-179dc117b91e admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.738921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579813a-e4b2-44b3-aa9c-e39ff3ff9b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.739587 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579813a-e4b2-44b3-aa9c-e39ff3ff9b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.739874 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579813a-e4b2-44b3-aa9c-e39ff3ff9b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.740150 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579813a-e4b2-44b3-aa9c-e39ff3ff9b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.740842 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579813a-e4b2-44b3-aa9c-e39ff3ff9b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.743441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579813a-e4b2-44b3-aa9c-e39ff3ff9b61 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.754083 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983467e-1d3e-46d1-a0c1-9edfc2c647de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.754797 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983467e-1d3e-46d1-a0c1-9edfc2c647de admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.755076 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983467e-1d3e-46d1-a0c1-9edfc2c647de admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.755344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983467e-1d3e-46d1-a0c1-9edfc2c647de admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.756054 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983467e-1d3e-46d1-a0c1-9edfc2c647de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.758560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983467e-1d3e-46d1-a0c1-9edfc2c647de admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.769495 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 792/1578] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:09.770044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983467e-1d3e-46d1-a0c1-9edfc2c647de admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.775518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 787/1579] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:09.776761 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a199a3c-b738-467e-ac06-580277801c08 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.777054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a199a3c-b738-467e-ac06-580277801c08 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.777328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a199a3c-b738-467e-ac06-580277801c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.782357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983467e-1d3e-46d1-a0c1-9edfc2c647de admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.795162 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-5a199a3c-b738-467e-ac06-580277801c08 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:09.796469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5a199a3c-b738-467e-ac06-580277801c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:09.836843 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b06689-056e-4881-988a-b9ffb9470425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.837509 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b06689-056e-4881-988a-b9ffb9470425 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.837820 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b06689-056e-4881-988a-b9ffb9470425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.838098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b06689-056e-4881-988a-b9ffb9470425 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.838812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b06689-056e-4881-988a-b9ffb9470425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.840805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b06689-056e-4881-988a-b9ffb9470425 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.854600 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 788/1580] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:09.855430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a199a3c-b738-467e-ac06-580277801c08 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.863540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 793/1581] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:09.867174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b06689-056e-4881-988a-b9ffb9470425 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.867618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a199a3c-b738-467e-ac06-580277801c08 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.872108 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16a007-dc46-4412-8b44-79fb65e85d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.872766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16a007-dc46-4412-8b44-79fb65e85d49 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.873049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16a007-dc46-4412-8b44-79fb65e85d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.873319 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16a007-dc46-4412-8b44-79fb65e85d49 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.874027 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16a007-dc46-4412-8b44-79fb65e85d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.875962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16a007-dc46-4412-8b44-79fb65e85d49 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.876772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b06689-056e-4881-988a-b9ffb9470425 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.881210 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ad711-eb1a-44fc-9ca4-4a260b812964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.881860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ad711-eb1a-44fc-9ca4-4a260b812964 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.882143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ad711-eb1a-44fc-9ca4-4a260b812964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.882935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ad711-eb1a-44fc-9ca4-4a260b812964 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.883610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ad711-eb1a-44fc-9ca4-4a260b812964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.885594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ad711-eb1a-44fc-9ca4-4a260b812964 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.898753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 789/1582] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:09.898753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16a007-dc46-4412-8b44-79fb65e85d49 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.906475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16a007-dc46-4412-8b44-79fb65e85d49 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.907960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 794/1583] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/users => generated 288 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:09.908809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ad711-eb1a-44fc-9ca4-4a260b812964 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.911742 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244139b-8db7-4ce4-ac92-90b3a3bf56ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.912500 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244139b-8db7-4ce4-ac92-90b3a3bf56ca admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.912787 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244139b-8db7-4ce4-ac92-90b3a3bf56ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.913065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244139b-8db7-4ce4-ac92-90b3a3bf56ca admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.914441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244139b-8db7-4ce4-ac92-90b3a3bf56ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.916459 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244139b-8db7-4ce4-ac92-90b3a3bf56ca admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.919274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ad711-eb1a-44fc-9ca4-4a260b812964 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.923924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7a856-3f2f-4160-9481-91a073e20a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.924585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7a856-3f2f-4160-9481-91a073e20a0f admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.924864 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7a856-3f2f-4160-9481-91a073e20a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.925157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7a856-3f2f-4160-9481-91a073e20a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.925931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7a856-3f2f-4160-9481-91a073e20a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.927724 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7a856-3f2f-4160-9481-91a073e20a0f admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.937698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 790/1584] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:09.938693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244139b-8db7-4ce4-ac92-90b3a3bf56ca admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.942258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 795/1585] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:09.942258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7a856-3f2f-4160-9481-91a073e20a0f admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.948545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244139b-8db7-4ce4-ac92-90b3a3bf56ca admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.950303 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7a856-3f2f-4160-9481-91a073e20a0f admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:09.953301 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea992d-bb07-422c-99fa-26efd8c2da04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.954201 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea992d-bb07-422c-99fa-26efd8c2da04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.954484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea992d-bb07-422c-99fa-26efd8c2da04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.954762 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea992d-bb07-422c-99fa-26efd8c2da04 admin admin] PATH_INFO: `/v3/projects/fc23d2719647485fa73eb4cc29134b0d/users/b1d30649f0904dbe841c23d8e091531e/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.954901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27842cb3-28db-4ae0-bdb9-a34185d9bb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:09.955523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27842cb3-28db-4ae0-bdb9-a34185d9bb33 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:09.955802 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27842cb3-28db-4ae0-bdb9-a34185d9bb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:09.956072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27842cb3-28db-4ae0-bdb9-a34185d9bb33 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:09.956910 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27842cb3-28db-4ae0-bdb9-a34185d9bb33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.959769 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27842cb3-28db-4ae0-bdb9-a34185d9bb33 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.971783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea992d-bb07-422c-99fa-26efd8c2da04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc23d2719647485fa73eb4cc29134b0d, user_id=b1d30649f0904dbe841c23d8e091531e, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:09.974843 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea992d-bb07-422c-99fa-26efd8c2da04 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:09.982841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 796/1586] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:09 2022] POST /identity/v3/users => generated 286 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:09.983761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27842cb3-28db-4ae0-bdb9-a34185d9bb33 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:09.987324 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-27842cb3-28db-4ae0-bdb9-a34185d9bb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:09.989687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 791/1587] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:09 2022] PUT /identity/v3/projects/fc23d2719647485fa73eb4cc29134b0d/users/b1d30649f0904dbe841c23d8e091531e/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:09.990531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea992d-bb07-422c-99fa-26efd8c2da04 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.046824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27842cb3-28db-4ae0-bdb9-a34185d9bb33 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.051894 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea992d-bb07-422c-99fa-26efd8c2da04 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.057274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819ee51-1df7-4385-8989-13363cb4412d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.057948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819ee51-1df7-4385-8989-13363cb4412d admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.058261 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819ee51-1df7-4385-8989-13363cb4412d admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.058554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819ee51-1df7-4385-8989-13363cb4412d admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.059267 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819ee51-1df7-4385-8989-13363cb4412d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.060849 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819ee51-1df7-4385-8989-13363cb4412d admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.071265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 792/1588] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:10.072140 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819ee51-1df7-4385-8989-13363cb4412d admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.083030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819ee51-1df7-4385-8989-13363cb4412d admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.088075 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02498108-cffa-4f87-a0c6-d8c2aa25e352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.088767 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02498108-cffa-4f87-a0c6-d8c2aa25e352 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.089052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02498108-cffa-4f87-a0c6-d8c2aa25e352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.089327 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02498108-cffa-4f87-a0c6-d8c2aa25e352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.090043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02498108-cffa-4f87-a0c6-d8c2aa25e352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.091759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02498108-cffa-4f87-a0c6-d8c2aa25e352 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.095438 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe404ce4-bbd7-4674-9af4-dde44ff25e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.096068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404ce4-bbd7-4674-9af4-dde44ff25e7b service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.096353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404ce4-bbd7-4674-9af4-dde44ff25e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.096631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404ce4-bbd7-4674-9af4-dde44ff25e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.102901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 793/1589] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:10.103797 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02498108-cffa-4f87-a0c6-d8c2aa25e352 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.106681 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe404ce4-bbd7-4674-9af4-dde44ff25e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.108148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe404ce4-bbd7-4674-9af4-dde44ff25e7b service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.114705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02498108-cffa-4f87-a0c6-d8c2aa25e352 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.118076 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 797/1590] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:10.118952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe404ce4-bbd7-4674-9af4-dde44ff25e7b service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.120039 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c7b92-f7bf-4a42-bdea-f9d67315a756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.120686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c7b92-f7bf-4a42-bdea-f9d67315a756 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.120967 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c7b92-f7bf-4a42-bdea-f9d67315a756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.121238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c7b92-f7bf-4a42-bdea-f9d67315a756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.121941 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c7b92-f7bf-4a42-bdea-f9d67315a756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.123549 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c7b92-f7bf-4a42-bdea-f9d67315a756 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.128182 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe404ce4-bbd7-4674-9af4-dde44ff25e7b service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.133323 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db11bf-6c3c-4560-badc-57affab19ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.133986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db11bf-6c3c-4560-badc-57affab19ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.134324 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db11bf-6c3c-4560-badc-57affab19ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.134603 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db11bf-6c3c-4560-badc-57affab19ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.135508 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 794/1591] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:10.136241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c7b92-f7bf-4a42-bdea-f9d67315a756 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.138524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db11bf-6c3c-4560-badc-57affab19ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.140274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db11bf-6c3c-4560-badc-57affab19ca8 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.146480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c7b92-f7bf-4a42-bdea-f9d67315a756 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.151098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 798/1592] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:10.151802 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2597f0-4c15-4eaf-bea2-fa9550ba32ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.152505 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2597f0-4c15-4eaf-bea2-fa9550ba32ee admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.152788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2597f0-4c15-4eaf-bea2-fa9550ba32ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.153076 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2597f0-4c15-4eaf-bea2-fa9550ba32ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.153774 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2597f0-4c15-4eaf-bea2-fa9550ba32ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.154905 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db11bf-6c3c-4560-badc-57affab19ca8 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.155402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2597f0-4c15-4eaf-bea2-fa9550ba32ee admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.165224 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db11bf-6c3c-4560-badc-57affab19ca8 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.166374 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 795/1593] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:10.167723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b49ac-ad1e-4d26-9bc9-57be55a7572f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.168308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b49ac-ad1e-4d26-9bc9-57be55a7572f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.168308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b49ac-ad1e-4d26-9bc9-57be55a7572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.172821 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843053a-df2d-4942-ab41-32feb797b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.173479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843053a-df2d-4942-ab41-32feb797b02f admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.173841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843053a-df2d-4942-ab41-32feb797b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.174083 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843053a-df2d-4942-ab41-32feb797b02f admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.175345 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843053a-df2d-4942-ab41-32feb797b02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.176347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843053a-df2d-4942-ab41-32feb797b02f admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.186705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e42b49ac-ad1e-4d26-9bc9-57be55a7572f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:10.187335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 799/1594] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:10.188244 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843053a-df2d-4942-ab41-32feb797b02f admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.190924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e42b49ac-ad1e-4d26-9bc9-57be55a7572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:10.199132 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843053a-df2d-4942-ab41-32feb797b02f admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.201885 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 796/1595] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:10.202746 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b49ac-ad1e-4d26-9bc9-57be55a7572f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.207477 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5e802-af0f-4873-9be9-d81ca09f60b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.208441 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5e802-af0f-4873-9be9-d81ca09f60b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.208918 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5e802-af0f-4873-9be9-d81ca09f60b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.209415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5e802-af0f-4873-9be9-d81ca09f60b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.210365 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5e802-af0f-4873-9be9-d81ca09f60b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.212593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5e802-af0f-4873-9be9-d81ca09f60b6 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.212823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b49ac-ad1e-4d26-9bc9-57be55a7572f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.219441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91bbfa-a16e-4979-87d1-8b383213a2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.220115 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91bbfa-a16e-4979-87d1-8b383213a2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.220401 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91bbfa-a16e-4979-87d1-8b383213a2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.220696 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91bbfa-a16e-4979-87d1-8b383213a2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.221466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91bbfa-a16e-4979-87d1-8b383213a2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.223182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91bbfa-a16e-4979-87d1-8b383213a2c1 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.223889 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 800/1596] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:10.224796 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5e802-af0f-4873-9be9-d81ca09f60b6 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.234851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 797/1597] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:10.235685 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91bbfa-a16e-4979-87d1-8b383213a2c1 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.241277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5e802-af0f-4873-9be9-d81ca09f60b6 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.245734 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91bbfa-a16e-4979-87d1-8b383213a2c1 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.247340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841866e-6941-4823-94ae-e049ef1ca2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.248078 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841866e-6941-4823-94ae-e049ef1ca2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.248425 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841866e-6941-4823-94ae-e049ef1ca2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.248774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841866e-6941-4823-94ae-e049ef1ca2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.249564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841866e-6941-4823-94ae-e049ef1ca2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.250954 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac7174-582c-4e4f-8663-304cd307ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.251367 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841866e-6941-4823-94ae-e049ef1ca2e4 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.251715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac7174-582c-4e4f-8663-304cd307ea23 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.252006 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac7174-582c-4e4f-8663-304cd307ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.252282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac7174-582c-4e4f-8663-304cd307ea23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.253117 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac7174-582c-4e4f-8663-304cd307ea23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.254741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac7174-582c-4e4f-8663-304cd307ea23 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.262726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 801/1598] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:10.263449 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841866e-6941-4823-94ae-e049ef1ca2e4 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.271483 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 798/1599] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:10.273510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac7174-582c-4e4f-8663-304cd307ea23 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.277406 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841866e-6941-4823-94ae-e049ef1ca2e4 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.282965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b39d9-54cf-44d7-bba7-f14910616fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.284318 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b39d9-54cf-44d7-bba7-f14910616fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.284318 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b39d9-54cf-44d7-bba7-f14910616fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.284509 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b39d9-54cf-44d7-bba7-f14910616fc1 admin admin] PATH_INFO: `/v3/projects/4ffb34c08c1a4c9d8369078b134c86cf/users/2b818418d59b40a0b6e4b229b7193dd8/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.293910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac7174-582c-4e4f-8663-304cd307ea23 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.301581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af803ffe-3825-41c2-925a-0de6df9914fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.302304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af803ffe-3825-41c2-925a-0de6df9914fb admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.302590 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af803ffe-3825-41c2-925a-0de6df9914fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.302862 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af803ffe-3825-41c2-925a-0de6df9914fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.303211 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b39d9-54cf-44d7-bba7-f14910616fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffb34c08c1a4c9d8369078b134c86cf, user_id=2b818418d59b40a0b6e4b229b7193dd8, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.303582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af803ffe-3825-41c2-925a-0de6df9914fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.305222 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af803ffe-3825-41c2-925a-0de6df9914fb admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.307153 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b39d9-54cf-44d7-bba7-f14910616fc1 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.319074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 799/1600] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:10.319890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af803ffe-3825-41c2-925a-0de6df9914fb admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.327414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 802/1601] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:10 2022] PUT /identity/v3/projects/4ffb34c08c1a4c9d8369078b134c86cf/users/2b818418d59b40a0b6e4b229b7193dd8/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:10.327858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b39d9-54cf-44d7-bba7-f14910616fc1 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.341428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af803ffe-3825-41c2-925a-0de6df9914fb admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.401421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9141c39-674d-4a4f-808f-384214e448ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.402087 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9141c39-674d-4a4f-808f-384214e448ee service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.402405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9141c39-674d-4a4f-808f-384214e448ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.402680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9141c39-674d-4a4f-808f-384214e448ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.409150 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b39d9-54cf-44d7-bba7-f14910616fc1 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.412428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9141c39-674d-4a4f-808f-384214e448ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.414435 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9141c39-674d-4a4f-808f-384214e448ee service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.414800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ba7ae-b160-4e25-b763-cd49f4af2eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.415862 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ba7ae-b160-4e25-b763-cd49f4af2eca admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.415999 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ba7ae-b160-4e25-b763-cd49f4af2eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.416218 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ba7ae-b160-4e25-b763-cd49f4af2eca admin admin] PATH_INFO: `/v3/projects/11c3095cbbb147aeba1bb605cd0592f9/users/d5e3418592d44074845a1c979e11ef19/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.425418 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 800/1602] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:10.426418 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9141c39-674d-4a4f-808f-384214e448ee service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.431909 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ba7ae-b160-4e25-b763-cd49f4af2eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c3095cbbb147aeba1bb605cd0592f9, user_id=d5e3418592d44074845a1c979e11ef19, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.434830 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ba7ae-b160-4e25-b763-cd49f4af2eca admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.436541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9141c39-674d-4a4f-808f-384214e448ee service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.442071 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6babd30-3c25-44df-919f-2019eb365fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.443605 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6babd30-3c25-44df-919f-2019eb365fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.443605 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6babd30-3c25-44df-919f-2019eb365fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.443874 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6babd30-3c25-44df-919f-2019eb365fbf admin admin] PATH_INFO: `/v3/projects/bd7f78fcf0be461796d2a86956cf3b9d/users/1b9eeed01d41446986dbf37c15ee4e2e/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.460115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 803/1603] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:10 2022] PUT /identity/v3/projects/11c3095cbbb147aeba1bb605cd0592f9/users/d5e3418592d44074845a1c979e11ef19/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:10.460115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ba7ae-b160-4e25-b763-cd49f4af2eca admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.462863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6babd30-3c25-44df-919f-2019eb365fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7f78fcf0be461796d2a86956cf3b9d, user_id=1b9eeed01d41446986dbf37c15ee4e2e, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.466121 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6babd30-3c25-44df-919f-2019eb365fbf admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.489890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 801/1604] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:10 2022] PUT /identity/v3/projects/bd7f78fcf0be461796d2a86956cf3b9d/users/1b9eeed01d41446986dbf37c15ee4e2e/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:10.490932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6babd30-3c25-44df-919f-2019eb365fbf admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.541711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ba7ae-b160-4e25-b763-cd49f4af2eca admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.614477 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc37a0-c67f-4920-81d2-94aedce590ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.615592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc37a0-c67f-4920-81d2-94aedce590ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.616024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc37a0-c67f-4920-81d2-94aedce590ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.616312 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc37a0-c67f-4920-81d2-94aedce590ea admin admin] PATH_INFO: `/v3/projects/e77416665b5e41599332558236071050/users/5407b61ec38b4088b61cade06ab26b79/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.643960 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6babd30-3c25-44df-919f-2019eb365fbf admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.648908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc37a0-c67f-4920-81d2-94aedce590ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77416665b5e41599332558236071050, user_id=5407b61ec38b4088b61cade06ab26b79, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.651679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc37a0-c67f-4920-81d2-94aedce590ea admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.658528 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019721ed-d0d9-49e5-90f1-1fb1089e8e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.659965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019721ed-d0d9-49e5-90f1-1fb1089e8e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.659965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019721ed-d0d9-49e5-90f1-1fb1089e8e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.660264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019721ed-d0d9-49e5-90f1-1fb1089e8e2e admin admin] PATH_INFO: `/v3/projects/255aeae1543e48d69e2ff14c21350d97/users/050b1d9a97824d9dbb68f84dad0e2b8a/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.680749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019721ed-d0d9-49e5-90f1-1fb1089e8e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=255aeae1543e48d69e2ff14c21350d97, user_id=050b1d9a97824d9dbb68f84dad0e2b8a, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.684093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019721ed-d0d9-49e5-90f1-1fb1089e8e2e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.688201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 804/1605] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:10 2022] PUT /identity/v3/projects/e77416665b5e41599332558236071050/users/5407b61ec38b4088b61cade06ab26b79/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:10.689705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc37a0-c67f-4920-81d2-94aedce590ea admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:10.706480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 802/1606] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:10 2022] PUT /identity/v3/projects/255aeae1543e48d69e2ff14c21350d97/users/050b1d9a97824d9dbb68f84dad0e2b8a/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:10.708253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87f477-57a8-410b-bc43-cc564c312192 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.708750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87f477-57a8-410b-bc43-cc564c312192 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.709212 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87f477-57a8-410b-bc43-cc564c312192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.746680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-2c87f477-57a8-410b-bc43-cc564c312192 None None] MFA Rules not processed for user `2b818418d59b40a0b6e4b229b7193dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:10.747322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-2c87f477-57a8-410b-bc43-cc564c312192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:10.785421 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc37a0-c67f-4920-81d2-94aedce590ea admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:10.853871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 803/1607] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:10.853871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d997ddf-7cb4-4a65-8c41-fd9ba8c040cc None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.853871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d997ddf-7cb4-4a65-8c41-fd9ba8c040cc None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.853871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d997ddf-7cb4-4a65-8c41-fd9ba8c040cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.879489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40729124-f551-453d-885b-70b99201c217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:10.881027 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40729124-f551-453d-885b-70b99201c217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.881599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40729124-f551-453d-885b-70b99201c217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.882086 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40729124-f551-453d-885b-70b99201c217 admin admin] PATH_INFO: `/v3/projects/1e09377ba87c4474a73b1fe379f1032c/users/66c473f36f864dbab9433e71c5ca5475/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.891151 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-6d997ddf-7cb4-4a65-8c41-fd9ba8c040cc None None] MFA Rules not processed for user `d5e3418592d44074845a1c979e11ef19`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:10.892400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6d997ddf-7cb4-4a65-8c41-fd9ba8c040cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:10.907580 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40729124-f551-453d-885b-70b99201c217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e09377ba87c4474a73b1fe379f1032c, user_id=66c473f36f864dbab9433e71c5ca5475, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:10.912007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40729124-f551-453d-885b-70b99201c217 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:10.934579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 805/1608] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:10 2022] PUT /identity/v3/projects/1e09377ba87c4474a73b1fe379f1032c/users/66c473f36f864dbab9433e71c5ca5475/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:10.936294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31127ec4-b2e5-45cd-8ed7-aca552c33cce None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:10.936818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31127ec4-b2e5-45cd-8ed7-aca552c33cce None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:10.937590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31127ec4-b2e5-45cd-8ed7-aca552c33cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:10.964124 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-31127ec4-b2e5-45cd-8ed7-aca552c33cce None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:10.964576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-31127ec4-b2e5-45cd-8ed7-aca552c33cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:11.005438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 804/1609] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:10 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:11.008159 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471b6ac-6544-481e-a3f9-a28196a01b96 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:11.008516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471b6ac-6544-481e-a3f9-a28196a01b96 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:11.008800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471b6ac-6544-481e-a3f9-a28196a01b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:11.053764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 806/1610] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:11.058202 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffd4bc-7a4a-4c4d-aefe-67bfa7e07372 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:11.058202 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffd4bc-7a4a-4c4d-aefe-67bfa7e07372 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:11.058202 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffd4bc-7a4a-4c4d-aefe-67bfa7e07372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:11.077835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4471b6ac-6544-481e-a3f9-a28196a01b96 None None] MFA Rules not processed for user `5407b61ec38b4088b61cade06ab26b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:11.079409 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4471b6ac-6544-481e-a3f9-a28196a01b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:11.084990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-faffd4bc-7a4a-4c4d-aefe-67bfa7e07372 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:11.086274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-faffd4bc-7a4a-4c4d-aefe-67bfa7e07372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:11.095174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 807/1611] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:11.095848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffd4bc-7a4a-4c4d-aefe-67bfa7e07372 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:11.107580 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffd4bc-7a4a-4c4d-aefe-67bfa7e07372 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:11.116192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bb2a9-2b50-4d19-8558-17d0170c60d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:11.117353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bb2a9-2b50-4d19-8558-17d0170c60d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:11.117883 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bb2a9-2b50-4d19-8558-17d0170c60d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:11.118655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bb2a9-2b50-4d19-8558-17d0170c60d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:11.119646 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13bb2a9-2b50-4d19-8558-17d0170c60d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:11.121910 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13bb2a9-2b50-4d19-8558-17d0170c60d7 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:11.159472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 808/1612] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:11 2022] POST /identity/v3/projects => generated 403 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:11.160869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdb1f1-765b-4907-9683-d7f944d8d4b8 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:11.161232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdb1f1-765b-4907-9683-d7f944d8d4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:11.161775 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdb1f1-765b-4907-9683-d7f944d8d4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:11.188395 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 805/1613] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:11.188395 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471b6ac-6544-481e-a3f9-a28196a01b96 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:11.195909 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-6ebdb1f1-765b-4907-9683-d7f944d8d4b8 None None] MFA Rules not processed for user `66c473f36f864dbab9433e71c5ca5475`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:11.197124 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6ebdb1f1-765b-4907-9683-d7f944d8d4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:11.260797 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471b6ac-6544-481e-a3f9-a28196a01b96 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:11.308448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 809/1614] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:11.310195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdb1f1-765b-4907-9683-d7f944d8d4b8 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:11.348841 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac17b81-f2b1-4672-94a7-e186f7a6905a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:11.349210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac17b81-f2b1-4672-94a7-e186f7a6905a service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:11.349601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac17b81-f2b1-4672-94a7-e186f7a6905a service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:11.349883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac17b81-f2b1-4672-94a7-e186f7a6905a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:11.423210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac17b81-f2b1-4672-94a7-e186f7a6905a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:11.425981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac17b81-f2b1-4672-94a7-e186f7a6905a service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:11.429976 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdb1f1-765b-4907-9683-d7f944d8d4b8 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:11.438232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85152395-d393-4468-aa41-86d2a8df6dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:11.440591 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85152395-d393-4468-aa41-86d2a8df6dbf service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:11.440591 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85152395-d393-4468-aa41-86d2a8df6dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:11.440851 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85152395-d393-4468-aa41-86d2a8df6dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:11.452333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 806/1615] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:11.455402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac17b81-f2b1-4672-94a7-e186f7a6905a service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:11.475568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac17b81-f2b1-4672-94a7-e186f7a6905a service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:11.484526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef118a79-b055-4dd7-9853-f3f13152c08c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:11.485322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef118a79-b055-4dd7-9853-f3f13152c08c service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:11.485602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef118a79-b055-4dd7-9853-f3f13152c08c service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:11.485880 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef118a79-b055-4dd7-9853-f3f13152c08c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:11.581622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85152395-d393-4468-aa41-86d2a8df6dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:11.583247 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85152395-d393-4468-aa41-86d2a8df6dbf service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:11.589602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef118a79-b055-4dd7-9853-f3f13152c08c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:11.591190 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef118a79-b055-4dd7-9853-f3f13152c08c service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:11.594744 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 810/1616] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:11.595626 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85152395-d393-4468-aa41-86d2a8df6dbf service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:11.603314 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 807/1617] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:11.604746 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c4897-3e3e-4c9f-b4db-918cf26e1518 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:11.605136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c4897-3e3e-4c9f-b4db-918cf26e1518 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:11.605508 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c4897-3e3e-4c9f-b4db-918cf26e1518 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:11.607374 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 808/1618] 10.222.0.58 () {54 vars in 960 bytes} [Thu May 5 15:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:42:11.607650 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85152395-d393-4468-aa41-86d2a8df6dbf service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:11.608813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736daae7-b6c1-49b6-b285-d3830db9f1b2 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:11.609297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736daae7-b6c1-49b6-b285-d3830db9f1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:11.609669 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736daae7-b6c1-49b6-b285-d3830db9f1b2 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:11.611337 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 809/1619] 10.222.0.58 () {54 vars in 960 bytes} [Thu May 5 15:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:42:11.612602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb9a86-b213-41f8-824b-1d228aa1f243 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:11.613163 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb9a86-b213-41f8-824b-1d228aa1f243 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:11.613577 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb9a86-b213-41f8-824b-1d228aa1f243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:11.622831 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d97b3b-906a-45d0-a73c-1a75cd8ccb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:11.623913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d97b3b-906a-45d0-a73c-1a75cd8ccb31 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:11.624337 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d97b3b-906a-45d0-a73c-1a75cd8ccb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:11.624707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d97b3b-906a-45d0-a73c-1a75cd8ccb31 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:11.625664 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d97b3b-906a-45d0-a73c-1a75cd8ccb31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:11.631734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d97b3b-906a-45d0-a73c-1a75cd8ccb31 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:11.672444 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 811/1620] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:11 2022] POST /identity/v3/users => generated 308 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:11.672444 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb39bec-799d-4e3b-bdd8-329febe3a668 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:11.672778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb39bec-799d-4e3b-bdd8-329febe3a668 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:11.676548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb39bec-799d-4e3b-bdd8-329febe3a668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:11.681586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-fecb9a86-b213-41f8-824b-1d228aa1f243 None None] MFA Rules not processed for user `b1d30649f0904dbe841c23d8e091531e`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:11.683505 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-fecb9a86-b213-41f8-824b-1d228aa1f243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:11.723646 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-8cb39bec-799d-4e3b-bdd8-329febe3a668 None None] MFA Rules not processed for user `2a29a4b1b1aa45aea2e466d8f8b79365`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:11.729025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8cb39bec-799d-4e3b-bdd8-329febe3a668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:11.772926 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 810/1621] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:11.775491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf114b-b455-41c0-acb8-627d07dff224 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:11.776052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf114b-b455-41c0-acb8-627d07dff224 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:11.776223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf114b-b455-41c0-acb8-627d07dff224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:11.812465 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-52bf114b-b455-41c0-acb8-627d07dff224 None None] MFA Rules not processed for user `2a29a4b1b1aa45aea2e466d8f8b79365`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:11.814133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-52bf114b-b455-41c0-acb8-627d07dff224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:11.872592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 812/1622] 10.222.0.58 () {58 vars in 1057 bytes} [Thu May 5 15:42:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:11.874373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb39bec-799d-4e3b-bdd8-329febe3a668 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:11.891800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb39bec-799d-4e3b-bdd8-329febe3a668 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:11.899740 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc4e5d-4d37-432d-835d-0e475cf9635b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:11.900820 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc4e5d-4d37-432d-835d-0e475cf9635b admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:11.903982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc4e5d-4d37-432d-835d-0e475cf9635b admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:11.903982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc4e5d-4d37-432d-835d-0e475cf9635b admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:11.905612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc4e5d-4d37-432d-835d-0e475cf9635b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:11.907625 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc4e5d-4d37-432d-835d-0e475cf9635b admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:11.927848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 813/1623] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:11.930827 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b128c7d-92cd-4751-b1be-1129161299a1 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:11.931281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b128c7d-92cd-4751-b1be-1129161299a1 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:11.931899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b128c7d-92cd-4751-b1be-1129161299a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:11.964020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-2b128c7d-92cd-4751-b1be-1129161299a1 None None] MFA Rules not processed for user `b1d30649f0904dbe841c23d8e091531e`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:11.969576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-2b128c7d-92cd-4751-b1be-1129161299a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:11.984775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 811/1624] 10.222.0.58 () {58 vars in 1057 bytes} [Thu May 5 15:42:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:11.997664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf114b-b455-41c0-acb8-627d07dff224 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:11.998620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 814/1625] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:11.999642 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b128c7d-92cd-4751-b1be-1129161299a1 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:12.015222 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b128c7d-92cd-4751-b1be-1129161299a1 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:12.021627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cca45-e020-4e85-817b-cb1fb73e32fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:12.022717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cca45-e020-4e85-817b-cb1fb73e32fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:12.023531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cca45-e020-4e85-817b-cb1fb73e32fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:12.023869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cca45-e020-4e85-817b-cb1fb73e32fa admin admin] PATH_INFO: `/v3/projects/834362453f85461fa0aec77163eb26fc/users/b112ca2610674344bec3bc42b89f8e3c/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:12.031220 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf114b-b455-41c0-acb8-627d07dff224 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:12.044552 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cca45-e020-4e85-817b-cb1fb73e32fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=834362453f85461fa0aec77163eb26fc, user_id=b112ca2610674344bec3bc42b89f8e3c, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:12.048684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cca45-e020-4e85-817b-cb1fb73e32fa admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:12.050906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87368617-e63d-4733-8922-f80ebd5df0fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:12.051748 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87368617-e63d-4733-8922-f80ebd5df0fb service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:12.052528 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87368617-e63d-4733-8922-f80ebd5df0fb service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:12.052959 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87368617-e63d-4733-8922-f80ebd5df0fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:12.073198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 815/1626] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:11 2022] PUT /identity/v3/projects/834362453f85461fa0aec77163eb26fc/users/b112ca2610674344bec3bc42b89f8e3c/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:12.073929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cca45-e020-4e85-817b-cb1fb73e32fa admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:12.192290 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87368617-e63d-4733-8922-f80ebd5df0fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:12.193906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87368617-e63d-4733-8922-f80ebd5df0fb service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:12.222232 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 812/1627] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:12.223701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87368617-e63d-4733-8922-f80ebd5df0fb service nova] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:12.245986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cca45-e020-4e85-817b-cb1fb73e32fa admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:12.259120 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497eed9-acbf-4e87-ae1f-f3496d555089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:12.259789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497eed9-acbf-4e87-ae1f-f3496d555089 service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:12.260077 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497eed9-acbf-4e87-ae1f-f3496d555089 service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:12.260339 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497eed9-acbf-4e87-ae1f-f3496d555089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:12.264901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87368617-e63d-4733-8922-f80ebd5df0fb service nova] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:12.373439 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497eed9-acbf-4e87-ae1f-f3496d555089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:12.375078 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497eed9-acbf-4e87-ae1f-f3496d555089 service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:12.402594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 816/1628] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:12.426272 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a8ca7-67fe-4fda-8279-8f951aafd249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:12.427539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a8ca7-67fe-4fda-8279-8f951aafd249 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:12.428024 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a8ca7-67fe-4fda-8279-8f951aafd249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:12.428577 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a8ca7-67fe-4fda-8279-8f951aafd249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:12.432244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a8ca7-67fe-4fda-8279-8f951aafd249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:12.438063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a8ca7-67fe-4fda-8279-8f951aafd249 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:12.470082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 813/1629] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:12.474085 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497eed9-acbf-4e87-ae1f-f3496d555089 service nova] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:12.497501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497eed9-acbf-4e87-ae1f-f3496d555089 service nova] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:12.517325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736e317-745a-4799-a3ec-2fc8c0270b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:12.518251 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736e317-745a-4799-a3ec-2fc8c0270b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:12.518530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736e317-745a-4799-a3ec-2fc8c0270b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:12.518803 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736e317-745a-4799-a3ec-2fc8c0270b97 admin admin] PATH_INFO: `/v3/projects/834362453f85461fa0aec77163eb26fc/users/b112ca2610674344bec3bc42b89f8e3c/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:12.526333 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736e317-745a-4799-a3ec-2fc8c0270b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=834362453f85461fa0aec77163eb26fc, user_id=b112ca2610674344bec3bc42b89f8e3c, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:12.532044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736e317-745a-4799-a3ec-2fc8c0270b97 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:12.558432 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 817/1630] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:12 2022] PUT /identity/v3/projects/834362453f85461fa0aec77163eb26fc/users/b112ca2610674344bec3bc42b89f8e3c/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:42:12.560188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bdc2b-7593-4778-99c5-70887abb8a72 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:12.560487 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bdc2b-7593-4778-99c5-70887abb8a72 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:12.560768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bdc2b-7593-4778-99c5-70887abb8a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:12.624075 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b45bdc2b-7593-4778-99c5-70887abb8a72 None None] MFA Rules not processed for user `b112ca2610674344bec3bc42b89f8e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:12.627025 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b45bdc2b-7593-4778-99c5-70887abb8a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:12.736166 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736e317-745a-4799-a3ec-2fc8c0270b97 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:12.795070 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 814/1631] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:12 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:12.820051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bdc2b-7593-4778-99c5-70887abb8a72 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:12.969943 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736e317-745a-4799-a3ec-2fc8c0270b97 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:12.990980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a336ef-c665-4246-a912-4cee9e8901a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:12.991769 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a336ef-c665-4246-a912-4cee9e8901a3 service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:12.992055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a336ef-c665-4246-a912-4cee9e8901a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:12.992451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a336ef-c665-4246-a912-4cee9e8901a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:13.020044 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bdc2b-7593-4778-99c5-70887abb8a72 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:13.030354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0566de-60af-4007-9577-3d2f4a0d478e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:13.032034 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0566de-60af-4007-9577-3d2f4a0d478e service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:13.032731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0566de-60af-4007-9577-3d2f4a0d478e service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:13.033073 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0566de-60af-4007-9577-3d2f4a0d478e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:13.059099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0566de-60af-4007-9577-3d2f4a0d478e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:13.063192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0566de-60af-4007-9577-3d2f4a0d478e service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:13.087195 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 815/1632] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:42:13.091159 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d8874-989d-491e-900a-5c9d1471d213 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:13.091442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d8874-989d-491e-900a-5c9d1471d213 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:13.091776 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d8874-989d-491e-900a-5c9d1471d213 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:13.098093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 816/1633] 10.222.0.58 () {54 vars in 912 bytes} [Thu May 5 15:42:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:42:13.105550 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b3120-c1ed-4b78-91f1-483ab018fe6a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:13.105851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b3120-c1ed-4b78-91f1-483ab018fe6a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:13.106132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b3120-c1ed-4b78-91f1-483ab018fe6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:13.186599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-6c9b3120-c1ed-4b78-91f1-483ab018fe6a None None] MFA Rules not processed for user `2a29a4b1b1aa45aea2e466d8f8b79365`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:13.188318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6c9b3120-c1ed-4b78-91f1-483ab018fe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:13.209881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 817/1634] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 5 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:13.223599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b3120-c1ed-4b78-91f1-483ab018fe6a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:13.231183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a336ef-c665-4246-a912-4cee9e8901a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:13.232938 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a336ef-c665-4246-a912-4cee9e8901a3 service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:13.237940 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b3120-c1ed-4b78-91f1-483ab018fe6a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:13.250089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2b230-2876-47e4-9cab-ecd081ab8a42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:13.250867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2b230-2876-47e4-9cab-ecd081ab8a42 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:13.251161 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2b230-2876-47e4-9cab-ecd081ab8a42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:13.251429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2b230-2876-47e4-9cab-ecd081ab8a42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:13.254985 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 818/1635] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:42:13.301297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2b230-2876-47e4-9cab-ecd081ab8a42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:13.308190 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2b230-2876-47e4-9cab-ecd081ab8a42 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:13.362188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 818/1636] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:13.425722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528946a7-14a2-4fd2-b845-d3f5d6e5f57e None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:13.425722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528946a7-14a2-4fd2-b845-d3f5d6e5f57e None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:13.425949 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528946a7-14a2-4fd2-b845-d3f5d6e5f57e None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:13.433032 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 819/1637] 10.222.0.58 () {54 vars in 912 bytes} [Thu May 5 15:42:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:42:13.460832 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ca2e9-6b88-43c1-9c2e-dd137ac9ebe1 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:13.461306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ca2e9-6b88-43c1-9c2e-dd137ac9ebe1 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:13.461982 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ca2e9-6b88-43c1-9c2e-dd137ac9ebe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:13.504038 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-585ca2e9-6b88-43c1-9c2e-dd137ac9ebe1 None None] MFA Rules not processed for user `2a29a4b1b1aa45aea2e466d8f8b79365`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:13.507378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-585ca2e9-6b88-43c1-9c2e-dd137ac9ebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:13.538089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 819/1638] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 5 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:13.539513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528946a7-14a2-4fd2-b845-d3f5d6e5f57e None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:13.541623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-528946a7-14a2-4fd2-b845-d3f5d6e5f57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:13.567884 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ca2e9-6b88-43c1-9c2e-dd137ac9ebe1 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:13.680384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528946a7-14a2-4fd2-b845-d3f5d6e5f57e None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:13.693624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a9cbb-3a1c-46d7-a2b5-785a809ef5e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab6c13dc02ba49d0be523fa9a73fdf5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:13.694051 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a9cbb-3a1c-46d7-a2b5-785a809ef5e8 service glance] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:13.694472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a9cbb-3a1c-46d7-a2b5-785a809ef5e8 service glance] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:13.695873 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a9cbb-3a1c-46d7-a2b5-785a809ef5e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:13.708581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ca2e9-6b88-43c1-9c2e-dd137ac9ebe1 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:13.730758 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfad4ce-e046-40e9-b46c-b35e95db02fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:13.732160 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfad4ce-e046-40e9-b46c-b35e95db02fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:13.733868 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfad4ce-e046-40e9-b46c-b35e95db02fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:13.734285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfad4ce-e046-40e9-b46c-b35e95db02fd admin admin] PATH_INFO: `/v3/users/2b818418d59b40a0b6e4b229b7193dd8` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:13.736055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a9cbb-3a1c-46d7-a2b5-785a809ef5e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:13.738836 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfad4ce-e046-40e9-b46c-b35e95db02fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b818418d59b40a0b6e4b229b7193dd8)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:13.739870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a9cbb-3a1c-46d7-a2b5-785a809ef5e8 service glance] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:13.742414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfad4ce-e046-40e9-b46c-b35e95db02fd admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:13.779349 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 820/1639] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:13.831723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7cfad4ce-e046-40e9-b46c-b35e95db02fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b818418d59b40a0b6e4b229b7193dd8'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:13.843033 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7cfad4ce-e046-40e9-b46c-b35e95db02fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b818418d59b40a0b6e4b229b7193dd8'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:13.843703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7cfad4ce-e046-40e9-b46c-b35e95db02fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b818418d59b40a0b6e4b229b7193dd8'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:13.845252 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7cfad4ce-e046-40e9-b46c-b35e95db02fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b818418d59b40a0b6e4b229b7193dd8'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:13.865624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7cfad4ce-e046-40e9-b46c-b35e95db02fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b818418d59b40a0b6e4b229b7193dd8'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:13.901514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 820/1640] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:13 2022] DELETE /identity/v3/users/2b818418d59b40a0b6e4b229b7193dd8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:13.905948 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfedab0-d902-4664-aa3b-4092685064ad None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:13.906153 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfedab0-d902-4664-aa3b-4092685064ad None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:13.906571 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfedab0-d902-4664-aa3b-4092685064ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:13.938766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-dcfedab0-d902-4664-aa3b-4092685064ad None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:13.942355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-dcfedab0-d902-4664-aa3b-4092685064ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:14.123865 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 821/1641] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:14.328459 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfad4ce-e046-40e9-b46c-b35e95db02fd admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:14.330372 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7cfad4ce-e046-40e9-b46c-b35e95db02fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:14.467272 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfad4ce-e046-40e9-b46c-b35e95db02fd admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:14.479423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac8e7a-1284-4925-ba70-23350b0b6667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:14.480347 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac8e7a-1284-4925-ba70-23350b0b6667 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:14.480634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac8e7a-1284-4925-ba70-23350b0b6667 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:14.481888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac8e7a-1284-4925-ba70-23350b0b6667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:14.509839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac8e7a-1284-4925-ba70-23350b0b6667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:14.512072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac8e7a-1284-4925-ba70-23350b0b6667 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:14.544905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 821/1642] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:14.564777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfedab0-d902-4664-aa3b-4092685064ad None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:14.566716 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-dcfedab0-d902-4664-aa3b-4092685064ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:14.591412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfedab0-d902-4664-aa3b-4092685064ad None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:14.597661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e975653-50f7-41e7-9491-98061326fb14 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:14.597975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e975653-50f7-41e7-9491-98061326fb14 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:14.598576 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e975653-50f7-41e7-9491-98061326fb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:14.610312 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d41130-63f3-493a-a31f-92699fe0523b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:14.611950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d41130-63f3-493a-a31f-92699fe0523b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:14.612799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d41130-63f3-493a-a31f-92699fe0523b admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:14.613763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d41130-63f3-493a-a31f-92699fe0523b admin admin] PATH_INFO: `/v3/users/5407b61ec38b4088b61cade06ab26b79` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:14.616594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d41130-63f3-493a-a31f-92699fe0523b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5407b61ec38b4088b61cade06ab26b79)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:14.622547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: WARNING py.warnings [None req-77d41130-63f3-493a-a31f-92699fe0523b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:42:14.622547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: warnings.warn(msg) May 05 15:42:14.622547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: May 05 15:42:14.624257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d41130-63f3-493a-a31f-92699fe0523b admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:14.628339 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8e975653-50f7-41e7-9491-98061326fb14 None None] MFA Rules not processed for user `050b1d9a97824d9dbb68f84dad0e2b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:14.629580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8e975653-50f7-41e7-9491-98061326fb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:14.769641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-77d41130-63f3-493a-a31f-92699fe0523b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5407b61ec38b4088b61cade06ab26b79'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:14.770783 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-77d41130-63f3-493a-a31f-92699fe0523b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5407b61ec38b4088b61cade06ab26b79'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:14.807558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-77d41130-63f3-493a-a31f-92699fe0523b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5407b61ec38b4088b61cade06ab26b79'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:14.826442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 822/1643] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:14.827789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e975653-50f7-41e7-9491-98061326fb14 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:14.829473 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8e975653-50f7-41e7-9491-98061326fb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:14.841010 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-77d41130-63f3-493a-a31f-92699fe0523b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5407b61ec38b4088b61cade06ab26b79'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:14.846851 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-77d41130-63f3-493a-a31f-92699fe0523b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5407b61ec38b4088b61cade06ab26b79'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:14.860482 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e975653-50f7-41e7-9491-98061326fb14 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:14.880745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972771f2-2679-41cf-bb36-eaa5fd8bda27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:14.881436 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972771f2-2679-41cf-bb36-eaa5fd8bda27 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:14.881724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972771f2-2679-41cf-bb36-eaa5fd8bda27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:14.882003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972771f2-2679-41cf-bb36-eaa5fd8bda27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:14.883371 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972771f2-2679-41cf-bb36-eaa5fd8bda27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:14.885642 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972771f2-2679-41cf-bb36-eaa5fd8bda27 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:14.904111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 822/1644] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:14 2022] DELETE /identity/v3/users/5407b61ec38b4088b61cade06ab26b79 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:14.908355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e10b5f-ecd5-44ba-9706-8953158d7aa2 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:14.908656 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e10b5f-ecd5-44ba-9706-8953158d7aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:14.908938 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e10b5f-ecd5-44ba-9706-8953158d7aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:14.940621 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 823/1645] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:14 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:14.945140 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972771f2-2679-41cf-bb36-eaa5fd8bda27 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:14.950365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-972771f2-2679-41cf-bb36-eaa5fd8bda27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:14.959051 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-c0e10b5f-ecd5-44ba-9706-8953158d7aa2 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:14.961704 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c0e10b5f-ecd5-44ba-9706-8953158d7aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:15.093930 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972771f2-2679-41cf-bb36-eaa5fd8bda27 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:15.099979 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2502a-4075-461a-9d3f-765b55a4f1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:15.102024 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2502a-4075-461a-9d3f-765b55a4f1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:15.102573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2502a-4075-461a-9d3f-765b55a4f1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:15.102961 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2502a-4075-461a-9d3f-765b55a4f1a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:15.103800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2502a-4075-461a-9d3f-765b55a4f1a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:15.106211 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2502a-4075-461a-9d3f-765b55a4f1a4 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:15.150795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 824/1646] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:14 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:15.155785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2502a-4075-461a-9d3f-765b55a4f1a4 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:15.175147 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 823/1647] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:42:15.176638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16461d-2290-4128-a151-f66aa0a25ef7 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:15.177041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16461d-2290-4128-a151-f66aa0a25ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:15.177568 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16461d-2290-4128-a151-f66aa0a25ef7 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:15.179148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 824/1648] 10.222.0.58 () {54 vars in 912 bytes} [Thu May 5 15:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:42:15.181454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2502a-4075-461a-9d3f-765b55a4f1a4 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:15.185245 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d71a2e-9f04-4bac-a067-8de3ede3ffee None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:15.186284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d71a2e-9f04-4bac-a067-8de3ede3ffee None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:15.186724 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d71a2e-9f04-4bac-a067-8de3ede3ffee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:15.193946 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c533a-b15b-4460-8afb-e6b815776964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:15.196667 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c533a-b15b-4460-8afb-e6b815776964 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:15.197726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c533a-b15b-4460-8afb-e6b815776964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:15.199913 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c533a-b15b-4460-8afb-e6b815776964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:15.201310 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c533a-b15b-4460-8afb-e6b815776964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:15.204726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c533a-b15b-4460-8afb-e6b815776964 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:15.232132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 825/1649] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:15.233085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c533a-b15b-4460-8afb-e6b815776964 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:15.238766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-cd2c533a-b15b-4460-8afb-e6b815776964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:15.247493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-b5d71a2e-9f04-4bac-a067-8de3ede3ffee None None] MFA Rules not processed for user `2fe9f8eb94c84c36ad7a49507b2c8360`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:15.249224 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b5d71a2e-9f04-4bac-a067-8de3ede3ffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:15.384167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c533a-b15b-4460-8afb-e6b815776964 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:15.385950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 825/1650] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 5 15:42:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:15.389433 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d71a2e-9f04-4bac-a067-8de3ede3ffee None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:15.391895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6659049-1804-4b48-9fb1-6767e2d34d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:15.392566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6659049-1804-4b48-9fb1-6767e2d34d76 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:15.392846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6659049-1804-4b48-9fb1-6767e2d34d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:15.393275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6659049-1804-4b48-9fb1-6767e2d34d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:15.420601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d71a2e-9f04-4bac-a067-8de3ede3ffee None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:15.422004 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6659049-1804-4b48-9fb1-6767e2d34d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:15.423623 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6659049-1804-4b48-9fb1-6767e2d34d76 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:15.437918 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ede23-77d9-4440-a288-4e4abe4c3ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:15.439510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ede23-77d9-4440-a288-4e4abe4c3ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:15.440204 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ede23-77d9-4440-a288-4e4abe4c3ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:15.440828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ede23-77d9-4440-a288-4e4abe4c3ff3 admin admin] PATH_INFO: `/v3/projects/9d72e5424de74448ae9977b50942d3cb/users/30ebdd12072241a894286837a06a8681/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:15.447853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 826/1651] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:15.464523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ede23-77d9-4440-a288-4e4abe4c3ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d72e5424de74448ae9977b50942d3cb, user_id=30ebdd12072241a894286837a06a8681, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:15.469647 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ede23-77d9-4440-a288-4e4abe4c3ff3 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:15.485826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6659049-1804-4b48-9fb1-6767e2d34d76 service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:15.499061 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6659049-1804-4b48-9fb1-6767e2d34d76 service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:15.500087 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 826/1652] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:15 2022] PUT /identity/v3/projects/9d72e5424de74448ae9977b50942d3cb/users/30ebdd12072241a894286837a06a8681/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:15.504766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ede23-77d9-4440-a288-4e4abe4c3ff3 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:15.622583 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287f32b-8b0b-4f10-8af5-667e64035c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:15.623252 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f32b-8b0b-4f10-8af5-667e64035c2d service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:15.626582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f32b-8b0b-4f10-8af5-667e64035c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:15.627133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f32b-8b0b-4f10-8af5-667e64035c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:15.646999 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287f32b-8b0b-4f10-8af5-667e64035c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:15.650624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287f32b-8b0b-4f10-8af5-667e64035c2d service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:15.671980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ede23-77d9-4440-a288-4e4abe4c3ff3 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:15.672123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 827/1653] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:42:15.684970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e11b2-a1c5-4dd0-b99f-e2dd5cec5090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:15.685817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e11b2-a1c5-4dd0-b99f-e2dd5cec5090 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:15.687507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e11b2-a1c5-4dd0-b99f-e2dd5cec5090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:15.689373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e11b2-a1c5-4dd0-b99f-e2dd5cec5090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:15.690393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e11b2-a1c5-4dd0-b99f-e2dd5cec5090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:15.695894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e11b2-a1c5-4dd0-b99f-e2dd5cec5090 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:15.717578 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 827/1654] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:15.722461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287f32b-8b0b-4f10-8af5-667e64035c2d service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:15.743509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287f32b-8b0b-4f10-8af5-667e64035c2d service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:15.753783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadfdec-ac57-4466-98b6-f4672c92d47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:15.754866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadfdec-ac57-4466-98b6-f4672c92d47d admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:15.755090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadfdec-ac57-4466-98b6-f4672c92d47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:15.755455 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadfdec-ac57-4466-98b6-f4672c92d47d admin admin] PATH_INFO: `/v3/projects/9d72e5424de74448ae9977b50942d3cb/users/30ebdd12072241a894286837a06a8681/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:15.758775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadfdec-ac57-4466-98b6-f4672c92d47d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d72e5424de74448ae9977b50942d3cb, user_id=30ebdd12072241a894286837a06a8681, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:15.761950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadfdec-ac57-4466-98b6-f4672c92d47d admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:15.797173 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 828/1655] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:15 2022] PUT /identity/v3/projects/9d72e5424de74448ae9977b50942d3cb/users/30ebdd12072241a894286837a06a8681/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:16.837310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e11b2-a1c5-4dd0-b99f-e2dd5cec5090 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:16.841237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6a9e11b2-a1c5-4dd0-b99f-e2dd5cec5090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:16.869331 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e11b2-a1c5-4dd0-b99f-e2dd5cec5090 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:17.022114 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadfdec-ac57-4466-98b6-f4672c92d47d admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:17.024823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9dadfdec-ac57-4466-98b6-f4672c92d47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:17.065080 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd158a-23e1-41ee-969f-e33476141ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:17.066276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd158a-23e1-41ee-969f-e33476141ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.066708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd158a-23e1-41ee-969f-e33476141ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.067146 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd158a-23e1-41ee-969f-e33476141ec1 admin admin] PATH_INFO: `/v3/users/66c473f36f864dbab9433e71c5ca5475` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.075617 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd158a-23e1-41ee-969f-e33476141ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c473f36f864dbab9433e71c5ca5475)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:17.078330 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd158a-23e1-41ee-969f-e33476141ec1 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:17.171548 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadfdec-ac57-4466-98b6-f4672c92d47d admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:17.179491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86de4f-5e95-4009-b701-3d80f0b880fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:17.180896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86de4f-5e95-4009-b701-3d80f0b880fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.181552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86de4f-5e95-4009-b701-3d80f0b880fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.182059 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86de4f-5e95-4009-b701-3d80f0b880fe admin admin] PATH_INFO: `/v3/projects/e77416665b5e41599332558236071050` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.183783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86de4f-5e95-4009-b701-3d80f0b880fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e77416665b5e41599332558236071050)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:17.185545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: WARNING py.warnings [None req-8d86de4f-5e95-4009-b701-3d80f0b880fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 05 15:42:17.185545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: warnings.warn(msg) May 05 15:42:17.185545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: May 05 15:42:17.188022 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86de4f-5e95-4009-b701-3d80f0b880fe admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:17.203892 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-42bd158a-23e1-41ee-969f-e33476141ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c473f36f864dbab9433e71c5ca5475'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:17.204920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-42bd158a-23e1-41ee-969f-e33476141ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c473f36f864dbab9433e71c5ca5475'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:17.228761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-42bd158a-23e1-41ee-969f-e33476141ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c473f36f864dbab9433e71c5ca5475'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:17.241384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-42bd158a-23e1-41ee-969f-e33476141ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c473f36f864dbab9433e71c5ca5475'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:17.243816 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-42bd158a-23e1-41ee-969f-e33476141ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c473f36f864dbab9433e71c5ca5475'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:17.279340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 828/1656] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:16 2022] DELETE /identity/v3/users/66c473f36f864dbab9433e71c5ca5475 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:17.280948 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c34b7-cf55-4a72-b65a-e490fa881078 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.282815 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c34b7-cf55-4a72-b65a-e490fa881078 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.283291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c34b7-cf55-4a72-b65a-e490fa881078 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.286270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8d86de4f-5e95-4009-b701-3d80f0b880fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e77416665b5e41599332558236071050', 'request_id': 'req-8d86de4f-5e95-4009-b701-3d80f0b880fe'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:17.290519 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 829/1657] 10.222.0.58 () {54 vars in 960 bytes} [Thu May 5 15:42:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:42:17.291790 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08141779-9586-4884-a7d0-36b1f55b43d3 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.292139 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08141779-9586-4884-a7d0-36b1f55b43d3 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.292422 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08141779-9586-4884-a7d0-36b1f55b43d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.299370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8d86de4f-5e95-4009-b701-3d80f0b880fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e77416665b5e41599332558236071050', 'request_id': 'req-8d86de4f-5e95-4009-b701-3d80f0b880fe'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:17.329825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-08141779-9586-4884-a7d0-36b1f55b43d3 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:17.333810 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-08141779-9586-4884-a7d0-36b1f55b43d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:17.335798 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8d86de4f-5e95-4009-b701-3d80f0b880fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e77416665b5e41599332558236071050', 'request_id': 'req-8d86de4f-5e95-4009-b701-3d80f0b880fe'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:17.358866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8d86de4f-5e95-4009-b701-3d80f0b880fe admin admin] The token cache is being invalidate because project e77416665b5e41599332558236071050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:17.359159 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8d86de4f-5e95-4009-b701-3d80f0b880fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:17.362099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8d86de4f-5e95-4009-b701-3d80f0b880fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:17.363858 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 829/1658] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:17 2022] DELETE /identity/v3/projects/e77416665b5e41599332558236071050 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:17.365823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e5fc8-fdbb-407a-97a0-72955119a33f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.366303 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e5fc8-fdbb-407a-97a0-72955119a33f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.366988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e5fc8-fdbb-407a-97a0-72955119a33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.419390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-486e5fc8-fdbb-407a-97a0-72955119a33f None None] MFA Rules not processed for user `a12f5d874be84f1ca79eb439267c7b70`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:17.426513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-486e5fc8-fdbb-407a-97a0-72955119a33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:17.470475 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 830/1659] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:17.473592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e4cb5-782d-41a3-93b4-c259cc5668b0 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.473592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e4cb5-782d-41a3-93b4-c259cc5668b0 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.473592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e4cb5-782d-41a3-93b4-c259cc5668b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.525723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-260e4cb5-782d-41a3-93b4-c259cc5668b0 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:17.527196 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-260e4cb5-782d-41a3-93b4-c259cc5668b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:17.556648 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 831/1660] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:17.564556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06329373-ca5c-48e4-b099-1943a838f5bf None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.565125 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06329373-ca5c-48e4-b099-1943a838f5bf None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.565563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06329373-ca5c-48e4-b099-1943a838f5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.599338 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-06329373-ca5c-48e4-b099-1943a838f5bf None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:17.602008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-06329373-ca5c-48e4-b099-1943a838f5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:17.624656 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 832/1661] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:17.626059 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06329373-ca5c-48e4-b099-1943a838f5bf None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:17.628701 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-06329373-ca5c-48e4-b099-1943a838f5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:17.630691 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 830/1662] 10.222.0.58 () {58 vars in 1057 bytes} [Thu May 5 15:42:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:17.674584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e5fc8-fdbb-407a-97a0-72955119a33f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:17.677217 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e5fc8-fdbb-407a-97a0-72955119a33f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:17.689810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed60a9-aec7-4352-bfc3-161258db1535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:17.690694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed60a9-aec7-4352-bfc3-161258db1535 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.691017 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed60a9-aec7-4352-bfc3-161258db1535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.691301 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed60a9-aec7-4352-bfc3-161258db1535 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.692034 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed60a9-aec7-4352-bfc3-161258db1535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:17.692400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed60a9-aec7-4352-bfc3-161258db1535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:17.694266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed60a9-aec7-4352-bfc3-161258db1535 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:17.721181 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 831/1663] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:17.723448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed60a9-aec7-4352-bfc3-161258db1535 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:17.761900 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed60a9-aec7-4352-bfc3-161258db1535 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:17.771626 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06329373-ca5c-48e4-b099-1943a838f5bf None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:17.777254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b32e38-8f62-4072-b93d-a2118603af92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:17.777254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b32e38-8f62-4072-b93d-a2118603af92 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.777669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b32e38-8f62-4072-b93d-a2118603af92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.778010 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b32e38-8f62-4072-b93d-a2118603af92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.790427 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e32eb-dc5e-4d26-8248-027f4375af9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12f5d874be84f1ca79eb439267c7b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:17.792547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e32eb-dc5e-4d26-8248-027f4375af9e service placement] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.793361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e32eb-dc5e-4d26-8248-027f4375af9e service placement] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.794746 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e32eb-dc5e-4d26-8248-027f4375af9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.800956 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-659e32eb-dc5e-4d26-8248-027f4375af9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:17.802561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b32e38-8f62-4072-b93d-a2118603af92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:17.804640 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b32e38-8f62-4072-b93d-a2118603af92 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:17.827383 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 833/1664] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:17.830493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b32e38-8f62-4072-b93d-a2118603af92 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:17.833351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b2b32e38-8f62-4072-b93d-a2118603af92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:17.837973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e32eb-dc5e-4d26-8248-027f4375af9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:17.839984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e32eb-dc5e-4d26-8248-027f4375af9e service placement] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:17.861242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 832/1665] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:17.868928 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b32e38-8f62-4072-b93d-a2118603af92 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:17.870460 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e32eb-dc5e-4d26-8248-027f4375af9e service placement] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:17.890053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:17.891409 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.891672 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.891954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a admin admin] PATH_INFO: `/v3/projects/4ffb34c08c1a4c9d8369078b134c86cf` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.896297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ffb34c08c1a4c9d8369078b134c86cf)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:17.900501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:17.909808 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e32eb-dc5e-4d26-8248-027f4375af9e service placement] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:17.935636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2df85-ec56-40ae-8443-fe8f99191acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:17.936313 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2df85-ec56-40ae-8443-fe8f99191acc admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:17.936596 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2df85-ec56-40ae-8443-fe8f99191acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:17.936870 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2df85-ec56-40ae-8443-fe8f99191acc admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:17.941544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2df85-ec56-40ae-8443-fe8f99191acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:17.943632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2df85-ec56-40ae-8443-fe8f99191acc admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:18.055761 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 833/1666] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:17 2022] POST /identity/v3/projects => generated 371 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:18.057093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2df85-ec56-40ae-8443-fe8f99191acc admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:18.073930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ffb34c08c1a4c9d8369078b134c86cf', 'request_id': 'req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:18.107053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ffb34c08c1a4c9d8369078b134c86cf', 'request_id': 'req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:18.123287 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ffb34c08c1a4c9d8369078b134c86cf', 'request_id': 'req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:18.172435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a admin admin] The token cache is being invalidate because project 4ffb34c08c1a4c9d8369078b134c86cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:18.172435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:18.174329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:18.194218 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 834/1667] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:17 2022] DELETE /identity/v3/projects/4ffb34c08c1a4c9d8369078b134c86cf => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:18.196034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:18.206513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:18.341818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2df85-ec56-40ae-8443-fe8f99191acc admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:18.354554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cb6c2-dd5d-4a2d-a2f3-6979f0330c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:18.355421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cb6c2-dd5d-4a2d-a2f3-6979f0330c43 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:18.355875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cb6c2-dd5d-4a2d-a2f3-6979f0330c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:18.356297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cb6c2-dd5d-4a2d-a2f3-6979f0330c43 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:18.357676 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cb6c2-dd5d-4a2d-a2f3-6979f0330c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:18.360274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cb6c2-dd5d-4a2d-a2f3-6979f0330c43 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:18.445767 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5b6bb-47fe-4ef9-8693-88d7ab611e7a admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:18.480551 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 834/1668] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:18 2022] POST /identity/v3/users => generated 286 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:18.481152 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f97d07-edda-4591-93a1-4ef06a8fa20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:18.482054 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f97d07-edda-4591-93a1-4ef06a8fa20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:18.482431 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f97d07-edda-4591-93a1-4ef06a8fa20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:18.482710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f97d07-edda-4591-93a1-4ef06a8fa20b admin admin] PATH_INFO: `/v3/users/b112ca2610674344bec3bc42b89f8e3c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:18.483928 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f97d07-edda-4591-93a1-4ef06a8fa20b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b112ca2610674344bec3bc42b89f8e3c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:18.485588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cb6c2-dd5d-4a2d-a2f3-6979f0330c43 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:18.490935 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b83cb6c2-dd5d-4a2d-a2f3-6979f0330c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:18.498067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f97d07-edda-4591-93a1-4ef06a8fa20b admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:18.517377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cb6c2-dd5d-4a2d-a2f3-6979f0330c43 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:18.529909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9aa3e7-ebe7-4f5e-ac38-426cbd415c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:18.532133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa3e7-ebe7-4f5e-ac38-426cbd415c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:18.532457 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa3e7-ebe7-4f5e-ac38-426cbd415c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:18.533164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa3e7-ebe7-4f5e-ac38-426cbd415c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:18.534259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9aa3e7-ebe7-4f5e-ac38-426cbd415c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:18.545886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9aa3e7-ebe7-4f5e-ac38-426cbd415c21 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:18.573090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 835/1669] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:18.579162 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9aa3e7-ebe7-4f5e-ac38-426cbd415c21 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:18.596974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9aa3e7-ebe7-4f5e-ac38-426cbd415c21 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:18.626877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c583e-c2df-447f-bee8-aab507b502dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:18.631845 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c583e-c2df-447f-bee8-aab507b502dc admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:18.634873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c583e-c2df-447f-bee8-aab507b502dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:18.636978 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c583e-c2df-447f-bee8-aab507b502dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:18.641848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c583e-c2df-447f-bee8-aab507b502dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:18.644423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c583e-c2df-447f-bee8-aab507b502dc admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:18.653961 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-c0f97d07-edda-4591-93a1-4ef06a8fa20b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b112ca2610674344bec3bc42b89f8e3c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:18.657799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-c0f97d07-edda-4591-93a1-4ef06a8fa20b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b112ca2610674344bec3bc42b89f8e3c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:18.682702 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-c0f97d07-edda-4591-93a1-4ef06a8fa20b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b112ca2610674344bec3bc42b89f8e3c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:18.684513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 836/1670] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:18.685575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c583e-c2df-447f-bee8-aab507b502dc admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:18.695887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3a1c583e-c2df-447f-bee8-aab507b502dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:18.703423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-c0f97d07-edda-4591-93a1-4ef06a8fa20b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b112ca2610674344bec3bc42b89f8e3c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:18.704846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-c0f97d07-edda-4591-93a1-4ef06a8fa20b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b112ca2610674344bec3bc42b89f8e3c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:18.719778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c583e-c2df-447f-bee8-aab507b502dc admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:18.731472 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98400195-517e-4f39-ae1b-a37e276a5212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:18.739985 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98400195-517e-4f39-ae1b-a37e276a5212 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:18.740495 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98400195-517e-4f39-ae1b-a37e276a5212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:18.740984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98400195-517e-4f39-ae1b-a37e276a5212 admin admin] PATH_INFO: `/v3/projects/c4efd8af4a564791bc687a04d11ca49c/users/bd36f4b03c284d2fb09b69f722298797/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:18.763126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 835/1671] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:18 2022] DELETE /identity/v3/users/b112ca2610674344bec3bc42b89f8e3c => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:18.981692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98400195-517e-4f39-ae1b-a37e276a5212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4efd8af4a564791bc687a04d11ca49c, user_id=bd36f4b03c284d2fb09b69f722298797, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:18.984737 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98400195-517e-4f39-ae1b-a37e276a5212 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:19.018270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 837/1672] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:18 2022] PUT /identity/v3/projects/c4efd8af4a564791bc687a04d11ca49c/users/bd36f4b03c284d2fb09b69f722298797/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:19.034489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be21e1-52fb-42ed-8194-1468a93ccec1 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:19.035024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be21e1-52fb-42ed-8194-1468a93ccec1 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:19.035097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be21e1-52fb-42ed-8194-1468a93ccec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:19.102707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-26be21e1-52fb-42ed-8194-1468a93ccec1 None None] MFA Rules not processed for user `bd36f4b03c284d2fb09b69f722298797`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:19.104036 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-26be21e1-52fb-42ed-8194-1468a93ccec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:19.348089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 836/1673] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:19.353413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98400195-517e-4f39-ae1b-a37e276a5212 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:19.383051 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea65ac-86a9-4b3e-9275-6e583b7bc1ff None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:19.383337 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea65ac-86a9-4b3e-9275-6e583b7bc1ff None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:19.383614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea65ac-86a9-4b3e-9275-6e583b7bc1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:19.484363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-daea65ac-86a9-4b3e-9275-6e583b7bc1ff None None] MFA Rules not processed for user `30ebdd12072241a894286837a06a8681`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:19.502005 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-daea65ac-86a9-4b3e-9275-6e583b7bc1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:19.618832 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98400195-517e-4f39-ae1b-a37e276a5212 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:19.638366 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e72f0b-6f17-430b-bcf1-73428e3ea4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:19.639057 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e72f0b-6f17-430b-bcf1-73428e3ea4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:19.639335 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e72f0b-6f17-430b-bcf1-73428e3ea4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:19.639607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e72f0b-6f17-430b-bcf1-73428e3ea4a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:19.640305 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e72f0b-6f17-430b-bcf1-73428e3ea4a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:19.655183 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e72f0b-6f17-430b-bcf1-73428e3ea4a1 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:19.741797 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 838/1674] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:19 2022] POST /identity/v3/projects => generated 373 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:19.743471 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e72f0b-6f17-430b-bcf1-73428e3ea4a1 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:19.783863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 837/1675] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:19.794056 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea65ac-86a9-4b3e-9275-6e583b7bc1ff None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:19.795679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-daea65ac-86a9-4b3e-9275-6e583b7bc1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:19.955045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e72f0b-6f17-430b-bcf1-73428e3ea4a1 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:19.968418 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0345a78-9752-4ab5-bfbd-4e18117c1364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:19.971802 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0345a78-9752-4ab5-bfbd-4e18117c1364 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:19.972347 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0345a78-9752-4ab5-bfbd-4e18117c1364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:19.972835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0345a78-9752-4ab5-bfbd-4e18117c1364 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:19.973954 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0345a78-9752-4ab5-bfbd-4e18117c1364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:19.987834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0345a78-9752-4ab5-bfbd-4e18117c1364 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:20.026285 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea65ac-86a9-4b3e-9275-6e583b7bc1ff None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:20.042984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 839/1676] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:19 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:20.044774 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0345a78-9752-4ab5-bfbd-4e18117c1364 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:20.069927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0345a78-9752-4ab5-bfbd-4e18117c1364 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:20.081986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded6b4b-ff8f-43e4-a3f5-105986be5876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:20.082579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded6b4b-ff8f-43e4-a3f5-105986be5876 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:20.082858 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded6b4b-ff8f-43e4-a3f5-105986be5876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:20.083134 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded6b4b-ff8f-43e4-a3f5-105986be5876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:20.085707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded6b4b-ff8f-43e4-a3f5-105986be5876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:20.089858 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded6b4b-ff8f-43e4-a3f5-105986be5876 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:20.129588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a64594-fc43-4cee-af38-8ac509844d3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:20.132539 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a64594-fc43-4cee-af38-8ac509844d3a service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:20.133279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a64594-fc43-4cee-af38-8ac509844d3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:20.133760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a64594-fc43-4cee-af38-8ac509844d3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:20.137014 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 840/1677] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:20.139594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-a9a64594-fc43-4cee-af38-8ac509844d3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:20.139731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded6b4b-ff8f-43e4-a3f5-105986be5876 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:20.191202 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded6b4b-ff8f-43e4-a3f5-105986be5876 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:20.197325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075dae8-f630-46cc-8921-802d1f6df52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:20.198259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075dae8-f630-46cc-8921-802d1f6df52d admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:20.198589 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075dae8-f630-46cc-8921-802d1f6df52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:20.199010 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075dae8-f630-46cc-8921-802d1f6df52d admin admin] PATH_INFO: `/v3/projects/b101f36eeee74a099958b4fd8cd3da3a/users/b6ed0796fd6b48a98dee6d67e70962a8/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:20.220431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075dae8-f630-46cc-8921-802d1f6df52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b101f36eeee74a099958b4fd8cd3da3a, user_id=b6ed0796fd6b48a98dee6d67e70962a8, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:20.229844 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075dae8-f630-46cc-8921-802d1f6df52d admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:20.240225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a64594-fc43-4cee-af38-8ac509844d3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:20.242610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a64594-fc43-4cee-af38-8ac509844d3a service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:20.261249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 841/1678] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:20 2022] PUT /identity/v3/projects/b101f36eeee74a099958b4fd8cd3da3a/users/b6ed0796fd6b48a98dee6d67e70962a8/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:20.262290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 838/1679] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:42:20.274774 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075dae8-f630-46cc-8921-802d1f6df52d admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:20.402649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075dae8-f630-46cc-8921-802d1f6df52d admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:20.415112 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d77f24-31f2-42b7-80ea-48f26045cbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:20.416330 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d77f24-31f2-42b7-80ea-48f26045cbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:20.416629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d77f24-31f2-42b7-80ea-48f26045cbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:20.418375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d77f24-31f2-42b7-80ea-48f26045cbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:20.421689 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d77f24-31f2-42b7-80ea-48f26045cbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:20.426265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d77f24-31f2-42b7-80ea-48f26045cbb3 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:20.449743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 842/1680] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:42:20.454343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a64594-fc43-4cee-af38-8ac509844d3a service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:20.472320 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a64594-fc43-4cee-af38-8ac509844d3a service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:20.484975 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8194c5b-3649-4f5c-b494-9a80f12bd343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:20.489654 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8194c5b-3649-4f5c-b494-9a80f12bd343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:20.490241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8194c5b-3649-4f5c-b494-9a80f12bd343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:20.492732 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8194c5b-3649-4f5c-b494-9a80f12bd343 admin admin] PATH_INFO: `/v3/projects/b101f36eeee74a099958b4fd8cd3da3a/users/b6ed0796fd6b48a98dee6d67e70962a8/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:20.497264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8194c5b-3649-4f5c-b494-9a80f12bd343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b101f36eeee74a099958b4fd8cd3da3a, user_id=b6ed0796fd6b48a98dee6d67e70962a8, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:20.502388 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8194c5b-3649-4f5c-b494-9a80f12bd343 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:20.533354 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 839/1681] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:20 2022] PUT /identity/v3/projects/b101f36eeee74a099958b4fd8cd3da3a/users/b6ed0796fd6b48a98dee6d67e70962a8/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:20.548700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9c1a6-5f83-422c-aaa4-e3b1295ee3ea None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:20.549548 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9c1a6-5f83-422c-aaa4-e3b1295ee3ea None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:20.549930 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9c1a6-5f83-422c-aaa4-e3b1295ee3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:20.617614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8194c5b-3649-4f5c-b494-9a80f12bd343 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:20.620162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-f8194c5b-3649-4f5c-b494-9a80f12bd343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:20.623984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f7b9c1a6-5f83-422c-aaa4-e3b1295ee3ea None None] MFA Rules not processed for user `b6ed0796fd6b48a98dee6d67e70962a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:20.629616 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f7b9c1a6-5f83-422c-aaa4-e3b1295ee3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:20.868210 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8194c5b-3649-4f5c-b494-9a80f12bd343 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:20.868455 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 843/1682] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:20.868455 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9c1a6-5f83-422c-aaa4-e3b1295ee3ea None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:20.874251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f7b9c1a6-5f83-422c-aaa4-e3b1295ee3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:20.883982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dccfc-f415-4c79-8008-617f6fab0180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:20.884869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dccfc-f415-4c79-8008-617f6fab0180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:20.885150 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dccfc-f415-4c79-8008-617f6fab0180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:20.885905 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dccfc-f415-4c79-8008-617f6fab0180 admin admin] PATH_INFO: `/v3/projects/834362453f85461fa0aec77163eb26fc` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:20.893487 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dccfc-f415-4c79-8008-617f6fab0180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=834362453f85461fa0aec77163eb26fc)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:20.895468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dccfc-f415-4c79-8008-617f6fab0180 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:20.918945 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9c1a6-5f83-422c-aaa4-e3b1295ee3ea None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:20.937702 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf824d-a7ce-486c-88dd-b2006619d7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:20.945798 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf824d-a7ce-486c-88dd-b2006619d7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:20.946672 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf824d-a7ce-486c-88dd-b2006619d7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:20.946910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf824d-a7ce-486c-88dd-b2006619d7a3 admin admin] PATH_INFO: `/v3/projects/1e09377ba87c4474a73b1fe379f1032c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:20.952683 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf824d-a7ce-486c-88dd-b2006619d7a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e09377ba87c4474a73b1fe379f1032c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:20.972722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf824d-a7ce-486c-88dd-b2006619d7a3 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:21.061479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-9a5dccfc-f415-4c79-8008-617f6fab0180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '834362453f85461fa0aec77163eb26fc', 'request_id': 'req-9a5dccfc-f415-4c79-8008-617f6fab0180'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:21.079419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-9a5dccfc-f415-4c79-8008-617f6fab0180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '834362453f85461fa0aec77163eb26fc', 'request_id': 'req-9a5dccfc-f415-4c79-8008-617f6fab0180'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:21.089036 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-9a5dccfc-f415-4c79-8008-617f6fab0180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '834362453f85461fa0aec77163eb26fc', 'request_id': 'req-9a5dccfc-f415-4c79-8008-617f6fab0180'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:21.113986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-9a5dccfc-f415-4c79-8008-617f6fab0180 admin admin] The token cache is being invalidate because project 834362453f85461fa0aec77163eb26fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:21.114519 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-9a5dccfc-f415-4c79-8008-617f6fab0180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:21.116626 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-9a5dccfc-f415-4c79-8008-617f6fab0180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:21.119694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 840/1683] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:20 2022] DELETE /identity/v3/projects/834362453f85461fa0aec77163eb26fc => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:42:21.121125 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dccfc-f415-4c79-8008-617f6fab0180 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:21.123412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9a5dccfc-f415-4c79-8008-617f6fab0180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:21.142940 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7fdf824d-a7ce-486c-88dd-b2006619d7a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e09377ba87c4474a73b1fe379f1032c', 'request_id': 'req-7fdf824d-a7ce-486c-88dd-b2006619d7a3'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:21.154043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7fdf824d-a7ce-486c-88dd-b2006619d7a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e09377ba87c4474a73b1fe379f1032c', 'request_id': 'req-7fdf824d-a7ce-486c-88dd-b2006619d7a3'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:21.163769 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7fdf824d-a7ce-486c-88dd-b2006619d7a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e09377ba87c4474a73b1fe379f1032c', 'request_id': 'req-7fdf824d-a7ce-486c-88dd-b2006619d7a3'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:21.205212 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7fdf824d-a7ce-486c-88dd-b2006619d7a3 admin admin] The token cache is being invalidate because project 1e09377ba87c4474a73b1fe379f1032c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:21.205760 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7fdf824d-a7ce-486c-88dd-b2006619d7a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:21.208312 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7fdf824d-a7ce-486c-88dd-b2006619d7a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:21.214860 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 844/1684] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:20 2022] DELETE /identity/v3/projects/1e09377ba87c4474a73b1fe379f1032c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:21.216812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb28a9-591b-4de3-87e6-54debf6f4edf None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.217270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb28a9-591b-4de3-87e6-54debf6f4edf None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.217707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb28a9-591b-4de3-87e6-54debf6f4edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.242341 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f4eb28a9-591b-4de3-87e6-54debf6f4edf None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:21.243885 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f4eb28a9-591b-4de3-87e6-54debf6f4edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:21.306900 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dccfc-f415-4c79-8008-617f6fab0180 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:21.363699 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 845/1685] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:21.367719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1852f-6f5c-410d-b14f-aedeae98f139 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.369178 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1852f-6f5c-410d-b14f-aedeae98f139 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.370140 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1852f-6f5c-410d-b14f-aedeae98f139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.434202 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-62a1852f-6f5c-410d-b14f-aedeae98f139 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:21.437259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-62a1852f-6f5c-410d-b14f-aedeae98f139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:21.442649 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc6a2f-3299-4c11-872b-6ebe1e9f3eb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:21.443684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc6a2f-3299-4c11-872b-6ebe1e9f3eb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.443971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc6a2f-3299-4c11-872b-6ebe1e9f3eb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.444250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc6a2f-3299-4c11-872b-6ebe1e9f3eb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.456971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-67cc6a2f-3299-4c11-872b-6ebe1e9f3eb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:21.463875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 846/1686] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:21.463875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc555fdf-4d17-4fab-80c2-cab8c8ce66ea None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.463875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc555fdf-4d17-4fab-80c2-cab8c8ce66ea None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.463875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc555fdf-4d17-4fab-80c2-cab8c8ce66ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.528133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-cc555fdf-4d17-4fab-80c2-cab8c8ce66ea None None] MFA Rules not processed for user `e2e0f15742ea49bba055538ae4e99303`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:21.529335 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-cc555fdf-4d17-4fab-80c2-cab8c8ce66ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:21.582052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc6a2f-3299-4c11-872b-6ebe1e9f3eb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:21.584252 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc6a2f-3299-4c11-872b-6ebe1e9f3eb8 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:21.606747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 841/1687] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:21.608866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791e40a-26d1-4452-be63-f7beab34d714 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.609144 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791e40a-26d1-4452-be63-f7beab34d714 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.609357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791e40a-26d1-4452-be63-f7beab34d714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.635074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-b791e40a-26d1-4452-be63-f7beab34d714 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:21.636357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b791e40a-26d1-4452-be63-f7beab34d714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:21.647697 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 842/1688] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:21.649092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee292-00fb-4ea0-8db6-c1f6683eb2cb None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.649386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee292-00fb-4ea0-8db6-c1f6683eb2cb None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.649668 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee292-00fb-4ea0-8db6-c1f6683eb2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.673359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 847/1689] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:21.673359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5382a-0ac8-409d-b8aa-68deef5d1ccb None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.673359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5382a-0ac8-409d-b8aa-68deef5d1ccb None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.673359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5382a-0ac8-409d-b8aa-68deef5d1ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.690266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-f49ee292-00fb-4ea0-8db6-c1f6683eb2cb None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:21.691706 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-f49ee292-00fb-4ea0-8db6-c1f6683eb2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:21.706559 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-40c5382a-0ac8-409d-b8aa-68deef5d1ccb None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:21.707808 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-40c5382a-0ac8-409d-b8aa-68deef5d1ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:21.730072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 843/1690] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:21.730072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee292-00fb-4ea0-8db6-c1f6683eb2cb None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:21.749243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee292-00fb-4ea0-8db6-c1f6683eb2cb None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:21.764690 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11523f1-07e3-445a-aabe-cb94a99384dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:21.765613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11523f1-07e3-445a-aabe-cb94a99384dc admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.765916 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11523f1-07e3-445a-aabe-cb94a99384dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.766159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11523f1-07e3-445a-aabe-cb94a99384dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.766916 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11523f1-07e3-445a-aabe-cb94a99384dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:21.767272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11523f1-07e3-445a-aabe-cb94a99384dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:21.769091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11523f1-07e3-445a-aabe-cb94a99384dc admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:21.817342 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 844/1691] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:21.823759 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaab513-1132-4010-beee-99d617dd60c0 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.825542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaab513-1132-4010-beee-99d617dd60c0 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.826014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaab513-1132-4010-beee-99d617dd60c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.895070 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 848/1692] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 5 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:21.895703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5382a-0ac8-409d-b8aa-68deef5d1ccb None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:21.901614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-7aaab513-1132-4010-beee-99d617dd60c0 None None] MFA Rules not processed for user `e2e0f15742ea49bba055538ae4e99303`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:21.902893 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7aaab513-1132-4010-beee-99d617dd60c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:21.947253 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 845/1693] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:21.948458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5382a-0ac8-409d-b8aa-68deef5d1ccb None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:21.950937 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaab513-1132-4010-beee-99d617dd60c0 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:21.959993 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa472ab8-53bb-4047-b1ed-1102ad4d85ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:21.960925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa472ab8-53bb-4047-b1ed-1102ad4d85ab admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.962523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa472ab8-53bb-4047-b1ed-1102ad4d85ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.964206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa472ab8-53bb-4047-b1ed-1102ad4d85ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.965147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa472ab8-53bb-4047-b1ed-1102ad4d85ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:21.965669 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa472ab8-53bb-4047-b1ed-1102ad4d85ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:21.967517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa472ab8-53bb-4047-b1ed-1102ad4d85ab admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:21.974745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaab513-1132-4010-beee-99d617dd60c0 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:21.992751 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f671f7-16ac-47d2-b730-887435f052c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:21.992977 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 849/1694] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:21.993433 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f671f7-16ac-47d2-b730-887435f052c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:21.993718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f671f7-16ac-47d2-b730-887435f052c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:21.994013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f671f7-16ac-47d2-b730-887435f052c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:21.994343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa472ab8-53bb-4047-b1ed-1102ad4d85ab admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:21.994728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f671f7-16ac-47d2-b730-887435f052c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:21.996165 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-fa472ab8-53bb-4047-b1ed-1102ad4d85ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:21.998683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f671f7-16ac-47d2-b730-887435f052c4 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.059686 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 846/1695] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:21 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:22.059686 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f671f7-16ac-47d2-b730-887435f052c4 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:22.175433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa472ab8-53bb-4047-b1ed-1102ad4d85ab admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:22.217067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f671f7-16ac-47d2-b730-887435f052c4 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:22.229850 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c84b69-3dfb-4e6c-8601-df75b8316918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:22.231430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c84b69-3dfb-4e6c-8601-df75b8316918 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.232665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c84b69-3dfb-4e6c-8601-df75b8316918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.233312 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c84b69-3dfb-4e6c-8601-df75b8316918 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.234579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c84b69-3dfb-4e6c-8601-df75b8316918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:22.238221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c84b69-3dfb-4e6c-8601-df75b8316918 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.283816 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 847/1696] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:22 2022] POST /identity/v3/projects => generated 383 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:22.284832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c84b69-3dfb-4e6c-8601-df75b8316918 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:22.348605 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2d059-3f24-48dd-9d34-d8901fbe1e2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:22.349453 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2d059-3f24-48dd-9d34-d8901fbe1e2d service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.349875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2d059-3f24-48dd-9d34-d8901fbe1e2d service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.350407 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2d059-3f24-48dd-9d34-d8901fbe1e2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.433514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2d059-3f24-48dd-9d34-d8901fbe1e2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:22.436539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2d059-3f24-48dd-9d34-d8901fbe1e2d service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.451485 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 850/1697] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:22.453194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2d059-3f24-48dd-9d34-d8901fbe1e2d service nova] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:22.454723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-06f2d059-3f24-48dd-9d34-d8901fbe1e2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:22.483610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c84b69-3dfb-4e6c-8601-df75b8316918 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:22.500456 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667277d-7757-4c23-bd08-5161ec7c43ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:22.501865 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667277d-7757-4c23-bd08-5161ec7c43ec admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.502355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667277d-7757-4c23-bd08-5161ec7c43ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.503941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667277d-7757-4c23-bd08-5161ec7c43ec admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.504672 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667277d-7757-4c23-bd08-5161ec7c43ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:22.508768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667277d-7757-4c23-bd08-5161ec7c43ec admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.558267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 848/1698] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:22 2022] POST /identity/v3/users => generated 303 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:22.559154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667277d-7757-4c23-bd08-5161ec7c43ec admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:22.563124 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4667277d-7757-4c23-bd08-5161ec7c43ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:22.591588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2d059-3f24-48dd-9d34-d8901fbe1e2d service nova] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:22.644111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe1a8f-7b3b-4fd9-af2c-84c3ccbc5153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:22.644777 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe1a8f-7b3b-4fd9-af2c-84c3ccbc5153 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.645059 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe1a8f-7b3b-4fd9-af2c-84c3ccbc5153 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.645334 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe1a8f-7b3b-4fd9-af2c-84c3ccbc5153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.647263 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-60fe1a8f-7b3b-4fd9-af2c-84c3ccbc5153 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:22.717787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667277d-7757-4c23-bd08-5161ec7c43ec admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:22.731245 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47bd0b-d5fa-4260-98e2-a0134a4fe5e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:22.733230 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47bd0b-d5fa-4260-98e2-a0134a4fe5e6 service swift] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.733230 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47bd0b-d5fa-4260-98e2-a0134a4fe5e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.736153 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47bd0b-d5fa-4260-98e2-a0134a4fe5e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.771902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe1a8f-7b3b-4fd9-af2c-84c3ccbc5153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:22.775495 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe1a8f-7b3b-4fd9-af2c-84c3ccbc5153 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.791141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 851/1699] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:22.792028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe1a8f-7b3b-4fd9-af2c-84c3ccbc5153 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:22.807173 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe1a8f-7b3b-4fd9-af2c-84c3ccbc5153 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:22.818338 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24554a-2180-4a86-ae96-6ebdc2da2dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:22.820286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24554a-2180-4a86-ae96-6ebdc2da2dca admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.822021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24554a-2180-4a86-ae96-6ebdc2da2dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.822625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24554a-2180-4a86-ae96-6ebdc2da2dca admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.825234 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24554a-2180-4a86-ae96-6ebdc2da2dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:22.831935 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24554a-2180-4a86-ae96-6ebdc2da2dca admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.842004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47bd0b-d5fa-4260-98e2-a0134a4fe5e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:22.843798 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47bd0b-d5fa-4260-98e2-a0134a4fe5e6 service swift] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.854514 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 849/1700] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:42:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:42:22.855643 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47bd0b-d5fa-4260-98e2-a0134a4fe5e6 service swift] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:22.857840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4c47bd0b-d5fa-4260-98e2-a0134a4fe5e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:22.875854 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 852/1701] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:22 2022] POST /identity/v3/users => generated 292 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:22.881361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24554a-2180-4a86-ae96-6ebdc2da2dca admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:22.885224 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47bd0b-d5fa-4260-98e2-a0134a4fe5e6 service swift] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:22.907835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1be35-35c5-492b-b774-1cb2a8bc34d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:22.909945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1be35-35c5-492b-b774-1cb2a8bc34d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.910133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1be35-35c5-492b-b774-1cb2a8bc34d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.910444 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24554a-2180-4a86-ae96-6ebdc2da2dca admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:22.910575 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1be35-35c5-492b-b774-1cb2a8bc34d6 admin admin] PATH_INFO: `/v3/users/bd36f4b03c284d2fb09b69f722298797` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.916158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1be35-35c5-492b-b774-1cb2a8bc34d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd36f4b03c284d2fb09b69f722298797)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:22.921911 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1be35-35c5-492b-b774-1cb2a8bc34d6 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.922930 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b65f2-f41a-4e54-bcda-9f94dcafd58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:22.923691 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b65f2-f41a-4e54-bcda-9f94dcafd58b admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:22.924031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b65f2-f41a-4e54-bcda-9f94dcafd58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:22.924361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b65f2-f41a-4e54-bcda-9f94dcafd58b admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:22.925832 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b65f2-f41a-4e54-bcda-9f94dcafd58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:22.935188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b65f2-f41a-4e54-bcda-9f94dcafd58b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:22.956407 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 853/1702] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:22.962913 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b65f2-f41a-4e54-bcda-9f94dcafd58b admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:22.984644 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b65f2-f41a-4e54-bcda-9f94dcafd58b admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:23.004199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a62bf-d5a1-4467-8e51-9fc01f4c6b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:23.008076 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a62bf-d5a1-4467-8e51-9fc01f4c6b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:23.019989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a62bf-d5a1-4467-8e51-9fc01f4c6b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:23.020638 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a62bf-d5a1-4467-8e51-9fc01f4c6b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:23.031611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a62bf-d5a1-4467-8e51-9fc01f4c6b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:23.035963 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a62bf-d5a1-4467-8e51-9fc01f4c6b19 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:23.051904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6fb1be35-35c5-492b-b774-1cb2a8bc34d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd36f4b03c284d2fb09b69f722298797'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:23.055401 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6fb1be35-35c5-492b-b774-1cb2a8bc34d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd36f4b03c284d2fb09b69f722298797'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:23.078545 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6fb1be35-35c5-492b-b774-1cb2a8bc34d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd36f4b03c284d2fb09b69f722298797'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:23.087369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6fb1be35-35c5-492b-b774-1cb2a8bc34d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd36f4b03c284d2fb09b69f722298797'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:23.088554 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6fb1be35-35c5-492b-b774-1cb2a8bc34d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd36f4b03c284d2fb09b69f722298797'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:23.095426 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 854/1703] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:23.104570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a62bf-d5a1-4467-8e51-9fc01f4c6b19 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:23.111151 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-169a62bf-d5a1-4467-8e51-9fc01f4c6b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:23.151766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 850/1704] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:22 2022] DELETE /identity/v3/users/bd36f4b03c284d2fb09b69f722298797 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:23.154613 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a62bf-d5a1-4467-8e51-9fc01f4c6b19 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:23.154738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1be35-35c5-492b-b774-1cb2a8bc34d6 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:23.159188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6fb1be35-35c5-492b-b774-1cb2a8bc34d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:23.319098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1be35-35c5-492b-b774-1cb2a8bc34d6 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:23.324487 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ed268-fd46-49dc-96ea-fdd5dc42dba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:23.325988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ed268-fd46-49dc-96ea-fdd5dc42dba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:23.326425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ed268-fd46-49dc-96ea-fdd5dc42dba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:23.333530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ed268-fd46-49dc-96ea-fdd5dc42dba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:23.335450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ed268-fd46-49dc-96ea-fdd5dc42dba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:23.337446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ed268-fd46-49dc-96ea-fdd5dc42dba0 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:23.340113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dd93e-ce47-4905-8f53-4c0f1a8fa8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:23.340488 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dd93e-ce47-4905-8f53-4c0f1a8fa8de admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:23.340773 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dd93e-ce47-4905-8f53-4c0f1a8fa8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:23.341535 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dd93e-ce47-4905-8f53-4c0f1a8fa8de admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:23.341862 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dd93e-ce47-4905-8f53-4c0f1a8fa8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:23.343554 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dd93e-ce47-4905-8f53-4c0f1a8fa8de admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:23.364154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 855/1705] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:23.365669 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c421cd-50aa-4a43-ab8b-c560a4abdc50 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:23.366156 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c421cd-50aa-4a43-ab8b-c560a4abdc50 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:23.367970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c421cd-50aa-4a43-ab8b-c560a4abdc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:23.376876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 851/1706] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:23.376876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dd93e-ce47-4905-8f53-4c0f1a8fa8de admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:23.415551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dd93e-ce47-4905-8f53-4c0f1a8fa8de admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:23.418785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-79c421cd-50aa-4a43-ab8b-c560a4abdc50 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:23.420268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-79c421cd-50aa-4a43-ab8b-c560a4abdc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:23.432363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030fb93-f435-492e-9763-18c63015a5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:23.433663 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030fb93-f435-492e-9763-18c63015a5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:23.433956 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030fb93-f435-492e-9763-18c63015a5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:23.434699 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030fb93-f435-492e-9763-18c63015a5d8 admin admin] PATH_INFO: `/v3/projects/43179223197641548793880358ca525e/users/0589abc0e5454ddfa99d174b8e6f0389/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:23.447157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 856/1707] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:23.450763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c421cd-50aa-4a43-ab8b-c560a4abdc50 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:23.464113 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c421cd-50aa-4a43-ab8b-c560a4abdc50 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:23.472133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a97b1-bad3-49a5-a3e6-41cd1f056b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:23.473637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a97b1-bad3-49a5-a3e6-41cd1f056b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:23.474382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a97b1-bad3-49a5-a3e6-41cd1f056b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:23.474918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a97b1-bad3-49a5-a3e6-41cd1f056b02 admin admin] PATH_INFO: `/v3/projects/33140bd9bcce4a70aacd02080e32b83c/users/2e1cf4aa83294f2ab27d59f803d73ec7/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:23.480067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030fb93-f435-492e-9763-18c63015a5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43179223197641548793880358ca525e, user_id=0589abc0e5454ddfa99d174b8e6f0389, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:23.488684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030fb93-f435-492e-9763-18c63015a5d8 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:23.501214 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a97b1-bad3-49a5-a3e6-41cd1f056b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33140bd9bcce4a70aacd02080e32b83c, user_id=2e1cf4aa83294f2ab27d59f803d73ec7, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:23.525695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a97b1-bad3-49a5-a3e6-41cd1f056b02 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:23.531013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 852/1708] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:23 2022] PUT /identity/v3/projects/43179223197641548793880358ca525e/users/0589abc0e5454ddfa99d174b8e6f0389/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:23.532393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030fb93-f435-492e-9763-18c63015a5d8 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:23.544561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4030fb93-f435-492e-9763-18c63015a5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:23.551633 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 857/1709] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:23 2022] PUT /identity/v3/projects/33140bd9bcce4a70aacd02080e32b83c/users/2e1cf4aa83294f2ab27d59f803d73ec7/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:23.554664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657d192-eab5-4e84-ab70-023c61ea1e5f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:23.560026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657d192-eab5-4e84-ab70-023c61ea1e5f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:23.560585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657d192-eab5-4e84-ab70-023c61ea1e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:23.607884 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-5657d192-eab5-4e84-ab70-023c61ea1e5f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:23.609416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5657d192-eab5-4e84-ab70-023c61ea1e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:23.784711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030fb93-f435-492e-9763-18c63015a5d8 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:23.857225 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 858/1710] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:23.858820 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab15fdc-8841-4d3d-a477-15087885a1d9 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:23.859373 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab15fdc-8841-4d3d-a477-15087885a1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:23.859934 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab15fdc-8841-4d3d-a477-15087885a1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:23.950858 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-7ab15fdc-8841-4d3d-a477-15087885a1d9 None None] MFA Rules not processed for user `2e1cf4aa83294f2ab27d59f803d73ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:23.961338 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7ab15fdc-8841-4d3d-a477-15087885a1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:24.072030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d4c15-e278-4e42-aac6-164d9a8dcfb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:24.072710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d4c15-e278-4e42-aac6-164d9a8dcfb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:24.072996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d4c15-e278-4e42-aac6-164d9a8dcfb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:24.073272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d4c15-e278-4e42-aac6-164d9a8dcfb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:24.101752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d4c15-e278-4e42-aac6-164d9a8dcfb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:24.103607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d4c15-e278-4e42-aac6-164d9a8dcfb1 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:24.151516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 853/1711] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:24.152459 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d4c15-e278-4e42-aac6-164d9a8dcfb1 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:24.163787 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 859/1712] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:24.164693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab15fdc-8841-4d3d-a477-15087885a1d9 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:24.167428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7ab15fdc-8841-4d3d-a477-15087885a1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:24.181923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d4c15-e278-4e42-aac6-164d9a8dcfb1 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:24.195886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab15fdc-8841-4d3d-a477-15087885a1d9 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:24.206881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c28b1f-c8b4-41c0-9771-a964e37a3b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:24.207551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c28b1f-c8b4-41c0-9771-a964e37a3b95 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:24.207840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c28b1f-c8b4-41c0-9771-a964e37a3b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:24.208224 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c28b1f-c8b4-41c0-9771-a964e37a3b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:24.222780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9d70c-43fa-44d2-b00c-9ecfaaa38381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:24.223726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9d70c-43fa-44d2-b00c-9ecfaaa38381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:24.224154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9d70c-43fa-44d2-b00c-9ecfaaa38381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:24.224274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9d70c-43fa-44d2-b00c-9ecfaaa38381 admin admin] PATH_INFO: `/v3/users/d5e3418592d44074845a1c979e11ef19` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:24.227509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9d70c-43fa-44d2-b00c-9ecfaaa38381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e3418592d44074845a1c979e11ef19)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:24.229509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9d70c-43fa-44d2-b00c-9ecfaaa38381 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:24.244214 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c28b1f-c8b4-41c0-9771-a964e37a3b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:24.249870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c28b1f-c8b4-41c0-9771-a964e37a3b95 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:24.269898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 854/1713] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:24.272287 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c28b1f-c8b4-41c0-9771-a964e37a3b95 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:24.293029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c28b1f-c8b4-41c0-9771-a964e37a3b95 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:24.312028 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f151352-b009-41fe-a89e-e2a35ca9d1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:24.312540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f151352-b009-41fe-a89e-e2a35ca9d1ba admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:24.312819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f151352-b009-41fe-a89e-e2a35ca9d1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:24.313099 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f151352-b009-41fe-a89e-e2a35ca9d1ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:24.322043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f151352-b009-41fe-a89e-e2a35ca9d1ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:24.324221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f151352-b009-41fe-a89e-e2a35ca9d1ba admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:24.436678 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-91e9d70c-43fa-44d2-b00c-9ecfaaa38381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e3418592d44074845a1c979e11ef19'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:24.467296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-91e9d70c-43fa-44d2-b00c-9ecfaaa38381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e3418592d44074845a1c979e11ef19'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:24.470491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-91e9d70c-43fa-44d2-b00c-9ecfaaa38381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e3418592d44074845a1c979e11ef19'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:24.472516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-91e9d70c-43fa-44d2-b00c-9ecfaaa38381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e3418592d44074845a1c979e11ef19'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:24.487817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 855/1714] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:24 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:24.493195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f151352-b009-41fe-a89e-e2a35ca9d1ba admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:24.503644 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7f151352-b009-41fe-a89e-e2a35ca9d1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:24.517658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-91e9d70c-43fa-44d2-b00c-9ecfaaa38381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e3418592d44074845a1c979e11ef19'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:24.563877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 860/1715] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:24 2022] DELETE /identity/v3/users/d5e3418592d44074845a1c979e11ef19 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:24.568443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f91d8-d23b-4af8-8159-af7966735b3b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:24.571220 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f91d8-d23b-4af8-8159-af7966735b3b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:24.571528 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f91d8-d23b-4af8-8159-af7966735b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:24.653781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-237f91d8-d23b-4af8-8159-af7966735b3b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:24.656909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-237f91d8-d23b-4af8-8159-af7966735b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:24.749813 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f151352-b009-41fe-a89e-e2a35ca9d1ba admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:24.907914 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fff71-bc48-4b3b-bad7-02452d9fcc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:24.908969 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fff71-bc48-4b3b-bad7-02452d9fcc67 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:24.909399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fff71-bc48-4b3b-bad7-02452d9fcc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:24.909819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fff71-bc48-4b3b-bad7-02452d9fcc67 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:24.910764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fff71-bc48-4b3b-bad7-02452d9fcc67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:24.915322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fff71-bc48-4b3b-bad7-02452d9fcc67 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:24.955918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 861/1716] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:24.977475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f91d8-d23b-4af8-8159-af7966735b3b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:24.978039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 856/1717] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:24 2022] POST /identity/v3/users => generated 298 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:24.996732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f91d8-d23b-4af8-8159-af7966735b3b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:25.017903 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fff71-bc48-4b3b-bad7-02452d9fcc67 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:25.019931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8e7fff71-bc48-4b3b-bad7-02452d9fcc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:25.024210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f813-12ff-49e9-9297-074fdeeb2ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:25.025297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f813-12ff-49e9-9297-074fdeeb2ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:25.027857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f813-12ff-49e9-9297-074fdeeb2ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:25.029330 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f813-12ff-49e9-9297-074fdeeb2ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:25.031244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0f813-12ff-49e9-9297-074fdeeb2ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:25.035924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0f813-12ff-49e9-9297-074fdeeb2ec4 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:25.073754 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 862/1718] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:42:25.082823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f813-12ff-49e9-9297-074fdeeb2ec4 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:25.117102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f813-12ff-49e9-9297-074fdeeb2ec4 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:25.154507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc23824-f5cd-4a4d-8baf-26ac86f979d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:25.155628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc23824-f5cd-4a4d-8baf-26ac86f979d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:25.156112 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc23824-f5cd-4a4d-8baf-26ac86f979d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:25.156384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc23824-f5cd-4a4d-8baf-26ac86f979d9 admin admin] PATH_INFO: `/v3/projects/77bef4a3e67a4bc28e9aa96833cc61e8/users/1449a9307bfa44d9bc36d71f27a20524/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:25.221759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc23824-f5cd-4a4d-8baf-26ac86f979d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77bef4a3e67a4bc28e9aa96833cc61e8, user_id=1449a9307bfa44d9bc36d71f27a20524, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:25.224472 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc23824-f5cd-4a4d-8baf-26ac86f979d9 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:25.234322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fff71-bc48-4b3b-bad7-02452d9fcc67 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:25.270958 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a3863-bad8-402c-b515-f6301145c7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:25.273149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a3863-bad8-402c-b515-f6301145c7bc service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:25.273597 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a3863-bad8-402c-b515-f6301145c7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:25.282631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a3863-bad8-402c-b515-f6301145c7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:25.316733 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 863/1719] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:25 2022] PUT /identity/v3/projects/77bef4a3e67a4bc28e9aa96833cc61e8/users/1449a9307bfa44d9bc36d71f27a20524/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:25.324874 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc23824-f5cd-4a4d-8baf-26ac86f979d9 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:25.346827 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a3863-bad8-402c-b515-f6301145c7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:25.348263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a3863-bad8-402c-b515-f6301145c7bc service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:25.400306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 857/1720] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:42:25.637056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc23824-f5cd-4a4d-8baf-26ac86f979d9 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:25.644601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cd680-68ea-4d9c-9dcb-474337c087da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:25.645981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd680-68ea-4d9c-9dcb-474337c087da admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:25.646525 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd680-68ea-4d9c-9dcb-474337c087da admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:25.647943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd680-68ea-4d9c-9dcb-474337c087da admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:25.650035 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cd680-68ea-4d9c-9dcb-474337c087da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:25.652235 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cd680-68ea-4d9c-9dcb-474337c087da admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:25.670521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 864/1721] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:25.674802 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a3863-bad8-402c-b515-f6301145c7bc service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:25.685905 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a3863-bad8-402c-b515-f6301145c7bc service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:25.709858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a16c27-e2cf-463e-a19d-8d0edf1ae78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:25.710317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a16c27-e2cf-463e-a19d-8d0edf1ae78c admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:25.710605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a16c27-e2cf-463e-a19d-8d0edf1ae78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:25.710966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a16c27-e2cf-463e-a19d-8d0edf1ae78c admin admin] PATH_INFO: `/v3/projects/77bef4a3e67a4bc28e9aa96833cc61e8/users/1449a9307bfa44d9bc36d71f27a20524/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:25.716009 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a16c27-e2cf-463e-a19d-8d0edf1ae78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=77bef4a3e67a4bc28e9aa96833cc61e8, user_id=1449a9307bfa44d9bc36d71f27a20524, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:25.726876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a16c27-e2cf-463e-a19d-8d0edf1ae78c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:25.771566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 858/1722] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:25 2022] PUT /identity/v3/projects/77bef4a3e67a4bc28e9aa96833cc61e8/users/1449a9307bfa44d9bc36d71f27a20524/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:42:25.783130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cacba2-8971-479a-b6dc-f1b42359cf82 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:25.783529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cacba2-8971-479a-b6dc-f1b42359cf82 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:25.783858 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cacba2-8971-479a-b6dc-f1b42359cf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:25.863852 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-75cacba2-8971-479a-b6dc-f1b42359cf82 None None] MFA Rules not processed for user `1449a9307bfa44d9bc36d71f27a20524`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:25.871170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-75cacba2-8971-479a-b6dc-f1b42359cf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:26.064142 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 865/1723] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:26.072552 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a16c27-e2cf-463e-a19d-8d0edf1ae78c admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:26.074437 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-38a16c27-e2cf-463e-a19d-8d0edf1ae78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:26.249483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a16c27-e2cf-463e-a19d-8d0edf1ae78c admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:26.263106 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93bfb0-e086-4d3f-840e-9af15e2a5b97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:26.264313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93bfb0-e086-4d3f-840e-9af15e2a5b97 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:26.265164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93bfb0-e086-4d3f-840e-9af15e2a5b97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:26.265290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93bfb0-e086-4d3f-840e-9af15e2a5b97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:26.302671 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93bfb0-e086-4d3f-840e-9af15e2a5b97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:26.304846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93bfb0-e086-4d3f-840e-9af15e2a5b97 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:26.355131 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 859/1724] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:26.515441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7def15-a341-44bf-b12e-88d32ecb312b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:26.517981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7def15-a341-44bf-b12e-88d32ecb312b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:26.518512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7def15-a341-44bf-b12e-88d32ecb312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:26.534513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93bfb0-e086-4d3f-840e-9af15e2a5b97 service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:26.535973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-ed93bfb0-e086-4d3f-840e-9af15e2a5b97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:26.560991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-5b7def15-a341-44bf-b12e-88d32ecb312b None None] MFA Rules not processed for user `2fe9f8eb94c84c36ad7a49507b2c8360`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:26.566386 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5b7def15-a341-44bf-b12e-88d32ecb312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:26.625273 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93bfb0-e086-4d3f-840e-9af15e2a5b97 service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:26.630223 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a76ff4-f397-4318-b237-2bbe81db857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:26.638705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a76ff4-f397-4318-b237-2bbe81db857b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:26.639165 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a76ff4-f397-4318-b237-2bbe81db857b admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:26.639600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a76ff4-f397-4318-b237-2bbe81db857b admin admin] PATH_INFO: `/v3/projects/c4efd8af4a564791bc687a04d11ca49c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:26.641080 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a76ff4-f397-4318-b237-2bbe81db857b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4efd8af4a564791bc687a04d11ca49c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:26.643735 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a76ff4-f397-4318-b237-2bbe81db857b admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:26.729155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-88a76ff4-f397-4318-b237-2bbe81db857b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4efd8af4a564791bc687a04d11ca49c', 'request_id': 'req-88a76ff4-f397-4318-b237-2bbe81db857b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:26.746693 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-88a76ff4-f397-4318-b237-2bbe81db857b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4efd8af4a564791bc687a04d11ca49c', 'request_id': 'req-88a76ff4-f397-4318-b237-2bbe81db857b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:26.759723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-88a76ff4-f397-4318-b237-2bbe81db857b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4efd8af4a564791bc687a04d11ca49c', 'request_id': 'req-88a76ff4-f397-4318-b237-2bbe81db857b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:26.764149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 866/1725] 10.222.0.41 () {58 vars in 1015 bytes} [Thu May 5 15:42:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:26.766554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7def15-a341-44bf-b12e-88d32ecb312b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:26.770037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5b7def15-a341-44bf-b12e-88d32ecb312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:26.787070 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-88a76ff4-f397-4318-b237-2bbe81db857b admin admin] The token cache is being invalidate because project c4efd8af4a564791bc687a04d11ca49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:26.787371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-88a76ff4-f397-4318-b237-2bbe81db857b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:26.789347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-88a76ff4-f397-4318-b237-2bbe81db857b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:26.792516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 860/1726] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:26 2022] DELETE /identity/v3/projects/c4efd8af4a564791bc687a04d11ca49c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:26.796720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a76ff4-f397-4318-b237-2bbe81db857b admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:26.798125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7def15-a341-44bf-b12e-88d32ecb312b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:26.799027 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-88a76ff4-f397-4318-b237-2bbe81db857b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:26.915400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3a315-eaa1-4485-bba1-594297c7d818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:26.917166 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3a315-eaa1-4485-bba1-594297c7d818 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:26.917455 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3a315-eaa1-4485-bba1-594297c7d818 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:26.917732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3a315-eaa1-4485-bba1-594297c7d818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:26.922971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-82f3a315-eaa1-4485-bba1-594297c7d818 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:26.967981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a76ff4-f397-4318-b237-2bbe81db857b admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:26.978430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4907a-68ce-4f9d-833c-385175c4182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:26.980591 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4907a-68ce-4f9d-833c-385175c4182e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:26.981540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4907a-68ce-4f9d-833c-385175c4182e admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:26.981830 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4907a-68ce-4f9d-833c-385175c4182e admin admin] PATH_INFO: `/v3/users/b6ed0796fd6b48a98dee6d67e70962a8` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:26.985068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4907a-68ce-4f9d-833c-385175c4182e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ed0796fd6b48a98dee6d67e70962a8)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:26.989749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4907a-68ce-4f9d-833c-385175c4182e admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:27.106636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3a315-eaa1-4485-bba1-594297c7d818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:27.108109 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3a315-eaa1-4485-bba1-594297c7d818 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:27.133576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-fad4907a-68ce-4f9d-833c-385175c4182e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ed0796fd6b48a98dee6d67e70962a8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:27.134965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-fad4907a-68ce-4f9d-833c-385175c4182e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ed0796fd6b48a98dee6d67e70962a8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:27.150072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-fad4907a-68ce-4f9d-833c-385175c4182e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ed0796fd6b48a98dee6d67e70962a8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:27.157295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 867/1727] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:27.159962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3a315-eaa1-4485-bba1-594297c7d818 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:27.165812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-82f3a315-eaa1-4485-bba1-594297c7d818 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:27.167007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-fad4907a-68ce-4f9d-833c-385175c4182e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ed0796fd6b48a98dee6d67e70962a8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:27.168616 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-fad4907a-68ce-4f9d-833c-385175c4182e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ed0796fd6b48a98dee6d67e70962a8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:27.219523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 861/1728] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:26 2022] DELETE /identity/v3/users/b6ed0796fd6b48a98dee6d67e70962a8 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:27.366643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3a315-eaa1-4485-bba1-594297c7d818 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:27.531559 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e2518-7229-4652-8b35-e2b1f357f044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:27.532770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e2518-7229-4652-8b35-e2b1f357f044 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:27.533275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e2518-7229-4652-8b35-e2b1f357f044 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:27.533754 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e2518-7229-4652-8b35-e2b1f357f044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:27.536009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-044e2518-7229-4652-8b35-e2b1f357f044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:27.561124 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e2518-7229-4652-8b35-e2b1f357f044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:27.563055 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e2518-7229-4652-8b35-e2b1f357f044 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:27.574321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 868/1729] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:28.709398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4907a-68ce-4f9d-833c-385175c4182e admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:28.712571 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-fad4907a-68ce-4f9d-833c-385175c4182e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:28.806940 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ea177-618b-47fe-802e-4a5a15155be8 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:28.807555 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ea177-618b-47fe-802e-4a5a15155be8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:28.807555 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ea177-618b-47fe-802e-4a5a15155be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:28.884485 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ff0ea177-618b-47fe-802e-4a5a15155be8 None None] MFA Rules not processed for user `0589abc0e5454ddfa99d174b8e6f0389`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:28.887608 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ff0ea177-618b-47fe-802e-4a5a15155be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:28.988473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4907a-68ce-4f9d-833c-385175c4182e admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:29.009729 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45188c4f-65b5-469f-8961-e2906dfa8f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:29.010696 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45188c4f-65b5-469f-8961-e2906dfa8f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:29.010978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45188c4f-65b5-469f-8961-e2906dfa8f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:29.011258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45188c4f-65b5-469f-8961-e2906dfa8f94 admin admin] PATH_INFO: `/v3/projects/11c3095cbbb147aeba1bb605cd0592f9` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:29.015713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45188c4f-65b5-469f-8961-e2906dfa8f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c3095cbbb147aeba1bb605cd0592f9)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:29.020886 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45188c4f-65b5-469f-8961-e2906dfa8f94 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:29.175228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 869/1730] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:42:29.179589 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-45188c4f-65b5-469f-8961-e2906dfa8f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c3095cbbb147aeba1bb605cd0592f9', 'request_id': 'req-45188c4f-65b5-469f-8961-e2906dfa8f94'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:29.183885 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ea177-618b-47fe-802e-4a5a15155be8 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:29.189230 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-45188c4f-65b5-469f-8961-e2906dfa8f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c3095cbbb147aeba1bb605cd0592f9', 'request_id': 'req-45188c4f-65b5-469f-8961-e2906dfa8f94'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:29.190420 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ff0ea177-618b-47fe-802e-4a5a15155be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:29.206515 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-45188c4f-65b5-469f-8961-e2906dfa8f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c3095cbbb147aeba1bb605cd0592f9', 'request_id': 'req-45188c4f-65b5-469f-8961-e2906dfa8f94'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:29.233917 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-45188c4f-65b5-469f-8961-e2906dfa8f94 admin admin] The token cache is being invalidate because project 11c3095cbbb147aeba1bb605cd0592f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:29.234395 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-45188c4f-65b5-469f-8961-e2906dfa8f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:29.235958 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-45188c4f-65b5-469f-8961-e2906dfa8f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:29.241642 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 862/1731] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:28 2022] DELETE /identity/v3/projects/11c3095cbbb147aeba1bb605cd0592f9 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:29.243241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dc56b-aa71-4b54-8c1b-71598d921742 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:29.243648 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dc56b-aa71-4b54-8c1b-71598d921742 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:29.244040 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dc56b-aa71-4b54-8c1b-71598d921742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:29.246675 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ea177-618b-47fe-802e-4a5a15155be8 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:29.283714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-9b3dc56b-aa71-4b54-8c1b-71598d921742 None None] MFA Rules not processed for user `e2e0f15742ea49bba055538ae4e99303`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:29.285196 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9b3dc56b-aa71-4b54-8c1b-71598d921742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:29.430203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e04f79-ab47-43c2-af40-b328d1d4184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:29.430952 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e04f79-ab47-43c2-af40-b328d1d4184b admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:29.431300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e04f79-ab47-43c2-af40-b328d1d4184b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:29.431930 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e04f79-ab47-43c2-af40-b328d1d4184b admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:29.436950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e04f79-ab47-43c2-af40-b328d1d4184b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:29.439382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e04f79-ab47-43c2-af40-b328d1d4184b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:29.490349 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 863/1732] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:29.516819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15412b2c-e774-422b-ba0d-a029ac8c4c20 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:29.528508 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15412b2c-e774-422b-ba0d-a029ac8c4c20 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:29.528926 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15412b2c-e774-422b-ba0d-a029ac8c4c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:29.533154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 870/1733] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:29 2022] POST /identity/v3/projects => generated 405 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:29.537661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e04f79-ab47-43c2-af40-b328d1d4184b admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:29.555053 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-86e04f79-ab47-43c2-af40-b328d1d4184b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:29.595272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-15412b2c-e774-422b-ba0d-a029ac8c4c20 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:29.601169 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-15412b2c-e774-422b-ba0d-a029ac8c4c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:29.749400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e04f79-ab47-43c2-af40-b328d1d4184b admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:29.755443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6df5ff-e791-41db-b50b-517e074e4bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:29.757157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6df5ff-e791-41db-b50b-517e074e4bdc admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:29.758391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6df5ff-e791-41db-b50b-517e074e4bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:29.758716 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6df5ff-e791-41db-b50b-517e074e4bdc admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:29.759476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6df5ff-e791-41db-b50b-517e074e4bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:29.762201 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6df5ff-e791-41db-b50b-517e074e4bdc admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:29.799471 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 871/1734] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:29 2022] POST /identity/v3/users => generated 309 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:29.801650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6df5ff-e791-41db-b50b-517e074e4bdc admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:29.823365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6df5ff-e791-41db-b50b-517e074e4bdc admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:29.833639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7adc24-9432-4baa-a2d9-cea0544107f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:29.834449 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7adc24-9432-4baa-a2d9-cea0544107f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:29.834793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7adc24-9432-4baa-a2d9-cea0544107f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:29.835265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7adc24-9432-4baa-a2d9-cea0544107f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:29.836172 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7adc24-9432-4baa-a2d9-cea0544107f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:29.838055 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7adc24-9432-4baa-a2d9-cea0544107f1 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:29.858261 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 872/1735] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:29.862299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7adc24-9432-4baa-a2d9-cea0544107f1 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:29.876409 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7adc24-9432-4baa-a2d9-cea0544107f1 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:29.877956 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 864/1736] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:29.887434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc84aa6-9b7c-40d3-b6a6-eeb070b3d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:29.887637 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc61211-ee4b-47eb-a31f-f8a27a7d661f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:29.887941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc61211-ee4b-47eb-a31f-f8a27a7d661f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:29.888212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc61211-ee4b-47eb-a31f-f8a27a7d661f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:29.888615 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc84aa6-9b7c-40d3-b6a6-eeb070b3d313 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:29.888986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc84aa6-9b7c-40d3-b6a6-eeb070b3d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:29.889447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc84aa6-9b7c-40d3-b6a6-eeb070b3d313 admin admin] PATH_INFO: `/v3/projects/395cbd3ca7164ae08bf8c843c0700258/users/a5afa06d77b147f69ff1628691c20a08/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:29.923930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-7fc61211-ee4b-47eb-a31f-f8a27a7d661f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:29.926931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7fc61211-ee4b-47eb-a31f-f8a27a7d661f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:29.927526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc84aa6-9b7c-40d3-b6a6-eeb070b3d313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395cbd3ca7164ae08bf8c843c0700258, user_id=a5afa06d77b147f69ff1628691c20a08, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:29.938825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc84aa6-9b7c-40d3-b6a6-eeb070b3d313 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:29.953408 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 865/1737] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:29.956923 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 873/1738] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:29 2022] PUT /identity/v3/projects/395cbd3ca7164ae08bf8c843c0700258/users/a5afa06d77b147f69ff1628691c20a08/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:29.958113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc61211-ee4b-47eb-a31f-f8a27a7d661f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:29.962420 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc84aa6-9b7c-40d3-b6a6-eeb070b3d313 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:29.973018 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc61211-ee4b-47eb-a31f-f8a27a7d661f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:30.043738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940fdad-7bf1-453a-aebf-d66cf00645c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:30.045002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940fdad-7bf1-453a-aebf-d66cf00645c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:30.045607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940fdad-7bf1-453a-aebf-d66cf00645c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:30.046104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940fdad-7bf1-453a-aebf-d66cf00645c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:30.047093 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940fdad-7bf1-453a-aebf-d66cf00645c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:30.047635 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940fdad-7bf1-453a-aebf-d66cf00645c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:30.049791 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940fdad-7bf1-453a-aebf-d66cf00645c1 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:30.064797 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 866/1739] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:30.069054 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940fdad-7bf1-453a-aebf-d66cf00645c1 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:30.085046 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940fdad-7bf1-453a-aebf-d66cf00645c1 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:30.093120 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8b30c-c903-4777-a984-b5c3cfd79fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:30.094306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8b30c-c903-4777-a984-b5c3cfd79fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:30.094966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8b30c-c903-4777-a984-b5c3cfd79fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:30.095361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8b30c-c903-4777-a984-b5c3cfd79fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:30.096402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8b30c-c903-4777-a984-b5c3cfd79fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:30.098709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8b30c-c903-4777-a984-b5c3cfd79fcb admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:30.106674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc84aa6-9b7c-40d3-b6a6-eeb070b3d313 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:30.111951 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0698d1-7e12-4fc4-a681-4630c683ea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:30.113458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0698d1-7e12-4fc4-a681-4630c683ea70 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:30.113761 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0698d1-7e12-4fc4-a681-4630c683ea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:30.114047 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0698d1-7e12-4fc4-a681-4630c683ea70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:30.114842 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0698d1-7e12-4fc4-a681-4630c683ea70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:30.116874 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0698d1-7e12-4fc4-a681-4630c683ea70 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:30.132939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 874/1740] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:30.137523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0698d1-7e12-4fc4-a681-4630c683ea70 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:30.139536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 867/1741] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:30 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:42:30.143561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8b30c-c903-4777-a984-b5c3cfd79fcb admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:30.164907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0698d1-7e12-4fc4-a681-4630c683ea70 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:30.283363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8b30c-c903-4777-a984-b5c3cfd79fcb admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:30.290949 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d45b1-e3aa-47c6-bc1b-59c44f536833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:30.291968 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d45b1-e3aa-47c6-bc1b-59c44f536833 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:30.292625 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d45b1-e3aa-47c6-bc1b-59c44f536833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:30.293170 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d45b1-e3aa-47c6-bc1b-59c44f536833 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:30.294102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d45b1-e3aa-47c6-bc1b-59c44f536833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:30.298407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d45b1-e3aa-47c6-bc1b-59c44f536833 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:30.365346 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 868/1742] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:30 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:30.367405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d45b1-e3aa-47c6-bc1b-59c44f536833 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:30.369450 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7a5d45b1-e3aa-47c6-bc1b-59c44f536833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:30.387665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d45b1-e3aa-47c6-bc1b-59c44f536833 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:30.393807 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29da1c4-2a99-4a74-96ae-ab84a3ae1f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:30.395305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29da1c4-2a99-4a74-96ae-ab84a3ae1f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:30.396188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29da1c4-2a99-4a74-96ae-ab84a3ae1f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:30.396680 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29da1c4-2a99-4a74-96ae-ab84a3ae1f58 admin admin] PATH_INFO: `/v3/projects/b101f36eeee74a099958b4fd8cd3da3a` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:30.398807 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29da1c4-2a99-4a74-96ae-ab84a3ae1f58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b101f36eeee74a099958b4fd8cd3da3a)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:30.398933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58a2ab-b892-4101-ac1c-2e2a82d48acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:30.399769 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58a2ab-b892-4101-ac1c-2e2a82d48acf admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:30.400049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58a2ab-b892-4101-ac1c-2e2a82d48acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:30.401578 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29da1c4-2a99-4a74-96ae-ab84a3ae1f58 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:30.403520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58a2ab-b892-4101-ac1c-2e2a82d48acf admin admin] PATH_INFO: `/v3/projects/395cbd3ca7164ae08bf8c843c0700258/users/a5afa06d77b147f69ff1628691c20a08/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:30.414012 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58a2ab-b892-4101-ac1c-2e2a82d48acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=395cbd3ca7164ae08bf8c843c0700258, user_id=a5afa06d77b147f69ff1628691c20a08, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:30.426780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58a2ab-b892-4101-ac1c-2e2a82d48acf admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:30.462611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 875/1743] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:30 2022] PUT /identity/v3/projects/395cbd3ca7164ae08bf8c843c0700258/users/a5afa06d77b147f69ff1628691c20a08/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:30.463608 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58a2ab-b892-4101-ac1c-2e2a82d48acf admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:30.587042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e29da1c4-2a99-4a74-96ae-ab84a3ae1f58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b101f36eeee74a099958b4fd8cd3da3a', 'request_id': 'req-e29da1c4-2a99-4a74-96ae-ab84a3ae1f58'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:30.608878 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e29da1c4-2a99-4a74-96ae-ab84a3ae1f58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b101f36eeee74a099958b4fd8cd3da3a', 'request_id': 'req-e29da1c4-2a99-4a74-96ae-ab84a3ae1f58'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:30.625434 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e29da1c4-2a99-4a74-96ae-ab84a3ae1f58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b101f36eeee74a099958b4fd8cd3da3a', 'request_id': 'req-e29da1c4-2a99-4a74-96ae-ab84a3ae1f58'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:30.678017 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e29da1c4-2a99-4a74-96ae-ab84a3ae1f58 admin admin] The token cache is being invalidate because project b101f36eeee74a099958b4fd8cd3da3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:30.678393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e29da1c4-2a99-4a74-96ae-ab84a3ae1f58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:30.686458 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e29da1c4-2a99-4a74-96ae-ab84a3ae1f58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:30.707972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58a2ab-b892-4101-ac1c-2e2a82d48acf admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:30.726837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 869/1744] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:30 2022] DELETE /identity/v3/projects/b101f36eeee74a099958b4fd8cd3da3a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:30.734577 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d5d1f-6b9c-48a4-801e-851e168f67c5 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:30.734853 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d5d1f-6b9c-48a4-801e-851e168f67c5 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:30.737461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d5d1f-6b9c-48a4-801e-851e168f67c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:30.828411 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-360d5d1f-6b9c-48a4-801e-851e168f67c5 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:30.833286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-360d5d1f-6b9c-48a4-801e-851e168f67c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:30.876504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba8919-42bf-4930-85c7-0edb6b81b6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:30.877236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba8919-42bf-4930-85c7-0edb6b81b6bd admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:30.877593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba8919-42bf-4930-85c7-0edb6b81b6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:30.877866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba8919-42bf-4930-85c7-0edb6b81b6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:30.878741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba8919-42bf-4930-85c7-0edb6b81b6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:30.881247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba8919-42bf-4930-85c7-0edb6b81b6bd admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:30.898122 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 876/1745] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:30.899154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba8919-42bf-4930-85c7-0edb6b81b6bd admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:30.901216 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c7ba8919-42bf-4930-85c7-0edb6b81b6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:30.928720 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba8919-42bf-4930-85c7-0edb6b81b6bd admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:30.936136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f2c0a-7c8c-4814-833b-540ce935f352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:30.937322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f2c0a-7c8c-4814-833b-540ce935f352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:30.937755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f2c0a-7c8c-4814-833b-540ce935f352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:30.938192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f2c0a-7c8c-4814-833b-540ce935f352 admin admin] PATH_INFO: `/v3/users/2e1cf4aa83294f2ab27d59f803d73ec7` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:30.940213 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f2c0a-7c8c-4814-833b-540ce935f352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1cf4aa83294f2ab27d59f803d73ec7)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:30.946820 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f2c0a-7c8c-4814-833b-540ce935f352 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:30.953243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 870/1746] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:30.954831 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d5d1f-6b9c-48a4-801e-851e168f67c5 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:30.957984 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-360d5d1f-6b9c-48a4-801e-851e168f67c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:30.993826 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d5d1f-6b9c-48a4-801e-851e168f67c5 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:30.999751 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8dade-c1dc-4f2a-8d6c-d63c4edd3d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:31.000633 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8dade-c1dc-4f2a-8d6c-d63c4edd3d4a admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:31.001061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8dade-c1dc-4f2a-8d6c-d63c4edd3d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:31.001258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8dade-c1dc-4f2a-8d6c-d63c4edd3d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:31.001982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8dade-c1dc-4f2a-8d6c-d63c4edd3d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:31.003712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8dade-c1dc-4f2a-8d6c-d63c4edd3d4a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:31.024014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 871/1747] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:31.028731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3237-d9b0-4858-9684-18679e37602f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:31.028731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3237-d9b0-4858-9684-18679e37602f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:31.028731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3237-d9b0-4858-9684-18679e37602f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:31.041060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f88f2c0a-7c8c-4814-833b-540ce935f352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1cf4aa83294f2ab27d59f803d73ec7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:31.056098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-a8dd3237-d9b0-4858-9684-18679e37602f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:31.057679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-a8dd3237-d9b0-4858-9684-18679e37602f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:31.067090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f88f2c0a-7c8c-4814-833b-540ce935f352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1cf4aa83294f2ab27d59f803d73ec7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:31.068307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f88f2c0a-7c8c-4814-833b-540ce935f352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1cf4aa83294f2ab27d59f803d73ec7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:31.070406 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 872/1748] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:31.071411 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f88f2c0a-7c8c-4814-833b-540ce935f352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1cf4aa83294f2ab27d59f803d73ec7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:31.071996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd3237-d9b0-4858-9684-18679e37602f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:31.085605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd3237-d9b0-4858-9684-18679e37602f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:31.089882 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f88f2c0a-7c8c-4814-833b-540ce935f352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1cf4aa83294f2ab27d59f803d73ec7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:31.095912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265a574-4ca7-454a-8654-f67ab7808062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:31.097186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265a574-4ca7-454a-8654-f67ab7808062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:31.097558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265a574-4ca7-454a-8654-f67ab7808062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:31.097965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265a574-4ca7-454a-8654-f67ab7808062 admin admin] PATH_INFO: `/v3/projects/159d2ed280ad49ed8f5d1b04c32aeac9/users/6655514d2cb941738e0dbe24b366814a/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:31.118273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 877/1749] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:30 2022] DELETE /identity/v3/users/2e1cf4aa83294f2ab27d59f803d73ec7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:31.123325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f2c0a-7c8c-4814-833b-540ce935f352 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:31.130708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265a574-4ca7-454a-8654-f67ab7808062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=159d2ed280ad49ed8f5d1b04c32aeac9, user_id=6655514d2cb941738e0dbe24b366814a, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:31.132729 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f88f2c0a-7c8c-4814-833b-540ce935f352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:31.135138 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265a574-4ca7-454a-8654-f67ab7808062 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:31.161720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 873/1750] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:31 2022] PUT /identity/v3/projects/159d2ed280ad49ed8f5d1b04c32aeac9/users/6655514d2cb941738e0dbe24b366814a/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:31.164461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c842f-a1ca-4ced-959c-b5660c371ae1 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:31.165039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c842f-a1ca-4ced-959c-b5660c371ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:31.165516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c842f-a1ca-4ced-959c-b5660c371ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:31.192945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-9c7c842f-a1ca-4ced-959c-b5660c371ae1 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:31.195542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9c7c842f-a1ca-4ced-959c-b5660c371ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:31.301981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 874/1751] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:31.301981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaf3d7-1d46-4368-a9a9-f061855f5fa1 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:31.301981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaf3d7-1d46-4368-a9a9-f061855f5fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:31.302295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaf3d7-1d46-4368-a9a9-f061855f5fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:31.340861 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-65eaf3d7-1d46-4368-a9a9-f061855f5fa1 None None] MFA Rules not processed for user `6655514d2cb941738e0dbe24b366814a`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:31.342346 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-65eaf3d7-1d46-4368-a9a9-f061855f5fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:31.408112 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f2c0a-7c8c-4814-833b-540ce935f352 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:31.420790 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906adf3-ac5d-4435-bf10-aad03c4bd83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:31.421478 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906adf3-ac5d-4435-bf10-aad03c4bd83b admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:31.421758 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906adf3-ac5d-4435-bf10-aad03c4bd83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:31.422030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906adf3-ac5d-4435-bf10-aad03c4bd83b admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:31.423325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906adf3-ac5d-4435-bf10-aad03c4bd83b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:31.431479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906adf3-ac5d-4435-bf10-aad03c4bd83b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:31.434252 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 875/1752] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:31.434252 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eaf3d7-1d46-4368-a9a9-f061855f5fa1 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:31.434472 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906adf3-ac5d-4435-bf10-aad03c4bd83b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:31.437001 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-65eaf3d7-1d46-4368-a9a9-f061855f5fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:31.471765 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 878/1753] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:31.474506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906adf3-ac5d-4435-bf10-aad03c4bd83b admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:31.479618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9906adf3-ac5d-4435-bf10-aad03c4bd83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:31.512851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906adf3-ac5d-4435-bf10-aad03c4bd83b admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:31.518997 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50074cf-e5b0-434c-8772-628d14bbb6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:31.519771 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50074cf-e5b0-434c-8772-628d14bbb6eb admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:31.520196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50074cf-e5b0-434c-8772-628d14bbb6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:31.520560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50074cf-e5b0-434c-8772-628d14bbb6eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:31.521743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50074cf-e5b0-434c-8772-628d14bbb6eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:31.524625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50074cf-e5b0-434c-8772-628d14bbb6eb admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:31.560095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eaf3d7-1d46-4368-a9a9-f061855f5fa1 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:31.574461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2351f-d837-4746-af27-ae8771ac83d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:31.575394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2351f-d837-4746-af27-ae8771ac83d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:31.575883 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2351f-d837-4746-af27-ae8771ac83d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:31.576353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2351f-d837-4746-af27-ae8771ac83d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:31.606040 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2351f-d837-4746-af27-ae8771ac83d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:31.607863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 879/1754] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:31 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:31.610826 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2351f-d837-4746-af27-ae8771ac83d9 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:31.611966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50074cf-e5b0-434c-8772-628d14bbb6eb admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:31.639002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 876/1755] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:31.640005 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2351f-d837-4746-af27-ae8771ac83d9 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:31.659394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2351f-d837-4746-af27-ae8771ac83d9 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:31.814099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50074cf-e5b0-434c-8772-628d14bbb6eb admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:31.824123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e2723-9260-48ba-a978-a3454c36a467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:31.850498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e2723-9260-48ba-a978-a3454c36a467 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:31.850498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e2723-9260-48ba-a978-a3454c36a467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:31.850498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e2723-9260-48ba-a978-a3454c36a467 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:31.850498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e2723-9260-48ba-a978-a3454c36a467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:31.850498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e2723-9260-48ba-a978-a3454c36a467 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:31.863236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0356eeb-e86e-4c10-a78c-dd6ee82d1de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:31.864095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0356eeb-e86e-4c10-a78c-dd6ee82d1de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:31.864508 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0356eeb-e86e-4c10-a78c-dd6ee82d1de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:31.865038 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0356eeb-e86e-4c10-a78c-dd6ee82d1de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:31.865897 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0356eeb-e86e-4c10-a78c-dd6ee82d1de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:31.868119 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0356eeb-e86e-4c10-a78c-dd6ee82d1de1 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:31.906140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 877/1756] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:31 2022] POST /identity/v3/users => generated 296 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:31.910101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e2723-9260-48ba-a978-a3454c36a467 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:31.922596 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 880/1757] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:31 2022] POST /identity/v3/projects => generated 361 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:31.929434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0356eeb-e86e-4c10-a78c-dd6ee82d1de1 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:31.963781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e2723-9260-48ba-a978-a3454c36a467 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:32.167037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0356eeb-e86e-4c10-a78c-dd6ee82d1de1 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:32.182318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8c16b-5ef8-4497-bf28-d2308c167cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:32.183132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8c16b-5ef8-4497-bf28-d2308c167cef admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:32.187859 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8c16b-5ef8-4497-bf28-d2308c167cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:32.188287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8c16b-5ef8-4497-bf28-d2308c167cef admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:32.190056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8c16b-5ef8-4497-bf28-d2308c167cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:32.193841 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8c16b-5ef8-4497-bf28-d2308c167cef admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:32.246424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee519249-15da-434b-a48e-fa1f615486b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:32.249667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee519249-15da-434b-a48e-fa1f615486b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:32.250043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee519249-15da-434b-a48e-fa1f615486b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:32.250301 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee519249-15da-434b-a48e-fa1f615486b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:32.253646 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee519249-15da-434b-a48e-fa1f615486b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:32.260918 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee519249-15da-434b-a48e-fa1f615486b4 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:32.282467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 881/1758] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:31 2022] POST /identity/v3/users => generated 281 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:32.287233 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c70f1b-fbd1-422f-85b5-2ad08d8abece None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:32.290203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c70f1b-fbd1-422f-85b5-2ad08d8abece None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:32.292915 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c70f1b-fbd1-422f-85b5-2ad08d8abece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:32.313447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 878/1759] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:32.313447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee519249-15da-434b-a48e-fa1f615486b4 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:32.351822 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee519249-15da-434b-a48e-fa1f615486b4 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:32.379145 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710a278-b526-4992-9765-20ef6d7bf310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:32.380028 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710a278-b526-4992-9765-20ef6d7bf310 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:32.380541 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710a278-b526-4992-9765-20ef6d7bf310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:32.380763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710a278-b526-4992-9765-20ef6d7bf310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:32.382159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710a278-b526-4992-9765-20ef6d7bf310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:32.384363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710a278-b526-4992-9765-20ef6d7bf310 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:32.411312 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-22c70f1b-fbd1-422f-85b5-2ad08d8abece None None] MFA Rules not processed for user `1b9eeed01d41446986dbf37c15ee4e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:32.413094 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-22c70f1b-fbd1-422f-85b5-2ad08d8abece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:32.433925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 879/1760] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:32.434853 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710a278-b526-4992-9765-20ef6d7bf310 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:32.469469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710a278-b526-4992-9765-20ef6d7bf310 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:32.499209 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454e0b4-cd60-4e18-a1eb-9376d2e5e87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:32.500127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454e0b4-cd60-4e18-a1eb-9376d2e5e87e admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:32.500424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454e0b4-cd60-4e18-a1eb-9376d2e5e87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:32.500802 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454e0b4-cd60-4e18-a1eb-9376d2e5e87e admin admin] PATH_INFO: `/v3/projects/ddc93d652b4948a283a6bbbac5951984/users/ac31b021edf4434f804c9561269c497c/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:32.551124 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454e0b4-cd60-4e18-a1eb-9376d2e5e87e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc93d652b4948a283a6bbbac5951984, user_id=ac31b021edf4434f804c9561269c497c, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:32.553849 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454e0b4-cd60-4e18-a1eb-9376d2e5e87e admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:32.605340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 880/1761] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:32 2022] PUT /identity/v3/projects/ddc93d652b4948a283a6bbbac5951984/users/ac31b021edf4434f804c9561269c497c/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:32.606388 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454e0b4-cd60-4e18-a1eb-9376d2e5e87e admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:32.665833 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 882/1762] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:32.667916 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fd275-7b9e-4878-98f5-d3e9f8b8aa6b None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:32.670750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fd275-7b9e-4878-98f5-d3e9f8b8aa6b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:32.671263 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fd275-7b9e-4878-98f5-d3e9f8b8aa6b None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:32.676437 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 883/1763] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 5 15:42:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:42:32.677622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fd275-7b9e-4878-98f5-d3e9f8b8aa6b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:32.857372 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454e0b4-cd60-4e18-a1eb-9376d2e5e87e admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:32.864065 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf689a6-353e-4050-86d7-9590530ecae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:32.864985 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf689a6-353e-4050-86d7-9590530ecae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:32.865372 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf689a6-353e-4050-86d7-9590530ecae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:32.866326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf689a6-353e-4050-86d7-9590530ecae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:32.867327 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf689a6-353e-4050-86d7-9590530ecae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:32.869498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf689a6-353e-4050-86d7-9590530ecae2 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:32.885728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 881/1764] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:32.885728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468f38b-f2e1-4452-a95c-6512ecb8c475 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:32.885728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468f38b-f2e1-4452-a95c-6512ecb8c475 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:32.885728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468f38b-f2e1-4452-a95c-6512ecb8c475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:32.913131 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-b468f38b-f2e1-4452-a95c-6512ecb8c475 None None] MFA Rules not processed for user `2a29a4b1b1aa45aea2e466d8f8b79365`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:32.915102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b468f38b-f2e1-4452-a95c-6512ecb8c475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:32.950924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fd275-7b9e-4878-98f5-d3e9f8b8aa6b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:32.965143 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88babc43-be8c-4a62-895f-dcbd35b520c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:32.966135 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88babc43-be8c-4a62-895f-dcbd35b520c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:32.966618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88babc43-be8c-4a62-895f-dcbd35b520c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:32.967065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88babc43-be8c-4a62-895f-dcbd35b520c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:32.968648 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88babc43-be8c-4a62-895f-dcbd35b520c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:32.975919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88babc43-be8c-4a62-895f-dcbd35b520c4 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:33.007414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 884/1765] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:33.008759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88babc43-be8c-4a62-895f-dcbd35b520c4 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:33.035434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88babc43-be8c-4a62-895f-dcbd35b520c4 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:33.046683 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec98b60-dc1b-4654-b602-ab07f6ca3635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:33.052685 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec98b60-dc1b-4654-b602-ab07f6ca3635 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:33.053661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec98b60-dc1b-4654-b602-ab07f6ca3635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:33.054049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec98b60-dc1b-4654-b602-ab07f6ca3635 admin admin] PATH_INFO: `/v3/projects/6c15ae698bda4a2c8d665821ec74c601/users/a2ba8cc0ff5d447c8d5bf927de4583f3/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:33.104274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec98b60-dc1b-4654-b602-ab07f6ca3635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c15ae698bda4a2c8d665821ec74c601, user_id=a2ba8cc0ff5d447c8d5bf927de4583f3, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:33.109165 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec98b60-dc1b-4654-b602-ab07f6ca3635 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:33.127063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 882/1766] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 5 15:42:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:33.128857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468f38b-f2e1-4452-a95c-6512ecb8c475 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:33.130128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 885/1767] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:33 2022] PUT /identity/v3/projects/6c15ae698bda4a2c8d665821ec74c601/users/a2ba8cc0ff5d447c8d5bf927de4583f3/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:33.132376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec98b60-dc1b-4654-b602-ab07f6ca3635 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:33.141632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-eec98b60-dc1b-4654-b602-ab07f6ca3635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:33.175942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468f38b-f2e1-4452-a95c-6512ecb8c475 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:33.288674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec98b60-dc1b-4654-b602-ab07f6ca3635 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:33.307217 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6684fb-e66b-49c9-be21-131f4a936818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:33.310787 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6684fb-e66b-49c9-be21-131f4a936818 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:33.311789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6684fb-e66b-49c9-be21-131f4a936818 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:33.312356 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6684fb-e66b-49c9-be21-131f4a936818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:33.377245 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a893bac-5581-4933-bccf-b184e02bce4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:33.378373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a893bac-5581-4933-bccf-b184e02bce4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:33.378854 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a893bac-5581-4933-bccf-b184e02bce4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:33.379299 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a893bac-5581-4933-bccf-b184e02bce4d admin admin] PATH_INFO: `/v3/projects/ddc93d652b4948a283a6bbbac5951984/users/ac31b021edf4434f804c9561269c497c/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:33.390008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a893bac-5581-4933-bccf-b184e02bce4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc93d652b4948a283a6bbbac5951984, user_id=ac31b021edf4434f804c9561269c497c, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:33.393190 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a893bac-5581-4933-bccf-b184e02bce4d admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:33.419994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 883/1768] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:33 2022] PUT /identity/v3/projects/ddc93d652b4948a283a6bbbac5951984/users/ac31b021edf4434f804c9561269c497c/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:33.422433 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e06a4-3a6b-4309-a1ac-62b5e557794b None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:33.433796 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e06a4-3a6b-4309-a1ac-62b5e557794b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:33.434527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e06a4-3a6b-4309-a1ac-62b5e557794b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:33.517298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6684fb-e66b-49c9-be21-131f4a936818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:33.518506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-f60e06a4-3a6b-4309-a1ac-62b5e557794b None None] MFA Rules not processed for user `a2ba8cc0ff5d447c8d5bf927de4583f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:33.519912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-f60e06a4-3a6b-4309-a1ac-62b5e557794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:33.523648 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6684fb-e66b-49c9-be21-131f4a936818 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:33.539097 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 886/1769] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:33.542126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b56d45-5ec5-40e1-8372-4950fb037ecb None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:33.542553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b56d45-5ec5-40e1-8372-4950fb037ecb None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:33.544283 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b56d45-5ec5-40e1-8372-4950fb037ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:33.622702 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f9b56d45-5ec5-40e1-8372-4950fb037ecb None None] MFA Rules not processed for user `ac31b021edf4434f804c9561269c497c`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:33.634751 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f9b56d45-5ec5-40e1-8372-4950fb037ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:33.679373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 884/1770] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:33.683770 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e06a4-3a6b-4309-a1ac-62b5e557794b None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:33.805952 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 887/1771] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:33.831503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e06a4-3a6b-4309-a1ac-62b5e557794b None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:33.833225 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b56d45-5ec5-40e1-8372-4950fb037ecb None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:33.835549 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f9b56d45-5ec5-40e1-8372-4950fb037ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:33.845162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087018c-f37a-45af-8faf-ed7683c28ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:33.845851 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087018c-f37a-45af-8faf-ed7683c28ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:33.846137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087018c-f37a-45af-8faf-ed7683c28ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:33.846443 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087018c-f37a-45af-8faf-ed7683c28ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:33.847141 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087018c-f37a-45af-8faf-ed7683c28ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:33.849432 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087018c-f37a-45af-8faf-ed7683c28ee8 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:33.907540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 885/1772] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:33 2022] POST /identity/v3/projects => generated 365 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:33.908512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087018c-f37a-45af-8faf-ed7683c28ee8 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:33.996566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b56d45-5ec5-40e1-8372-4950fb037ecb None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:34.081868 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087018c-f37a-45af-8faf-ed7683c28ee8 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:34.097710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3e39f-c83e-467b-bb2c-5a1b65aebcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:34.098439 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3e39f-c83e-467b-bb2c-5a1b65aebcf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:34.098789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3e39f-c83e-467b-bb2c-5a1b65aebcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:34.099137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3e39f-c83e-467b-bb2c-5a1b65aebcf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:34.099908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3e39f-c83e-467b-bb2c-5a1b65aebcf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:34.102592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3e39f-c83e-467b-bb2c-5a1b65aebcf4 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:34.117906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacd15d-eb12-4c60-b791-0a0592a9f338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:34.120243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacd15d-eb12-4c60-b791-0a0592a9f338 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:34.120530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacd15d-eb12-4c60-b791-0a0592a9f338 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:34.120802 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacd15d-eb12-4c60-b791-0a0592a9f338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:34.154950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 886/1773] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:33 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:42:34.157161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3e39f-c83e-467b-bb2c-5a1b65aebcf4 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:34.161007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-21b3e39f-c83e-467b-bb2c-5a1b65aebcf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:34.276155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacd15d-eb12-4c60-b791-0a0592a9f338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:34.280461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacd15d-eb12-4c60-b791-0a0592a9f338 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:34.300789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 888/1774] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:34.314208 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacd15d-eb12-4c60-b791-0a0592a9f338 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:34.354186 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacd15d-eb12-4c60-b791-0a0592a9f338 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:34.362284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3e39f-c83e-467b-bb2c-5a1b65aebcf4 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:34.370031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6639d8-c249-42c4-8685-1d9ff32d3e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:34.370748 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6639d8-c249-42c4-8685-1d9ff32d3e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:34.371179 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6639d8-c249-42c4-8685-1d9ff32d3e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:34.371398 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6639d8-c249-42c4-8685-1d9ff32d3e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:34.372207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6639d8-c249-42c4-8685-1d9ff32d3e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:34.373839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6639d8-c249-42c4-8685-1d9ff32d3e07 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:34.386695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c55e8-e1a4-497f-b871-adc713ee88e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:34.387924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c55e8-e1a4-497f-b871-adc713ee88e6 service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:34.388209 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c55e8-e1a4-497f-b871-adc713ee88e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:34.388486 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c55e8-e1a4-497f-b871-adc713ee88e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:34.443649 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c55e8-e1a4-497f-b871-adc713ee88e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:34.445501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c55e8-e1a4-497f-b871-adc713ee88e6 service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:34.446189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 889/1775] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:34.447392 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6639d8-c249-42c4-8685-1d9ff32d3e07 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:34.485864 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 887/1776] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:34.487062 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6639d8-c249-42c4-8685-1d9ff32d3e07 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:34.504243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc633f-4536-48c2-b6ca-5eb5b07e6ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:34.505157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc633f-4536-48c2-b6ca-5eb5b07e6ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:34.505438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc633f-4536-48c2-b6ca-5eb5b07e6ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:34.505715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc633f-4536-48c2-b6ca-5eb5b07e6ec9 admin admin] PATH_INFO: `/v3/projects/907b4fc098974bd091c622da82a52a82/users/9d2dcfe5a0b74814a1ba51ec2505e193/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:34.563898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc633f-4536-48c2-b6ca-5eb5b07e6ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=907b4fc098974bd091c622da82a52a82, user_id=9d2dcfe5a0b74814a1ba51ec2505e193, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:34.566618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc633f-4536-48c2-b6ca-5eb5b07e6ec9 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:34.613171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 890/1777] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:34 2022] PUT /identity/v3/projects/907b4fc098974bd091c622da82a52a82/users/9d2dcfe5a0b74814a1ba51ec2505e193/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:34.618255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c55e8-e1a4-497f-b871-adc713ee88e6 service nova] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:34.635930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c55e8-e1a4-497f-b871-adc713ee88e6 service nova] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:34.794769 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb5f93-47cd-49c0-b7f0-63db0ae130fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:34.797022 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb5f93-47cd-49c0-b7f0-63db0ae130fd admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:34.798694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb5f93-47cd-49c0-b7f0-63db0ae130fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:34.799170 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb5f93-47cd-49c0-b7f0-63db0ae130fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:34.800805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb5f93-47cd-49c0-b7f0-63db0ae130fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:34.804873 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb5f93-47cd-49c0-b7f0-63db0ae130fd admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:34.842457 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc633f-4536-48c2-b6ca-5eb5b07e6ec9 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:34.856124 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 888/1778] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:34.859843 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc633f-4536-48c2-b6ca-5eb5b07e6ec9 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:34.868523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac730f-6688-40ec-ba52-2cc50cb8bd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:34.869362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac730f-6688-40ec-ba52-2cc50cb8bd59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:34.869647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac730f-6688-40ec-ba52-2cc50cb8bd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:34.869920 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac730f-6688-40ec-ba52-2cc50cb8bd59 admin admin] PATH_INFO: `/v3/projects/907b4fc098974bd091c622da82a52a82/users/9d2dcfe5a0b74814a1ba51ec2505e193/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:34.871986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac730f-6688-40ec-ba52-2cc50cb8bd59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=907b4fc098974bd091c622da82a52a82, user_id=9d2dcfe5a0b74814a1ba51ec2505e193, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:34.874991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac730f-6688-40ec-ba52-2cc50cb8bd59 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:34.920803 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 891/1779] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:34 2022] PUT /identity/v3/projects/907b4fc098974bd091c622da82a52a82/users/9d2dcfe5a0b74814a1ba51ec2505e193/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:34.935589 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482611f-1dcc-43d3-adfb-8f33e8737c3f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:34.935889 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482611f-1dcc-43d3-adfb-8f33e8737c3f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:34.936185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482611f-1dcc-43d3-adfb-8f33e8737c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:34.957793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac730f-6688-40ec-ba52-2cc50cb8bd59 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:34.970204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-bcac730f-6688-40ec-ba52-2cc50cb8bd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:35.027406 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-8482611f-1dcc-43d3-adfb-8f33e8737c3f None None] MFA Rules not processed for user `9d2dcfe5a0b74814a1ba51ec2505e193`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:35.031151 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8482611f-1dcc-43d3-adfb-8f33e8737c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:35.193485 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac730f-6688-40ec-ba52-2cc50cb8bd59 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:35.216974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916e348-d4ca-491e-9aad-6673cc4fcc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:35.217878 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916e348-d4ca-491e-9aad-6673cc4fcc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:35.218261 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916e348-d4ca-491e-9aad-6673cc4fcc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:35.218552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916e348-d4ca-491e-9aad-6673cc4fcc93 admin admin] PATH_INFO: `/v3/projects/33140bd9bcce4a70aacd02080e32b83c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:35.227988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916e348-d4ca-491e-9aad-6673cc4fcc93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33140bd9bcce4a70aacd02080e32b83c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:35.235293 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916e348-d4ca-491e-9aad-6673cc4fcc93 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:35.276379 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 889/1780] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:35.278134 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482611f-1dcc-43d3-adfb-8f33e8737c3f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:35.373280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e916e348-d4ca-491e-9aad-6673cc4fcc93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33140bd9bcce4a70aacd02080e32b83c', 'request_id': 'req-e916e348-d4ca-491e-9aad-6673cc4fcc93'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:35.390084 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e916e348-d4ca-491e-9aad-6673cc4fcc93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33140bd9bcce4a70aacd02080e32b83c', 'request_id': 'req-e916e348-d4ca-491e-9aad-6673cc4fcc93'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:35.402823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e916e348-d4ca-491e-9aad-6673cc4fcc93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33140bd9bcce4a70aacd02080e32b83c', 'request_id': 'req-e916e348-d4ca-491e-9aad-6673cc4fcc93'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:35.430681 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e916e348-d4ca-491e-9aad-6673cc4fcc93 admin admin] The token cache is being invalidate because project 33140bd9bcce4a70aacd02080e32b83c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:35.431194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e916e348-d4ca-491e-9aad-6673cc4fcc93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:35.433904 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e916e348-d4ca-491e-9aad-6673cc4fcc93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:35.439195 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 892/1781] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:34 2022] DELETE /identity/v3/projects/33140bd9bcce4a70aacd02080e32b83c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:35.440377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916e348-d4ca-491e-9aad-6673cc4fcc93 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:35.445046 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e916e348-d4ca-491e-9aad-6673cc4fcc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:35.448148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482611f-1dcc-43d3-adfb-8f33e8737c3f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:35.595586 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543894f-91cf-48fd-b1ae-b312c1845efc tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac31b021edf4434f804c9561269c497c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddc93d652b4948a283a6bbbac5951984', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:35.596286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543894f-91cf-48fd-b1ae-b312c1845efc tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:35.596572 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543894f-91cf-48fd-b1ae-b312c1845efc tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:35.596851 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543894f-91cf-48fd-b1ae-b312c1845efc tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:35.597712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543894f-91cf-48fd-b1ae-b312c1845efc tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:35.597888 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543894f-91cf-48fd-b1ae-b312c1845efc tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:35.599690 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543894f-91cf-48fd-b1ae-b312c1845efc tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:35.604492 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916e348-d4ca-491e-9aad-6673cc4fcc93 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:35.620799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662718f-8889-4819-8308-38849e961145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:35.621569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662718f-8889-4819-8308-38849e961145 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:35.621821 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662718f-8889-4819-8308-38849e961145 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:35.622097 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662718f-8889-4819-8308-38849e961145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:35.640993 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0662718f-8889-4819-8308-38849e961145 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:35.654773 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 890/1782] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:35.655894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543894f-91cf-48fd-b1ae-b312c1845efc tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:35.662341 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6543894f-91cf-48fd-b1ae-b312c1845efc tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:35.783079 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662718f-8889-4819-8308-38849e961145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:35.784551 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662718f-8889-4819-8308-38849e961145 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:35.808536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543894f-91cf-48fd-b1ae-b312c1845efc tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:35.811131 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 893/1783] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:35.813389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742648f4-9591-4e2d-a650-1af732f08d48 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:35.815138 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742648f4-9591-4e2d-a650-1af732f08d48 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:35.815432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742648f4-9591-4e2d-a650-1af732f08d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:35.820927 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69dceb6-5fa0-4532-a8ee-8c3a75286e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:35.822004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dceb6-5fa0-4532-a8ee-8c3a75286e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:35.822091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dceb6-5fa0-4532-a8ee-8c3a75286e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:35.822390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dceb6-5fa0-4532-a8ee-8c3a75286e52 admin admin] PATH_INFO: `/v3/users/1449a9307bfa44d9bc36d71f27a20524` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:35.827019 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69dceb6-5fa0-4532-a8ee-8c3a75286e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1449a9307bfa44d9bc36d71f27a20524)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:35.829090 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69dceb6-5fa0-4532-a8ee-8c3a75286e52 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:35.877108 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-742648f4-9591-4e2d-a650-1af732f08d48 None None] MFA Rules not processed for user `a5afa06d77b147f69ff1628691c20a08`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:35.883610 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-742648f4-9591-4e2d-a650-1af732f08d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:35.936500 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b69dceb6-5fa0-4532-a8ee-8c3a75286e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1449a9307bfa44d9bc36d71f27a20524'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:35.940023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b69dceb6-5fa0-4532-a8ee-8c3a75286e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1449a9307bfa44d9bc36d71f27a20524'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:35.960638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b69dceb6-5fa0-4532-a8ee-8c3a75286e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1449a9307bfa44d9bc36d71f27a20524'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:35.968960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b69dceb6-5fa0-4532-a8ee-8c3a75286e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1449a9307bfa44d9bc36d71f27a20524'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:35.970537 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b69dceb6-5fa0-4532-a8ee-8c3a75286e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1449a9307bfa44d9bc36d71f27a20524'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:36.031596 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 891/1784] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:35 2022] DELETE /identity/v3/users/1449a9307bfa44d9bc36d71f27a20524 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:36.032549 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69dceb6-5fa0-4532-a8ee-8c3a75286e52 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:36.034032 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b69dceb6-5fa0-4532-a8ee-8c3a75286e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:36.116652 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 894/1785] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:36.234120 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69dceb6-5fa0-4532-a8ee-8c3a75286e52 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:36.244123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300f403-e47e-464b-82b9-a8c20ab8eda9 tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac31b021edf4434f804c9561269c497c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddc93d652b4948a283a6bbbac5951984', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:36.244822 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300f403-e47e-464b-82b9-a8c20ab8eda9 tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:36.245256 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300f403-e47e-464b-82b9-a8c20ab8eda9 tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:36.249435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300f403-e47e-464b-82b9-a8c20ab8eda9 tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:36.252779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300f403-e47e-464b-82b9-a8c20ab8eda9 tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:36.254848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300f403-e47e-464b-82b9-a8c20ab8eda9 tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:36.353261 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742648f4-9591-4e2d-a650-1af732f08d48 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:36.365571 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 892/1786] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:36 2022] POST /identity/v3/projects => generated 355 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:36.366826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742648f4-9591-4e2d-a650-1af732f08d48 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:36.470772 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f205e-d0fc-4fe5-b389-e112623c106a tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac31b021edf4434f804c9561269c497c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddc93d652b4948a283a6bbbac5951984', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:36.471788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f205e-d0fc-4fe5-b389-e112623c106a tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:36.472270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f205e-d0fc-4fe5-b389-e112623c106a tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:36.472559 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f205e-d0fc-4fe5-b389-e112623c106a tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:36.473333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f205e-d0fc-4fe5-b389-e112623c106a tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:36.473814 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f205e-d0fc-4fe5-b389-e112623c106a tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:36.476004 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f205e-d0fc-4fe5-b389-e112623c106a tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:36.494438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 895/1787] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:36.601975 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300f403-e47e-464b-82b9-a8c20ab8eda9 tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:36.646798 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300f403-e47e-464b-82b9-a8c20ab8eda9 tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:36.664524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295554eb-0921-4091-827d-dafca898253c tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac31b021edf4434f804c9561269c497c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddc93d652b4948a283a6bbbac5951984', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:36.665659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295554eb-0921-4091-827d-dafca898253c tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:36.669225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295554eb-0921-4091-827d-dafca898253c tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:36.669723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295554eb-0921-4091-827d-dafca898253c tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] PATH_INFO: `/v3/projects/8d54e2cb4cc54aa499dc3fcfb363f92a` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:36.682011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295554eb-0921-4091-827d-dafca898253c tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8d54e2cb4cc54aa499dc3fcfb363f92a)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:36.690753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295554eb-0921-4091-827d-dafca898253c tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:36.893370 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-295554eb-0921-4091-827d-dafca898253c tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d54e2cb4cc54aa499dc3fcfb363f92a', 'request_id': 'req-295554eb-0921-4091-827d-dafca898253c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:36.905456 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-295554eb-0921-4091-827d-dafca898253c tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d54e2cb4cc54aa499dc3fcfb363f92a', 'request_id': 'req-295554eb-0921-4091-827d-dafca898253c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:36.918775 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-295554eb-0921-4091-827d-dafca898253c tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d54e2cb4cc54aa499dc3fcfb363f92a', 'request_id': 'req-295554eb-0921-4091-827d-dafca898253c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:36.954881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-295554eb-0921-4091-827d-dafca898253c tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] The token cache is being invalidate because project 8d54e2cb4cc54aa499dc3fcfb363f92a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:36.955786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-295554eb-0921-4091-827d-dafca898253c tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:36.957639 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-295554eb-0921-4091-827d-dafca898253c tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:36.977208 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 893/1788] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:36 2022] DELETE /identity/v3/projects/8d54e2cb4cc54aa499dc3fcfb363f92a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:37.028566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f205e-d0fc-4fe5-b389-e112623c106a tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:37.031188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-843f205e-d0fc-4fe5-b389-e112623c106a tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:37.204916 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f205e-d0fc-4fe5-b389-e112623c106a tempest-VolumeQuotaClassesTest-682539382 tempest-VolumeQuotaClassesTest-682539382-project-admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:37.297381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bd1e0-2ec1-454c-8a66-b8700ea3ca4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:37.298806 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bd1e0-2ec1-454c-8a66-b8700ea3ca4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:37.299353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bd1e0-2ec1-454c-8a66-b8700ea3ca4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:37.299788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bd1e0-2ec1-454c-8a66-b8700ea3ca4c admin admin] PATH_INFO: `/v3/users/a2ba8cc0ff5d447c8d5bf927de4583f3` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:37.301381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bd1e0-2ec1-454c-8a66-b8700ea3ca4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ba8cc0ff5d447c8d5bf927de4583f3)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:37.304285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bd1e0-2ec1-454c-8a66-b8700ea3ca4c admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:37.376907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8e6bd1e0-2ec1-454c-8a66-b8700ea3ca4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ba8cc0ff5d447c8d5bf927de4583f3'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:37.387411 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8e6bd1e0-2ec1-454c-8a66-b8700ea3ca4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ba8cc0ff5d447c8d5bf927de4583f3'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:37.388884 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8e6bd1e0-2ec1-454c-8a66-b8700ea3ca4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ba8cc0ff5d447c8d5bf927de4583f3'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:37.390151 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8e6bd1e0-2ec1-454c-8a66-b8700ea3ca4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ba8cc0ff5d447c8d5bf927de4583f3'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:37.410851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8e6bd1e0-2ec1-454c-8a66-b8700ea3ca4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ba8cc0ff5d447c8d5bf927de4583f3'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:37.458376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 896/1789] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:37 2022] DELETE /identity/v3/users/a2ba8cc0ff5d447c8d5bf927de4583f3 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:37.460055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e61c06-8f8f-41cf-837f-1e6b7e7189ab None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:37.461264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e61c06-8f8f-41cf-837f-1e6b7e7189ab None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:37.461812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e61c06-8f8f-41cf-837f-1e6b7e7189ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:37.502985 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bd1e0-2ec1-454c-8a66-b8700ea3ca4c admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:37.504626 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8e6bd1e0-2ec1-454c-8a66-b8700ea3ca4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:37.546602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-67e61c06-8f8f-41cf-837f-1e6b7e7189ab None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:37.549711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-67e61c06-8f8f-41cf-837f-1e6b7e7189ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:37.715591 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 894/1790] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:37.747968 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bd1e0-2ec1-454c-8a66-b8700ea3ca4c admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:37.758016 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cc3b8-c9f4-40c1-b498-20107cac5654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:37.759207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cc3b8-c9f4-40c1-b498-20107cac5654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:37.759793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cc3b8-c9f4-40c1-b498-20107cac5654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:37.760231 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cc3b8-c9f4-40c1-b498-20107cac5654 admin admin] PATH_INFO: `/v3/users/6655514d2cb941738e0dbe24b366814a` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:37.761732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cc3b8-c9f4-40c1-b498-20107cac5654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6655514d2cb941738e0dbe24b366814a)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:37.763972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cc3b8-c9f4-40c1-b498-20107cac5654 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:37.812708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e61c06-8f8f-41cf-837f-1e6b7e7189ab None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:37.814154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-67e61c06-8f8f-41cf-837f-1e6b7e7189ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:37.908117 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e54cc3b8-c9f4-40c1-b498-20107cac5654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6655514d2cb941738e0dbe24b366814a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:37.925211 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e54cc3b8-c9f4-40c1-b498-20107cac5654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6655514d2cb941738e0dbe24b366814a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:37.926581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e54cc3b8-c9f4-40c1-b498-20107cac5654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6655514d2cb941738e0dbe24b366814a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:37.927349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e54cc3b8-c9f4-40c1-b498-20107cac5654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6655514d2cb941738e0dbe24b366814a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:37.943585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e61c06-8f8f-41cf-837f-1e6b7e7189ab None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:37.952155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089158ef-8458-41e6-a445-2dc322f0e48d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:37.953036 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089158ef-8458-41e6-a445-2dc322f0e48d service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:37.953505 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089158ef-8458-41e6-a445-2dc322f0e48d service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:37.953949 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089158ef-8458-41e6-a445-2dc322f0e48d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:37.955297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e54cc3b8-c9f4-40c1-b498-20107cac5654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6655514d2cb941738e0dbe24b366814a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:37.963836 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-089158ef-8458-41e6-a445-2dc322f0e48d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:37.982545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 897/1791] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:37 2022] DELETE /identity/v3/users/6655514d2cb941738e0dbe24b366814a => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:37.988952 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c143f-bee6-4dd5-b102-8ba628381dc6 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:37.990009 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089158ef-8458-41e6-a445-2dc322f0e48d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:37.990674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c143f-bee6-4dd5-b102-8ba628381dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:37.992281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089158ef-8458-41e6-a445-2dc322f0e48d service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:37.992625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c143f-bee6-4dd5-b102-8ba628381dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:38.019579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 895/1792] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:42:38.046568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ad2c143f-bee6-4dd5-b102-8ba628381dc6 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:38.048038 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ad2c143f-bee6-4dd5-b102-8ba628381dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:38.170698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 898/1793] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:38.219936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089158ef-8458-41e6-a445-2dc322f0e48d service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:38.221770 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-089158ef-8458-41e6-a445-2dc322f0e48d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:38.245644 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089158ef-8458-41e6-a445-2dc322f0e48d service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:38.367455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b3e7b-db1d-4985-9195-269f2d06c87f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:38.368128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b3e7b-db1d-4985-9195-269f2d06c87f service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:38.368490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b3e7b-db1d-4985-9195-269f2d06c87f service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:38.368771 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b3e7b-db1d-4985-9195-269f2d06c87f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:38.398256 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c143f-bee6-4dd5-b102-8ba628381dc6 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:38.400134 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ad2c143f-bee6-4dd5-b102-8ba628381dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:38.418611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c143f-bee6-4dd5-b102-8ba628381dc6 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:38.424619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbaa81-6d27-4828-85c0-b6b202634d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:38.425842 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbaa81-6d27-4828-85c0-b6b202634d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:38.426451 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbaa81-6d27-4828-85c0-b6b202634d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:38.426983 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbaa81-6d27-4828-85c0-b6b202634d35 admin admin] PATH_INFO: `/v3/projects/77bef4a3e67a4bc28e9aa96833cc61e8` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:38.428951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b3e7b-db1d-4985-9195-269f2d06c87f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:38.429599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbaa81-6d27-4828-85c0-b6b202634d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77bef4a3e67a4bc28e9aa96833cc61e8)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:38.431274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b3e7b-db1d-4985-9195-269f2d06c87f service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:38.432976 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbaa81-6d27-4828-85c0-b6b202634d35 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:38.457576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 896/1794] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:38.499982 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-83fbaa81-6d27-4828-85c0-b6b202634d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77bef4a3e67a4bc28e9aa96833cc61e8', 'request_id': 'req-83fbaa81-6d27-4828-85c0-b6b202634d35'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:38.514495 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-83fbaa81-6d27-4828-85c0-b6b202634d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77bef4a3e67a4bc28e9aa96833cc61e8', 'request_id': 'req-83fbaa81-6d27-4828-85c0-b6b202634d35'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:38.528252 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-83fbaa81-6d27-4828-85c0-b6b202634d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77bef4a3e67a4bc28e9aa96833cc61e8', 'request_id': 'req-83fbaa81-6d27-4828-85c0-b6b202634d35'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:38.556244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-83fbaa81-6d27-4828-85c0-b6b202634d35 admin admin] The token cache is being invalidate because project 77bef4a3e67a4bc28e9aa96833cc61e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:38.557149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-83fbaa81-6d27-4828-85c0-b6b202634d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:38.557275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-83fbaa81-6d27-4828-85c0-b6b202634d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:38.563023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 899/1795] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:38 2022] DELETE /identity/v3/projects/77bef4a3e67a4bc28e9aa96833cc61e8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:38.565742 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8d0aa-b0b4-416e-8d78-f76ab18c01f2 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:38.566656 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8d0aa-b0b4-416e-8d78-f76ab18c01f2 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:38.567080 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8d0aa-b0b4-416e-8d78-f76ab18c01f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:38.629729 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-68a8d0aa-b0b4-416e-8d78-f76ab18c01f2 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:38.631914 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-68a8d0aa-b0b4-416e-8d78-f76ab18c01f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:38.767549 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928037f6-910c-49d8-9291-0635bb690565 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:38.767846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928037f6-910c-49d8-9291-0635bb690565 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:38.768129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928037f6-910c-49d8-9291-0635bb690565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:38.768533 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 897/1796] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:38.811086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-928037f6-910c-49d8-9291-0635bb690565 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:38.816399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-928037f6-910c-49d8-9291-0635bb690565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:38.860687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 900/1797] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:42:38.864951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8d0aa-b0b4-416e-8d78-f76ab18c01f2 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:38.877979 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8d0aa-b0b4-416e-8d78-f76ab18c01f2 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:38.899115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3cf6d-c436-4d7f-ada6-eee1529210ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:38.899816 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3cf6d-c436-4d7f-ada6-eee1529210ad admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:38.900161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3cf6d-c436-4d7f-ada6-eee1529210ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:38.900447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3cf6d-c436-4d7f-ada6-eee1529210ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:38.901352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3cf6d-c436-4d7f-ada6-eee1529210ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:38.901823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3cf6d-c436-4d7f-ada6-eee1529210ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:38.903634 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3cf6d-c436-4d7f-ada6-eee1529210ad admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:38.932679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 898/1798] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:38.936841 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928037f6-910c-49d8-9291-0635bb690565 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:38.956388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928037f6-910c-49d8-9291-0635bb690565 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:38.965088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396aeffc-64b4-4ea4-8c3f-7589dc27ae8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:38.965766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396aeffc-64b4-4ea4-8c3f-7589dc27ae8a admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:38.966043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396aeffc-64b4-4ea4-8c3f-7589dc27ae8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:38.966350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396aeffc-64b4-4ea4-8c3f-7589dc27ae8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:38.967056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396aeffc-64b4-4ea4-8c3f-7589dc27ae8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:38.969202 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396aeffc-64b4-4ea4-8c3f-7589dc27ae8a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:39.022972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 901/1799] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:38 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:39.027311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3cf6d-c436-4d7f-ada6-eee1529210ad admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:39.045119 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3cf6d-c436-4d7f-ada6-eee1529210ad admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:39.123086 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62634549-abb1-4813-8a71-ae420dfbf991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:39.124037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62634549-abb1-4813-8a71-ae420dfbf991 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:39.124324 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62634549-abb1-4813-8a71-ae420dfbf991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:39.124597 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62634549-abb1-4813-8a71-ae420dfbf991 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:39.125520 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62634549-abb1-4813-8a71-ae420dfbf991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:39.127628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62634549-abb1-4813-8a71-ae420dfbf991 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:39.165674 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 899/1800] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:39 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:39.169792 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396aeffc-64b4-4ea4-8c3f-7589dc27ae8a admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:39.191034 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396aeffc-64b4-4ea4-8c3f-7589dc27ae8a admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:39.199641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce6032-c9c2-41e4-9edc-73f7b129920a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:39.201610 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce6032-c9c2-41e4-9edc-73f7b129920a admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:39.202087 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce6032-c9c2-41e4-9edc-73f7b129920a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:39.202683 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce6032-c9c2-41e4-9edc-73f7b129920a admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:39.204776 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce6032-c9c2-41e4-9edc-73f7b129920a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:39.207477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce6032-c9c2-41e4-9edc-73f7b129920a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:39.226453 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 902/1801] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:42:39.231298 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62634549-abb1-4813-8a71-ae420dfbf991 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:39.244747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62634549-abb1-4813-8a71-ae420dfbf991 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:39.252983 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0cbcc-7076-4e2b-b5e7-495cf35f5efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:39.254137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0cbcc-7076-4e2b-b5e7-495cf35f5efd admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:39.255294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0cbcc-7076-4e2b-b5e7-495cf35f5efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:39.255817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0cbcc-7076-4e2b-b5e7-495cf35f5efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:39.258617 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0cbcc-7076-4e2b-b5e7-495cf35f5efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:39.260918 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0cbcc-7076-4e2b-b5e7-495cf35f5efd admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:39.291347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 900/1802] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:39.292933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce6032-c9c2-41e4-9edc-73f7b129920a admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:39.309891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce6032-c9c2-41e4-9edc-73f7b129920a admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:39.333153 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1e442-c406-44c9-96fd-85faccaf1eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:39.335760 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1e442-c406-44c9-96fd-85faccaf1eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:39.336297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1e442-c406-44c9-96fd-85faccaf1eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:39.336765 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1e442-c406-44c9-96fd-85faccaf1eb4 admin admin] PATH_INFO: `/v3/projects/c6e54e2bf9ca418597de8dd60c96c657/users/2c90b5a0810249b5a91a7c9d5e73ecf9/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:39.368826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1e442-c406-44c9-96fd-85faccaf1eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e54e2bf9ca418597de8dd60c96c657, user_id=2c90b5a0810249b5a91a7c9d5e73ecf9, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:39.371766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1e442-c406-44c9-96fd-85faccaf1eb4 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:39.410231 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 903/1803] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:39 2022] PUT /identity/v3/projects/c6e54e2bf9ca418597de8dd60c96c657/users/2c90b5a0810249b5a91a7c9d5e73ecf9/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:39.417638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998c355-804f-4d5a-9f3b-cf8da227920b None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:39.417931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998c355-804f-4d5a-9f3b-cf8da227920b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:39.418490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998c355-804f-4d5a-9f3b-cf8da227920b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:39.458808 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-6998c355-804f-4d5a-9f3b-cf8da227920b None None] MFA Rules not processed for user `2c90b5a0810249b5a91a7c9d5e73ecf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:39.460175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6998c355-804f-4d5a-9f3b-cf8da227920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:39.610519 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 901/1804] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:39.618594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1e442-c406-44c9-96fd-85faccaf1eb4 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:39.721232 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1e442-c406-44c9-96fd-85faccaf1eb4 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:39.746330 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b747250-2cf7-4637-9d6e-cc8ae4faafe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:39.747148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b747250-2cf7-4637-9d6e-cc8ae4faafe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:39.748184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b747250-2cf7-4637-9d6e-cc8ae4faafe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:39.748184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b747250-2cf7-4637-9d6e-cc8ae4faafe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:39.749227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b747250-2cf7-4637-9d6e-cc8ae4faafe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:39.752009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b747250-2cf7-4637-9d6e-cc8ae4faafe5 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:39.816533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 904/1805] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:39 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:39.831412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998c355-804f-4d5a-9f3b-cf8da227920b None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:39.843093 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998c355-804f-4d5a-9f3b-cf8da227920b None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:39.866392 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b747250-2cf7-4637-9d6e-cc8ae4faafe5 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:39.868478 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6b747250-2cf7-4637-9d6e-cc8ae4faafe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:39.957149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b747250-2cf7-4637-9d6e-cc8ae4faafe5 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:39.966213 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d65173-3a4c-4bd9-b2c4-ea050029d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:39.967188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d65173-3a4c-4bd9-b2c4-ea050029d220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:39.968018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d65173-3a4c-4bd9-b2c4-ea050029d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:39.968340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d65173-3a4c-4bd9-b2c4-ea050029d220 admin admin] PATH_INFO: `/v3/projects/6c15ae698bda4a2c8d665821ec74c601` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:39.970575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d65173-3a4c-4bd9-b2c4-ea050029d220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c15ae698bda4a2c8d665821ec74c601)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:39.974035 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d65173-3a4c-4bd9-b2c4-ea050029d220 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:39.994564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535d0e4-0c68-42ca-866e-903840d02778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:39.995269 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535d0e4-0c68-42ca-866e-903840d02778 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:39.995978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535d0e4-0c68-42ca-866e-903840d02778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:39.995978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535d0e4-0c68-42ca-866e-903840d02778 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:39.996519 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535d0e4-0c68-42ca-866e-903840d02778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:39.999481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535d0e4-0c68-42ca-866e-903840d02778 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:40.044495 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 902/1806] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:39 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:40.045517 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535d0e4-0c68-42ca-866e-903840d02778 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:40.060809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535d0e4-0c68-42ca-866e-903840d02778 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:40.066679 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-29d65173-3a4c-4bd9-b2c4-ea050029d220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c15ae698bda4a2c8d665821ec74c601', 'request_id': 'req-29d65173-3a4c-4bd9-b2c4-ea050029d220'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:40.077959 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-29d65173-3a4c-4bd9-b2c4-ea050029d220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c15ae698bda4a2c8d665821ec74c601', 'request_id': 'req-29d65173-3a4c-4bd9-b2c4-ea050029d220'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:40.096535 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-29d65173-3a4c-4bd9-b2c4-ea050029d220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c15ae698bda4a2c8d665821ec74c601', 'request_id': 'req-29d65173-3a4c-4bd9-b2c4-ea050029d220'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:40.129152 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-29d65173-3a4c-4bd9-b2c4-ea050029d220 admin admin] The token cache is being invalidate because project 6c15ae698bda4a2c8d665821ec74c601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:40.130289 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-29d65173-3a4c-4bd9-b2c4-ea050029d220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:40.132769 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-29d65173-3a4c-4bd9-b2c4-ea050029d220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:40.141593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 905/1807] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:39 2022] DELETE /identity/v3/projects/6c15ae698bda4a2c8d665821ec74c601 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:42:40.141593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d65173-3a4c-4bd9-b2c4-ea050029d220 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:40.144679 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-29d65173-3a4c-4bd9-b2c4-ea050029d220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:40.181040 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a31e03-7bd9-4451-8435-f63f9f94ed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:40.181768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a31e03-7bd9-4451-8435-f63f9f94ed8c admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:40.182247 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a31e03-7bd9-4451-8435-f63f9f94ed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:40.182424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a31e03-7bd9-4451-8435-f63f9f94ed8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:40.184455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a31e03-7bd9-4451-8435-f63f9f94ed8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:40.189332 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a31e03-7bd9-4451-8435-f63f9f94ed8c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:40.216346 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 903/1808] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:40.217164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a31e03-7bd9-4451-8435-f63f9f94ed8c admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:40.221368 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-20a31e03-7bd9-4451-8435-f63f9f94ed8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:40.249059 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a31e03-7bd9-4451-8435-f63f9f94ed8c admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:40.255270 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bd7f2-24d0-4191-9268-53096fc42c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:40.257028 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bd7f2-24d0-4191-9268-53096fc42c7a admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:40.257687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bd7f2-24d0-4191-9268-53096fc42c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:40.258200 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bd7f2-24d0-4191-9268-53096fc42c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:40.262495 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d65173-3a4c-4bd9-b2c4-ea050029d220 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:40.270345 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bd7f2-24d0-4191-9268-53096fc42c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:40.276513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca2ead-ee43-411f-b4d2-e3080a8e882b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:40.276513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca2ead-ee43-411f-b4d2-e3080a8e882b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:40.276513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca2ead-ee43-411f-b4d2-e3080a8e882b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:40.276513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca2ead-ee43-411f-b4d2-e3080a8e882b admin admin] PATH_INFO: `/v3/users/9d2dcfe5a0b74814a1ba51ec2505e193` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:40.278005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca2ead-ee43-411f-b4d2-e3080a8e882b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2dcfe5a0b74814a1ba51ec2505e193)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:40.281731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca2ead-ee43-411f-b4d2-e3080a8e882b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:40.282215 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bd7f2-24d0-4191-9268-53096fc42c7a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:40.310443 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 904/1809] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:40.320770 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5971165-a94a-4fda-99cf-ce3a1b510779 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:40.321380 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5971165-a94a-4fda-99cf-ce3a1b510779 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:40.322607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5971165-a94a-4fda-99cf-ce3a1b510779 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:40.327381 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 905/1810] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 5 15:42:40 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:42:40.329787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5971165-a94a-4fda-99cf-ce3a1b510779 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:40.351313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5971165-a94a-4fda-99cf-ce3a1b510779 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:40.371335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297ba7e-96f1-4212-8bd2-faed56569667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:40.372550 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297ba7e-96f1-4212-8bd2-faed56569667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:40.373643 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297ba7e-96f1-4212-8bd2-faed56569667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:40.373973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297ba7e-96f1-4212-8bd2-faed56569667 admin admin] PATH_INFO: `/v3/projects/4a955d60428444ecac4b14bff63eebee/users/95a99d86eb294185825c94db1f409e93/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:40.398955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-1fca2ead-ee43-411f-b4d2-e3080a8e882b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2dcfe5a0b74814a1ba51ec2505e193'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:40.417473 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-1fca2ead-ee43-411f-b4d2-e3080a8e882b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2dcfe5a0b74814a1ba51ec2505e193'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:40.420062 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-1fca2ead-ee43-411f-b4d2-e3080a8e882b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2dcfe5a0b74814a1ba51ec2505e193'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:40.421379 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-1fca2ead-ee43-411f-b4d2-e3080a8e882b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2dcfe5a0b74814a1ba51ec2505e193'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:40.473822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-1fca2ead-ee43-411f-b4d2-e3080a8e882b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2dcfe5a0b74814a1ba51ec2505e193'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:40.505823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 906/1811] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:40 2022] DELETE /identity/v3/users/9d2dcfe5a0b74814a1ba51ec2505e193 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:42:40.508211 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f88c4a-9f3e-43ac-a91e-27e2d8759cc5 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:40.508602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f88c4a-9f3e-43ac-a91e-27e2d8759cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:40.509001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f88c4a-9f3e-43ac-a91e-27e2d8759cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:40.531617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-57f88c4a-9f3e-43ac-a91e-27e2d8759cc5 None None] MFA Rules not processed for user `2a29a4b1b1aa45aea2e466d8f8b79365`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:40.534466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-57f88c4a-9f3e-43ac-a91e-27e2d8759cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:40.649903 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 907/1812] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 5 15:42:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:40.651659 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f88c4a-9f3e-43ac-a91e-27e2d8759cc5 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:40.653971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-57f88c4a-9f3e-43ac-a91e-27e2d8759cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:40.697524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297ba7e-96f1-4212-8bd2-faed56569667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a955d60428444ecac4b14bff63eebee, user_id=95a99d86eb294185825c94db1f409e93, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:40.704859 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297ba7e-96f1-4212-8bd2-faed56569667 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:40.742665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 906/1813] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:40 2022] PUT /identity/v3/projects/4a955d60428444ecac4b14bff63eebee/users/95a99d86eb294185825c94db1f409e93/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:40.744298 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297ba7e-96f1-4212-8bd2-faed56569667 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:40.746251 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-3297ba7e-96f1-4212-8bd2-faed56569667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:40.767526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f88c4a-9f3e-43ac-a91e-27e2d8759cc5 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:40.884081 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b0e62-30de-4059-a639-408548e992ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:40.886013 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b0e62-30de-4059-a639-408548e992ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:40.886495 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b0e62-30de-4059-a639-408548e992ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:40.886878 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b0e62-30de-4059-a639-408548e992ac admin admin] PATH_INFO: `/v3/projects/159d2ed280ad49ed8f5d1b04c32aeac9` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:40.888283 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b0e62-30de-4059-a639-408548e992ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=159d2ed280ad49ed8f5d1b04c32aeac9)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:40.890197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b0e62-30de-4059-a639-408548e992ac admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:40.892376 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297ba7e-96f1-4212-8bd2-faed56569667 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:40.900135 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879cd6a-b921-4805-a8e7-37b85ce1da2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:40.901128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879cd6a-b921-4805-a8e7-37b85ce1da2d service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:40.901418 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879cd6a-b921-4805-a8e7-37b85ce1da2d service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:40.901707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879cd6a-b921-4805-a8e7-37b85ce1da2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:40.913732 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879cd6a-b921-4805-a8e7-37b85ce1da2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:40.915447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879cd6a-b921-4805-a8e7-37b85ce1da2d service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:40.947920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 907/1814] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:40.949251 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bb089-fb30-474e-afbb-3afb3d1a7234 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:40.950277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bb089-fb30-474e-afbb-3afb3d1a7234 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:40.950590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bb089-fb30-474e-afbb-3afb3d1a7234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:40.977541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-410b0e62-30de-4059-a639-408548e992ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159d2ed280ad49ed8f5d1b04c32aeac9', 'request_id': 'req-410b0e62-30de-4059-a639-408548e992ac'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:40.984356 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-410b0e62-30de-4059-a639-408548e992ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159d2ed280ad49ed8f5d1b04c32aeac9', 'request_id': 'req-410b0e62-30de-4059-a639-408548e992ac'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:40.995931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-410b0e62-30de-4059-a639-408548e992ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159d2ed280ad49ed8f5d1b04c32aeac9', 'request_id': 'req-410b0e62-30de-4059-a639-408548e992ac'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:41.016511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-b76bb089-fb30-474e-afbb-3afb3d1a7234 None None] MFA Rules not processed for user `95a99d86eb294185825c94db1f409e93`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:41.018262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b76bb089-fb30-474e-afbb-3afb3d1a7234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:41.038210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-410b0e62-30de-4059-a639-408548e992ac admin admin] The token cache is being invalidate because project 159d2ed280ad49ed8f5d1b04c32aeac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:41.038820 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-410b0e62-30de-4059-a639-408548e992ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:41.040489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-410b0e62-30de-4059-a639-408548e992ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:41.045107 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 908/1815] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:40 2022] DELETE /identity/v3/projects/159d2ed280ad49ed8f5d1b04c32aeac9 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:41.047653 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b0e62-30de-4059-a639-408548e992ac admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:41.052375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-410b0e62-30de-4059-a639-408548e992ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:41.134592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 908/1816] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:41.138423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bb089-fb30-474e-afbb-3afb3d1a7234 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:41.139871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b76bb089-fb30-474e-afbb-3afb3d1a7234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:41.155739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bb089-fb30-474e-afbb-3afb3d1a7234 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:41.156103 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b0e62-30de-4059-a639-408548e992ac admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:41.161239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c28b3b-4250-4ae3-ae6d-bf963a1e3b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:41.161908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c28b3b-4250-4ae3-ae6d-bf963a1e3b1e admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:41.162308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c28b3b-4250-4ae3-ae6d-bf963a1e3b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:41.162613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c28b3b-4250-4ae3-ae6d-bf963a1e3b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:41.163157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52316f-a637-47a6-94a8-73ebbe35bfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:41.163565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c28b3b-4250-4ae3-ae6d-bf963a1e3b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:41.164589 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52316f-a637-47a6-94a8-73ebbe35bfb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:41.164940 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52316f-a637-47a6-94a8-73ebbe35bfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:41.165281 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52316f-a637-47a6-94a8-73ebbe35bfb5 admin admin] PATH_INFO: `/v3/users/ac31b021edf4434f804c9561269c497c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:41.165505 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c28b3b-4250-4ae3-ae6d-bf963a1e3b1e admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:41.166822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52316f-a637-47a6-94a8-73ebbe35bfb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac31b021edf4434f804c9561269c497c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:41.169310 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52316f-a637-47a6-94a8-73ebbe35bfb5 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:41.211581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 909/1817] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:41 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:41.215983 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c28b3b-4250-4ae3-ae6d-bf963a1e3b1e admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:41.244098 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8d52316f-a637-47a6-94a8-73ebbe35bfb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac31b021edf4434f804c9561269c497c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:41.254269 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8d52316f-a637-47a6-94a8-73ebbe35bfb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac31b021edf4434f804c9561269c497c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:41.255638 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8d52316f-a637-47a6-94a8-73ebbe35bfb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac31b021edf4434f804c9561269c497c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:41.257865 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8d52316f-a637-47a6-94a8-73ebbe35bfb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac31b021edf4434f804c9561269c497c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:41.279507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8d52316f-a637-47a6-94a8-73ebbe35bfb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac31b021edf4434f804c9561269c497c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:41.297312 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 909/1818] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:41 2022] DELETE /identity/v3/users/ac31b021edf4434f804c9561269c497c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:41.316936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52316f-a637-47a6-94a8-73ebbe35bfb5 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:41.319219 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8d52316f-a637-47a6-94a8-73ebbe35bfb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:41.322315 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c28b3b-4250-4ae3-ae6d-bf963a1e3b1e admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:41.460965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed9879-b753-4094-83df-3e757d4ee98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:41.462401 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed9879-b753-4094-83df-3e757d4ee98f admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:41.462690 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed9879-b753-4094-83df-3e757d4ee98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:41.462970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed9879-b753-4094-83df-3e757d4ee98f admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:41.463713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed9879-b753-4094-83df-3e757d4ee98f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:41.467141 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed9879-b753-4094-83df-3e757d4ee98f admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:41.484233 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52316f-a637-47a6-94a8-73ebbe35bfb5 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:41.501563 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c8d80-611d-41cd-a2cb-c400a1d66e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:41.502610 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c8d80-611d-41cd-a2cb-c400a1d66e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:41.502835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c8d80-611d-41cd-a2cb-c400a1d66e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:41.503092 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c8d80-611d-41cd-a2cb-c400a1d66e4d admin admin] PATH_INFO: `/v3/users/0589abc0e5454ddfa99d174b8e6f0389` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:41.507822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c8d80-611d-41cd-a2cb-c400a1d66e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0589abc0e5454ddfa99d174b8e6f0389)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:41.509810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c8d80-611d-41cd-a2cb-c400a1d66e4d admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:41.527559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 910/1819] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:41 2022] POST /identity/v3/users => generated 293 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:41.531516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed9879-b753-4094-83df-3e757d4ee98f admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:41.534590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-59ed9879-b753-4094-83df-3e757d4ee98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:41.560627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed9879-b753-4094-83df-3e757d4ee98f admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:41.574624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abe0be-8f7f-4787-8f2d-7c2226efb27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:41.575321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abe0be-8f7f-4787-8f2d-7c2226efb27e admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:41.575602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abe0be-8f7f-4787-8f2d-7c2226efb27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:41.575918 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abe0be-8f7f-4787-8f2d-7c2226efb27e admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:41.576657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abe0be-8f7f-4787-8f2d-7c2226efb27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:41.578578 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abe0be-8f7f-4787-8f2d-7c2226efb27e admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:41.609951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 911/1820] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:42:41.614118 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abe0be-8f7f-4787-8f2d-7c2226efb27e admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:41.624013 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c52c8d80-611d-41cd-a2cb-c400a1d66e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0589abc0e5454ddfa99d174b8e6f0389'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:41.628686 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abe0be-8f7f-4787-8f2d-7c2226efb27e admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:41.639215 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c52c8d80-611d-41cd-a2cb-c400a1d66e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0589abc0e5454ddfa99d174b8e6f0389'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:41.639840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5b1f9-ba88-4b94-8f37-b23164d5397e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:41.640751 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c52c8d80-611d-41cd-a2cb-c400a1d66e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0589abc0e5454ddfa99d174b8e6f0389'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:41.640852 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b1f9-ba88-4b94-8f37-b23164d5397e admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:41.641029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b1f9-ba88-4b94-8f37-b23164d5397e admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:41.641372 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b1f9-ba88-4b94-8f37-b23164d5397e admin admin] PATH_INFO: `/v3/projects/a5167ef29b1a4e55a861a5d9959d792c/users/caeae25be9574f228d221abebeea94da/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:41.643250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c52c8d80-611d-41cd-a2cb-c400a1d66e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0589abc0e5454ddfa99d174b8e6f0389'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:41.671525 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c52c8d80-611d-41cd-a2cb-c400a1d66e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0589abc0e5454ddfa99d174b8e6f0389'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:41.677286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5b1f9-ba88-4b94-8f37-b23164d5397e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5167ef29b1a4e55a861a5d9959d792c, user_id=caeae25be9574f228d221abebeea94da, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:41.682787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5b1f9-ba88-4b94-8f37-b23164d5397e admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:41.701851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 910/1821] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:41 2022] DELETE /identity/v3/users/0589abc0e5454ddfa99d174b8e6f0389 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:41.715313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 912/1822] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:41 2022] PUT /identity/v3/projects/a5167ef29b1a4e55a861a5d9959d792c/users/caeae25be9574f228d221abebeea94da/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:42:41.719810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c8d80-611d-41cd-a2cb-c400a1d66e4d admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:41.722532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c52c8d80-611d-41cd-a2cb-c400a1d66e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:41.845990 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c8d80-611d-41cd-a2cb-c400a1d66e4d admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:41.932999 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8af60-2583-41ca-bc63-65231a424380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:41.934216 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8af60-2583-41ca-bc63-65231a424380 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:41.934721 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8af60-2583-41ca-bc63-65231a424380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:41.935195 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8af60-2583-41ca-bc63-65231a424380 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:41.936120 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8af60-2583-41ca-bc63-65231a424380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:41.938398 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8af60-2583-41ca-bc63-65231a424380 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:41.958333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 911/1823] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:41.963679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5b1f9-ba88-4b94-8f37-b23164d5397e admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:41.980804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5b1f9-ba88-4b94-8f37-b23164d5397e admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:41.987107 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efc9ae-4cef-480d-8ee4-8e206f5143cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:41.987919 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efc9ae-4cef-480d-8ee4-8e206f5143cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:41.988606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efc9ae-4cef-480d-8ee4-8e206f5143cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:41.988606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efc9ae-4cef-480d-8ee4-8e206f5143cd admin admin] PATH_INFO: `/v3/projects/a5167ef29b1a4e55a861a5d9959d792c/users/caeae25be9574f228d221abebeea94da/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:41.993177 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2efc9ae-4cef-480d-8ee4-8e206f5143cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5167ef29b1a4e55a861a5d9959d792c, user_id=caeae25be9574f228d221abebeea94da, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:41.996034 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2efc9ae-4cef-480d-8ee4-8e206f5143cd admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:42.021320 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 913/1824] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:41 2022] PUT /identity/v3/projects/a5167ef29b1a4e55a861a5d9959d792c/users/caeae25be9574f228d221abebeea94da/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:42.025587 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f2080-33d9-4de6-adf8-283b155bc32a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:42.025889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f2080-33d9-4de6-adf8-283b155bc32a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:42.026313 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f2080-33d9-4de6-adf8-283b155bc32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:42.066230 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8d9f2080-33d9-4de6-adf8-283b155bc32a None None] MFA Rules not processed for user `caeae25be9574f228d221abebeea94da`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:42.067382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8d9f2080-33d9-4de6-adf8-283b155bc32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:42.162634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 912/1825] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:42.174998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efc9ae-4cef-480d-8ee4-8e206f5143cd admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:42.176887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b2efc9ae-4cef-480d-8ee4-8e206f5143cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:42.255731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efc9ae-4cef-480d-8ee4-8e206f5143cd admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:42.260393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a129eff-dd05-4d43-b0e1-311b435223b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:42.261825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a129eff-dd05-4d43-b0e1-311b435223b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:42.261825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a129eff-dd05-4d43-b0e1-311b435223b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:42.261825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a129eff-dd05-4d43-b0e1-311b435223b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:42.273215 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a129eff-dd05-4d43-b0e1-311b435223b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:42.275158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a129eff-dd05-4d43-b0e1-311b435223b1 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:42.285859 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 914/1826] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:42.343834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f2080-33d9-4de6-adf8-283b155bc32a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:42.346470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8d9f2080-33d9-4de6-adf8-283b155bc32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:42.363934 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f2080-33d9-4de6-adf8-283b155bc32a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:42.368584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba1e00-e701-4c15-ad17-4e346bcf067a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:42.369372 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba1e00-e701-4c15-ad17-4e346bcf067a service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:42.369755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba1e00-e701-4c15-ad17-4e346bcf067a service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:42.370127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba1e00-e701-4c15-ad17-4e346bcf067a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:42.372213 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d3ba1e00-e701-4c15-ad17-4e346bcf067a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:42.447548 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba1e00-e701-4c15-ad17-4e346bcf067a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:42.449618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba1e00-e701-4c15-ad17-4e346bcf067a service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:42.464467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 913/1827] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:42.485053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a129eff-dd05-4d43-b0e1-311b435223b1 service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:42.486617 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6a129eff-dd05-4d43-b0e1-311b435223b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:42.601993 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba1e00-e701-4c15-ad17-4e346bcf067a service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:42.603829 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d3ba1e00-e701-4c15-ad17-4e346bcf067a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:42.624935 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba1e00-e701-4c15-ad17-4e346bcf067a service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:42.632330 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376a50d-8552-455e-aeff-fb1714b42b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:42.633764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376a50d-8552-455e-aeff-fb1714b42b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:42.634345 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376a50d-8552-455e-aeff-fb1714b42b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:42.634546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376a50d-8552-455e-aeff-fb1714b42b72 admin admin] PATH_INFO: `/v3/projects/43179223197641548793880358ca525e` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:42.634979 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a129eff-dd05-4d43-b0e1-311b435223b1 service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:42.636039 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376a50d-8552-455e-aeff-fb1714b42b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43179223197641548793880358ca525e)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:42.638439 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376a50d-8552-455e-aeff-fb1714b42b72 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:42.661139 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf20c-b240-48bf-bbaf-027223cd96c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:42.662133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf20c-b240-48bf-bbaf-027223cd96c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:42.662502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf20c-b240-48bf-bbaf-027223cd96c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:42.662784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf20c-b240-48bf-bbaf-027223cd96c8 admin admin] PATH_INFO: `/v3/projects/907b4fc098974bd091c622da82a52a82` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:42.667114 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cf20c-b240-48bf-bbaf-027223cd96c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=907b4fc098974bd091c622da82a52a82)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:42.669552 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cf20c-b240-48bf-bbaf-027223cd96c8 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:42.735115 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f376a50d-8552-455e-aeff-fb1714b42b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43179223197641548793880358ca525e', 'request_id': 'req-f376a50d-8552-455e-aeff-fb1714b42b72'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:42.746744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f376a50d-8552-455e-aeff-fb1714b42b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43179223197641548793880358ca525e', 'request_id': 'req-f376a50d-8552-455e-aeff-fb1714b42b72'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:42.754318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f376a50d-8552-455e-aeff-fb1714b42b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43179223197641548793880358ca525e', 'request_id': 'req-f376a50d-8552-455e-aeff-fb1714b42b72'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:42.756524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d12cf20c-b240-48bf-bbaf-027223cd96c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907b4fc098974bd091c622da82a52a82', 'request_id': 'req-d12cf20c-b240-48bf-bbaf-027223cd96c8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:42.767834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d12cf20c-b240-48bf-bbaf-027223cd96c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907b4fc098974bd091c622da82a52a82', 'request_id': 'req-d12cf20c-b240-48bf-bbaf-027223cd96c8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:42.776961 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f376a50d-8552-455e-aeff-fb1714b42b72 admin admin] The token cache is being invalidate because project 43179223197641548793880358ca525e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:42.777408 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f376a50d-8552-455e-aeff-fb1714b42b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:42.777677 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d12cf20c-b240-48bf-bbaf-027223cd96c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907b4fc098974bd091c622da82a52a82', 'request_id': 'req-d12cf20c-b240-48bf-bbaf-027223cd96c8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:42.778153 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f376a50d-8552-455e-aeff-fb1714b42b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:42.782381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 914/1828] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:42 2022] DELETE /identity/v3/projects/43179223197641548793880358ca525e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:42:42.784131 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa03cc-6915-45c8-8387-0615faa0d49f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:42.784477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa03cc-6915-45c8-8387-0615faa0d49f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:42.785634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa03cc-6915-45c8-8387-0615faa0d49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:42.797631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d12cf20c-b240-48bf-bbaf-027223cd96c8 admin admin] The token cache is being invalidate because project 907b4fc098974bd091c622da82a52a82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:42.798085 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d12cf20c-b240-48bf-bbaf-027223cd96c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:42.798918 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d12cf20c-b240-48bf-bbaf-027223cd96c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:42.801136 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 915/1829] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:42 2022] DELETE /identity/v3/projects/907b4fc098974bd091c622da82a52a82 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:42.803669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf20c-b240-48bf-bbaf-027223cd96c8 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:42.807638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d12cf20c-b240-48bf-bbaf-027223cd96c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:42.814827 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d8aa03cc-6915-45c8-8387-0615faa0d49f None None] MFA Rules not processed for user `1b9eeed01d41446986dbf37c15ee4e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:42.816519 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d8aa03cc-6915-45c8-8387-0615faa0d49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:42.892208 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 915/1830] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:42.893428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa03cc-6915-45c8-8387-0615faa0d49f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:42.899275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d8aa03cc-6915-45c8-8387-0615faa0d49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:42.910275 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf20c-b240-48bf-bbaf-027223cd96c8 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:42.921548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60063f28-f6e9-4ec4-a800-60b30fe459d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:42.921791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa03cc-6915-45c8-8387-0615faa0d49f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:42.929291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60063f28-f6e9-4ec4-a800-60b30fe459d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:42.930825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60063f28-f6e9-4ec4-a800-60b30fe459d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:42.931609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6b16b-dfe4-4941-b2b0-3f1604c3dcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:42.932539 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60063f28-f6e9-4ec4-a800-60b30fe459d4 admin admin] PATH_INFO: `/v3/projects/ddc93d652b4948a283a6bbbac5951984` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:42.932897 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6b16b-dfe4-4941-b2b0-3f1604c3dcba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:42.934439 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6b16b-dfe4-4941-b2b0-3f1604c3dcba admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:42.934874 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6b16b-dfe4-4941-b2b0-3f1604c3dcba admin admin] PATH_INFO: `/v3/users/a5afa06d77b147f69ff1628691c20a08` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:42.935512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60063f28-f6e9-4ec4-a800-60b30fe459d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc93d652b4948a283a6bbbac5951984)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:42.936768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6b16b-dfe4-4941-b2b0-3f1604c3dcba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5afa06d77b147f69ff1628691c20a08)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:42.940379 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60063f28-f6e9-4ec4-a800-60b30fe459d4 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:42.943026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6b16b-dfe4-4941-b2b0-3f1604c3dcba admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:43.049555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-60063f28-f6e9-4ec4-a800-60b30fe459d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc93d652b4948a283a6bbbac5951984', 'request_id': 'req-60063f28-f6e9-4ec4-a800-60b30fe459d4'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.055582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-60063f28-f6e9-4ec4-a800-60b30fe459d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc93d652b4948a283a6bbbac5951984', 'request_id': 'req-60063f28-f6e9-4ec4-a800-60b30fe459d4'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.056600 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-23d6b16b-dfe4-4941-b2b0-3f1604c3dcba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5afa06d77b147f69ff1628691c20a08'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.065607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-23d6b16b-dfe4-4941-b2b0-3f1604c3dcba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5afa06d77b147f69ff1628691c20a08'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.066725 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-23d6b16b-dfe4-4941-b2b0-3f1604c3dcba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5afa06d77b147f69ff1628691c20a08'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.066849 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-60063f28-f6e9-4ec4-a800-60b30fe459d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc93d652b4948a283a6bbbac5951984', 'request_id': 'req-60063f28-f6e9-4ec4-a800-60b30fe459d4'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.067546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-23d6b16b-dfe4-4941-b2b0-3f1604c3dcba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5afa06d77b147f69ff1628691c20a08'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.085180 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-23d6b16b-dfe4-4941-b2b0-3f1604c3dcba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5afa06d77b147f69ff1628691c20a08'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.108399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-60063f28-f6e9-4ec4-a800-60b30fe459d4 admin admin] The token cache is being invalidate because project ddc93d652b4948a283a6bbbac5951984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:43.108665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-60063f28-f6e9-4ec4-a800-60b30fe459d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.109457 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-60063f28-f6e9-4ec4-a800-60b30fe459d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.111962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 916/1831] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:42 2022] DELETE /identity/v3/users/a5afa06d77b147f69ff1628691c20a08 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:43.112771 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 916/1832] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:42 2022] DELETE /identity/v3/projects/ddc93d652b4948a283a6bbbac5951984 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:43.119981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c571dc-5a70-47c1-8238-c71b309cdc62 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:43.120369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b82e4f-7071-40ea-b2ed-f06a93f88a39 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:43.120569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c571dc-5a70-47c1-8238-c71b309cdc62 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:43.120673 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b82e4f-7071-40ea-b2ed-f06a93f88a39 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:43.120951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b82e4f-7071-40ea-b2ed-f06a93f88a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:43.121122 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c571dc-5a70-47c1-8238-c71b309cdc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:43.145439 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-42c571dc-5a70-47c1-8238-c71b309cdc62 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:43.146551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-d7b82e4f-7071-40ea-b2ed-f06a93f88a39 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:43.146998 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-42c571dc-5a70-47c1-8238-c71b309cdc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:43.147717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d7b82e4f-7071-40ea-b2ed-f06a93f88a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:43.227947 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 917/1833] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:42:43.230650 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78453705-de76-4872-9a5c-f5a2f65d979a None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:43.231110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78453705-de76-4872-9a5c-f5a2f65d979a None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:43.231377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78453705-de76-4872-9a5c-f5a2f65d979a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:43.245908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 917/1834] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:43.253639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8dc38-b937-48d5-a540-4a69942bf7b1 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:43.253931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8dc38-b937-48d5-a540-4a69942bf7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:43.254237 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8dc38-b937-48d5-a540-4a69942bf7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:43.284317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-78453705-de76-4872-9a5c-f5a2f65d979a None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:43.285572 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-78453705-de76-4872-9a5c-f5a2f65d979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:43.295926 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a9e8dc38-b937-48d5-a540-4a69942bf7b1 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:43.297218 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a9e8dc38-b937-48d5-a540-4a69942bf7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:43.308692 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 918/1835] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:43.309119 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 918/1836] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:42:43.313155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78453705-de76-4872-9a5c-f5a2f65d979a None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:43.316881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8dc38-b937-48d5-a540-4a69942bf7b1 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:43.323621 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78453705-de76-4872-9a5c-f5a2f65d979a None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:43.330007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc261e01-7dda-42b6-81bd-30c1b2bf52d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:43.330213 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8dc38-b937-48d5-a540-4a69942bf7b1 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:43.332086 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc261e01-7dda-42b6-81bd-30c1b2bf52d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:43.332387 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc261e01-7dda-42b6-81bd-30c1b2bf52d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:43.332765 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc261e01-7dda-42b6-81bd-30c1b2bf52d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:43.334511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc261e01-7dda-42b6-81bd-30c1b2bf52d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:43.334924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc261e01-7dda-42b6-81bd-30c1b2bf52d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:43.337339 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d8305-750c-4496-8546-c0fe35cadc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:43.337608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc261e01-7dda-42b6-81bd-30c1b2bf52d3 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:43.338013 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d8305-750c-4496-8546-c0fe35cadc7e admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:43.338751 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d8305-750c-4496-8546-c0fe35cadc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:43.338751 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d8305-750c-4496-8546-c0fe35cadc7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:43.339332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d8305-750c-4496-8546-c0fe35cadc7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:43.340075 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d8305-750c-4496-8546-c0fe35cadc7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:43.341928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d8305-750c-4496-8546-c0fe35cadc7e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:43.362638 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 919/1837] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:43.364154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d8305-750c-4496-8546-c0fe35cadc7e admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:43.373334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 919/1838] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:42:43.374546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc261e01-7dda-42b6-81bd-30c1b2bf52d3 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:43.383432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d8305-750c-4496-8546-c0fe35cadc7e admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:43.388281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc261e01-7dda-42b6-81bd-30c1b2bf52d3 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:43.397251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254a303-d33f-4257-9062-38bbdcbf4413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:43.397765 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bd99b-1ec5-428b-b734-26e9a41241a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:43.398762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bd99b-1ec5-428b-b734-26e9a41241a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:43.399145 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bd99b-1ec5-428b-b734-26e9a41241a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:43.399332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254a303-d33f-4257-9062-38bbdcbf4413 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:43.399957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bd99b-1ec5-428b-b734-26e9a41241a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:43.400542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bd99b-1ec5-428b-b734-26e9a41241a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:43.401404 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254a303-d33f-4257-9062-38bbdcbf4413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:43.401892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254a303-d33f-4257-9062-38bbdcbf4413 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:43.402865 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254a303-d33f-4257-9062-38bbdcbf4413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:43.403307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bd99b-1ec5-428b-b734-26e9a41241a6 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:43.406127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254a303-d33f-4257-9062-38bbdcbf4413 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:43.444250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 920/1839] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:43 2022] POST /identity/v3/projects => generated 365 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:43.446433 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bd99b-1ec5-428b-b734-26e9a41241a6 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:43.460473 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 920/1840] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:43 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:42:43.461760 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254a303-d33f-4257-9062-38bbdcbf4413 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:43.547117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bd99b-1ec5-428b-b734-26e9a41241a6 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:43.631684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762de1d-f737-4c5a-aa63-2b497dfbb1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:43.632601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762de1d-f737-4c5a-aa63-2b497dfbb1dc admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:43.632961 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762de1d-f737-4c5a-aa63-2b497dfbb1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:43.633343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762de1d-f737-4c5a-aa63-2b497dfbb1dc admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:43.634178 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762de1d-f737-4c5a-aa63-2b497dfbb1dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:43.636223 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762de1d-f737-4c5a-aa63-2b497dfbb1dc admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:43.646685 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254a303-d33f-4257-9062-38bbdcbf4413 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:43.659385 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f07b87-6839-41a4-9690-9517a8b3e5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:43.659907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f07b87-6839-41a4-9690-9517a8b3e5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:43.662594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f07b87-6839-41a4-9690-9517a8b3e5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:43.662988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f07b87-6839-41a4-9690-9517a8b3e5b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:43.663842 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f07b87-6839-41a4-9690-9517a8b3e5b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:43.666023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f07b87-6839-41a4-9690-9517a8b3e5b7 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:43.674570 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 921/1841] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:43 2022] POST /identity/v3/users => generated 283 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:43.675600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762de1d-f737-4c5a-aa63-2b497dfbb1dc admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:43.682341 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-5762de1d-f737-4c5a-aa63-2b497dfbb1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:43.700065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 921/1842] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:43 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:43.701284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f07b87-6839-41a4-9690-9517a8b3e5b7 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:43.703507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-70f07b87-6839-41a4-9690-9517a8b3e5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:43.705696 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762de1d-f737-4c5a-aa63-2b497dfbb1dc admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:43.719991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f07b87-6839-41a4-9690-9517a8b3e5b7 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:43.722511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10373a6-8145-4f62-b2d0-c2172c61cc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:43.724158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10373a6-8145-4f62-b2d0-c2172c61cc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:43.725242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10373a6-8145-4f62-b2d0-c2172c61cc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:43.725675 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10373a6-8145-4f62-b2d0-c2172c61cc37 admin admin] PATH_INFO: `/v3/projects/395cbd3ca7164ae08bf8c843c0700258` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:43.727337 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10373a6-8145-4f62-b2d0-c2172c61cc37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=395cbd3ca7164ae08bf8c843c0700258)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:43.729437 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10373a6-8145-4f62-b2d0-c2172c61cc37 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:43.743416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6c4f8-55d9-4fa6-94fb-7dbf99a386a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:43.744516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6c4f8-55d9-4fa6-94fb-7dbf99a386a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:43.745395 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6c4f8-55d9-4fa6-94fb-7dbf99a386a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:43.745395 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6c4f8-55d9-4fa6-94fb-7dbf99a386a0 admin admin] PATH_INFO: `/v3/users/050b1d9a97824d9dbb68f84dad0e2b8a` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:43.746942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6c4f8-55d9-4fa6-94fb-7dbf99a386a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=050b1d9a97824d9dbb68f84dad0e2b8a)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:43.751264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6c4f8-55d9-4fa6-94fb-7dbf99a386a0 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:43.812565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f10373a6-8145-4f62-b2d0-c2172c61cc37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395cbd3ca7164ae08bf8c843c0700258', 'request_id': 'req-f10373a6-8145-4f62-b2d0-c2172c61cc37'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.820950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f10373a6-8145-4f62-b2d0-c2172c61cc37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395cbd3ca7164ae08bf8c843c0700258', 'request_id': 'req-f10373a6-8145-4f62-b2d0-c2172c61cc37'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.828851 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f10373a6-8145-4f62-b2d0-c2172c61cc37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395cbd3ca7164ae08bf8c843c0700258', 'request_id': 'req-f10373a6-8145-4f62-b2d0-c2172c61cc37'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.829072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d1f6c4f8-55d9-4fa6-94fb-7dbf99a386a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '050b1d9a97824d9dbb68f84dad0e2b8a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.840359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d1f6c4f8-55d9-4fa6-94fb-7dbf99a386a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '050b1d9a97824d9dbb68f84dad0e2b8a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.841310 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d1f6c4f8-55d9-4fa6-94fb-7dbf99a386a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '050b1d9a97824d9dbb68f84dad0e2b8a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.842235 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d1f6c4f8-55d9-4fa6-94fb-7dbf99a386a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '050b1d9a97824d9dbb68f84dad0e2b8a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.845868 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f10373a6-8145-4f62-b2d0-c2172c61cc37 admin admin] The token cache is being invalidate because project 395cbd3ca7164ae08bf8c843c0700258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:43.846276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f10373a6-8145-4f62-b2d0-c2172c61cc37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.846999 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f10373a6-8145-4f62-b2d0-c2172c61cc37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.852519 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 922/1843] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:43 2022] DELETE /identity/v3/projects/395cbd3ca7164ae08bf8c843c0700258 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:43.852519 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10373a6-8145-4f62-b2d0-c2172c61cc37 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:43.852519 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-f10373a6-8145-4f62-b2d0-c2172c61cc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:43.863351 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d1f6c4f8-55d9-4fa6-94fb-7dbf99a386a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '050b1d9a97824d9dbb68f84dad0e2b8a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:43.877975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 922/1844] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:43 2022] DELETE /identity/v3/users/050b1d9a97824d9dbb68f84dad0e2b8a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:43.879272 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6c4f8-55d9-4fa6-94fb-7dbf99a386a0 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:43.881324 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d1f6c4f8-55d9-4fa6-94fb-7dbf99a386a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:43.941125 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10373a6-8145-4f62-b2d0-c2172c61cc37 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:43.962604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6c4f8-55d9-4fa6-94fb-7dbf99a386a0 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:43.967661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589592d6-d2e1-41a0-89af-be16c8384313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:43.968470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589592d6-d2e1-41a0-89af-be16c8384313 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:43.969103 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589592d6-d2e1-41a0-89af-be16c8384313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:43.969604 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589592d6-d2e1-41a0-89af-be16c8384313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:43.970434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589592d6-d2e1-41a0-89af-be16c8384313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:43.972406 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589592d6-d2e1-41a0-89af-be16c8384313 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:43.983368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 923/1845] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:43.985082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626e3ea-b35b-4481-ba2a-335c1299cc06 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:43.985465 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626e3ea-b35b-4481-ba2a-335c1299cc06 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:43.985855 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626e3ea-b35b-4481-ba2a-335c1299cc06 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:43.987303 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 924/1846] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 5 15:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:42:43.988434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101a113-dc89-4603-bb58-5e53ef857e9b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:43.988849 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101a113-dc89-4603-bb58-5e53ef857e9b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:43.989219 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101a113-dc89-4603-bb58-5e53ef857e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.007536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a101a113-dc89-4603-bb58-5e53ef857e9b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:44.008887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a101a113-dc89-4603-bb58-5e53ef857e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:44.017179 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 925/1847] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:44.017923 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101a113-dc89-4603-bb58-5e53ef857e9b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:44.019991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a101a113-dc89-4603-bb58-5e53ef857e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:44.025837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a1078-6aad-499e-ac2d-e0c669cc5e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:44.026568 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a1078-6aad-499e-ac2d-e0c669cc5e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.026854 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a1078-6aad-499e-ac2d-e0c669cc5e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.027131 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a1078-6aad-499e-ac2d-e0c669cc5e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.027861 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a1078-6aad-499e-ac2d-e0c669cc5e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:44.029445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a1078-6aad-499e-ac2d-e0c669cc5e5a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:44.033027 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101a113-dc89-4603-bb58-5e53ef857e9b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:44.038937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91559ae-8844-4a19-a080-cbf32d21c36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:44.039744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91559ae-8844-4a19-a080-cbf32d21c36d admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.040122 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91559ae-8844-4a19-a080-cbf32d21c36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.040488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91559ae-8844-4a19-a080-cbf32d21c36d admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.043941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 923/1848] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:44.044084 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91559ae-8844-4a19-a080-cbf32d21c36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:44.044191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b988a4-cd09-49eb-9f0a-eff1c37266db None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.044277 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91559ae-8844-4a19-a080-cbf32d21c36d admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:44.044352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b988a4-cd09-49eb-9f0a-eff1c37266db None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.044352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b988a4-cd09-49eb-9f0a-eff1c37266db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.053957 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 926/1849] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:44.055422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ba9b3-88c0-46e5-b526-ef9701b2119e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.055922 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ba9b3-88c0-46e5-b526-ef9701b2119e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.056292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ba9b3-88c0-46e5-b526-ef9701b2119e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.063304 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-a6b988a4-cd09-49eb-9f0a-eff1c37266db None None] MFA Rules not processed for user `2a29a4b1b1aa45aea2e466d8f8b79365`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:44.064823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-a6b988a4-cd09-49eb-9f0a-eff1c37266db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:44.075621 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e73ba9b3-88c0-46e5-b526-ef9701b2119e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:44.077540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e73ba9b3-88c0-46e5-b526-ef9701b2119e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:44.087512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 927/1850] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:44.088336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ba9b3-88c0-46e5-b526-ef9701b2119e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:44.108570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ba9b3-88c0-46e5-b526-ef9701b2119e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:44.118515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6d1da-999a-46f3-8471-30f92830e3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:44.119197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6d1da-999a-46f3-8471-30f92830e3fe admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.119480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6d1da-999a-46f3-8471-30f92830e3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.119759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6d1da-999a-46f3-8471-30f92830e3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.121074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6d1da-999a-46f3-8471-30f92830e3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:44.122712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6d1da-999a-46f3-8471-30f92830e3fe admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:44.151081 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 928/1851] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:44.151081 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6d1da-999a-46f3-8471-30f92830e3fe admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:44.151317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 924/1852] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 5 15:42:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:44.151406 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b988a4-cd09-49eb-9f0a-eff1c37266db None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:44.164518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6d1da-999a-46f3-8471-30f92830e3fe admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:44.167985 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b988a4-cd09-49eb-9f0a-eff1c37266db None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:44.174869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca967a14-8e08-4e87-83d1-a1b984084e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:44.175198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1e514-a75d-40b9-bdca-6583ef510380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:44.178111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1e514-a75d-40b9-bdca-6583ef510380 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.178111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1e514-a75d-40b9-bdca-6583ef510380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.178111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1e514-a75d-40b9-bdca-6583ef510380 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.178523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca967a14-8e08-4e87-83d1-a1b984084e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.178523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca967a14-8e08-4e87-83d1-a1b984084e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.178523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca967a14-8e08-4e87-83d1-a1b984084e17 admin admin] PATH_INFO: `/v3/projects/4fe85994069f47c5baae0c795602da37/users/87fa92b4ceae4c80a7a05f282e2e1756/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.178769 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1e514-a75d-40b9-bdca-6583ef510380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:44.178769 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1e514-a75d-40b9-bdca-6583ef510380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:44.180838 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1e514-a75d-40b9-bdca-6583ef510380 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:44.196625 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 925/1853] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:44.204887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1af66-b3ec-48bf-93a4-e6e31a55345f None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.204887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1af66-b3ec-48bf-93a4-e6e31a55345f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.204887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1af66-b3ec-48bf-93a4-e6e31a55345f None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.204887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 926/1854] 10.222.0.58 () {54 vars in 912 bytes} [Thu May 5 15:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:42:44.205319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1af66-b3ec-48bf-93a4-e6e31a55345f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:44.219842 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1af66-b3ec-48bf-93a4-e6e31a55345f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:44.221446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca967a14-8e08-4e87-83d1-a1b984084e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe85994069f47c5baae0c795602da37, user_id=87fa92b4ceae4c80a7a05f282e2e1756, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:44.225560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d431a-d4ab-4016-8b99-7286c6e32026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:44.226600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d431a-d4ab-4016-8b99-7286c6e32026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.226881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d431a-d4ab-4016-8b99-7286c6e32026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.227155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d431a-d4ab-4016-8b99-7286c6e32026 admin admin] PATH_INFO: `/v3/projects/4145914ca74e4aff9a987fdeb19ce831/users/c1c0b48412614d5dbf0edfff42f7aa19/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.235246 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca967a14-8e08-4e87-83d1-a1b984084e17 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:44.250554 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d431a-d4ab-4016-8b99-7286c6e32026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4145914ca74e4aff9a987fdeb19ce831, user_id=c1c0b48412614d5dbf0edfff42f7aa19, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:44.253095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d431a-d4ab-4016-8b99-7286c6e32026 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:44.258587 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 929/1855] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:44 2022] PUT /identity/v3/projects/4fe85994069f47c5baae0c795602da37/users/87fa92b4ceae4c80a7a05f282e2e1756/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:44.259622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca967a14-8e08-4e87-83d1-a1b984084e17 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:44.261124 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ca967a14-8e08-4e87-83d1-a1b984084e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:44.283163 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 927/1856] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:44 2022] PUT /identity/v3/projects/4145914ca74e4aff9a987fdeb19ce831/users/c1c0b48412614d5dbf0edfff42f7aa19/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:44.284567 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d431a-d4ab-4016-8b99-7286c6e32026 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:44.349039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d431a-d4ab-4016-8b99-7286c6e32026 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:44.351332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca967a14-8e08-4e87-83d1-a1b984084e17 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:44.354130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c96cd-113d-4ee2-bb8d-ca727d409b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:44.354724 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c96cd-113d-4ee2-bb8d-ca727d409b57 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.355004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c96cd-113d-4ee2-bb8d-ca727d409b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.355274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c96cd-113d-4ee2-bb8d-ca727d409b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.355957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c96cd-113d-4ee2-bb8d-ca727d409b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:44.357912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c96cd-113d-4ee2-bb8d-ca727d409b57 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:44.389155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 928/1857] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:44 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:44.389155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c96cd-113d-4ee2-bb8d-ca727d409b57 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:44.389155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-991c96cd-113d-4ee2-bb8d-ca727d409b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:44.423392 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954e1f0-d951-4dbf-9247-8ae9a631bedd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:44.424058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e1f0-d951-4dbf-9247-8ae9a631bedd service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.424339 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e1f0-d951-4dbf-9247-8ae9a631bedd service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.424614 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e1f0-d951-4dbf-9247-8ae9a631bedd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.434290 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954e1f0-d951-4dbf-9247-8ae9a631bedd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:44.435865 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954e1f0-d951-4dbf-9247-8ae9a631bedd service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:44.446966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 930/1858] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:44.449086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1513167-d01a-448b-a4c2-f56d6b1fc580 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.449378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1513167-d01a-448b-a4c2-f56d6b1fc580 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.449653 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1513167-d01a-448b-a4c2-f56d6b1fc580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.463757 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c96cd-113d-4ee2-bb8d-ca727d409b57 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:44.469139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e1513167-d01a-448b-a4c2-f56d6b1fc580 None None] MFA Rules not processed for user `2fe9f8eb94c84c36ad7a49507b2c8360`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:44.469970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd321e3-d499-443a-9236-21727b70e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:44.470375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e1513167-d01a-448b-a4c2-f56d6b1fc580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:44.471336 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd321e3-d499-443a-9236-21727b70e2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.471710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd321e3-d499-443a-9236-21727b70e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.472080 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd321e3-d499-443a-9236-21727b70e2f8 admin admin] PATH_INFO: `/v3/projects/255aeae1543e48d69e2ff14c21350d97` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.473704 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd321e3-d499-443a-9236-21727b70e2f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=255aeae1543e48d69e2ff14c21350d97)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:44.475788 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd321e3-d499-443a-9236-21727b70e2f8 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:44.571118 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6dd321e3-d499-443a-9236-21727b70e2f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '255aeae1543e48d69e2ff14c21350d97', 'request_id': 'req-6dd321e3-d499-443a-9236-21727b70e2f8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:44.585549 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 931/1859] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 5 15:42:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:44.587396 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a52e4b-7d66-4697-bc03-170bc6cdde90 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.587800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a52e4b-7d66-4697-bc03-170bc6cdde90 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.588171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a52e4b-7d66-4697-bc03-170bc6cdde90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.593110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6dd321e3-d499-443a-9236-21727b70e2f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '255aeae1543e48d69e2ff14c21350d97', 'request_id': 'req-6dd321e3-d499-443a-9236-21727b70e2f8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:44.612881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6dd321e3-d499-443a-9236-21727b70e2f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '255aeae1543e48d69e2ff14c21350d97', 'request_id': 'req-6dd321e3-d499-443a-9236-21727b70e2f8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:44.653085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-c7a52e4b-7d66-4697-bc03-170bc6cdde90 None None] MFA Rules not processed for user `87fa92b4ceae4c80a7a05f282e2e1756`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:44.654879 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6dd321e3-d499-443a-9236-21727b70e2f8 admin admin] The token cache is being invalidate because project 255aeae1543e48d69e2ff14c21350d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:44.655214 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6dd321e3-d499-443a-9236-21727b70e2f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:44.655742 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c7a52e4b-7d66-4697-bc03-170bc6cdde90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:44.657139 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6dd321e3-d499-443a-9236-21727b70e2f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:44.661430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 929/1860] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:44 2022] DELETE /identity/v3/projects/255aeae1543e48d69e2ff14c21350d97 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:44.666134 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c009b9f-8720-4462-85bf-9a268369978c None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.666834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c009b9f-8720-4462-85bf-9a268369978c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.666834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c009b9f-8720-4462-85bf-9a268369978c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.739256 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-9c009b9f-8720-4462-85bf-9a268369978c None None] MFA Rules not processed for user `c1c0b48412614d5dbf0edfff42f7aa19`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:44.740971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9c009b9f-8720-4462-85bf-9a268369978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:44.761357 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 932/1861] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:44.762746 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a52e4b-7d66-4697-bc03-170bc6cdde90 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:44.765812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c7a52e4b-7d66-4697-bc03-170bc6cdde90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:44.850739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 930/1862] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:44.850739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c009b9f-8720-4462-85bf-9a268369978c None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:44.851972 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9c009b9f-8720-4462-85bf-9a268369978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:44.890376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a52e4b-7d66-4697-bc03-170bc6cdde90 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:44.898233 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564913d-32ac-479c-a57f-1bd961fc3332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:44.898988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564913d-32ac-479c-a57f-1bd961fc3332 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.899277 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564913d-32ac-479c-a57f-1bd961fc3332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.899559 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564913d-32ac-479c-a57f-1bd961fc3332 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.901092 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564913d-32ac-479c-a57f-1bd961fc3332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:44.903506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564913d-32ac-479c-a57f-1bd961fc3332 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:44.933303 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 933/1863] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:44 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:44.934614 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564913d-32ac-479c-a57f-1bd961fc3332 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:44.937801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c564913d-32ac-479c-a57f-1bd961fc3332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:44.953418 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564913d-32ac-479c-a57f-1bd961fc3332 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:44.954085 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c009b9f-8720-4462-85bf-9a268369978c None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:44.958493 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458c8e5-7b8e-487c-a677-3dd067aadeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:44.960078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458c8e5-7b8e-487c-a677-3dd067aadeef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.960513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458c8e5-7b8e-487c-a677-3dd067aadeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.960962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458c8e5-7b8e-487c-a677-3dd067aadeef admin admin] PATH_INFO: `/v3/users/30ebdd12072241a894286837a06a8681` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.961822 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed6968-612b-41bf-a47c-3ae4c60632c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:44.962589 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed6968-612b-41bf-a47c-3ae4c60632c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:44.962937 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed6968-612b-41bf-a47c-3ae4c60632c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:44.963148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458c8e5-7b8e-487c-a677-3dd067aadeef admin admin] RBAC: Authorizing `identity:delete_user(user_id=30ebdd12072241a894286837a06a8681)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:44.963342 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed6968-612b-41bf-a47c-3ae4c60632c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:44.965248 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-72ed6968-612b-41bf-a47c-3ae4c60632c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:44.965545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458c8e5-7b8e-487c-a677-3dd067aadeef admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:44.978501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed6968-612b-41bf-a47c-3ae4c60632c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:44.980762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed6968-612b-41bf-a47c-3ae4c60632c7 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:44.994754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 931/1864] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:44.996226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed6968-612b-41bf-a47c-3ae4c60632c7 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:44.997961 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-72ed6968-612b-41bf-a47c-3ae4c60632c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:45.037883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3458c8e5-7b8e-487c-a677-3dd067aadeef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30ebdd12072241a894286837a06a8681'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:45.050097 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3458c8e5-7b8e-487c-a677-3dd067aadeef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30ebdd12072241a894286837a06a8681'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:45.051444 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3458c8e5-7b8e-487c-a677-3dd067aadeef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30ebdd12072241a894286837a06a8681'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:45.052166 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3458c8e5-7b8e-487c-a677-3dd067aadeef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30ebdd12072241a894286837a06a8681'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:45.069889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3458c8e5-7b8e-487c-a677-3dd067aadeef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30ebdd12072241a894286837a06a8681'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:45.078834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed6968-612b-41bf-a47c-3ae4c60632c7 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:45.083461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6bf0a-890b-46e4-b642-f3d7853f49f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:45.085046 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6bf0a-890b-46e4-b642-f3d7853f49f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:45.085601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6bf0a-890b-46e4-b642-f3d7853f49f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:45.086110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6bf0a-890b-46e4-b642-f3d7853f49f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:45.088325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-70c6bf0a-890b-46e4-b642-f3d7853f49f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:45.091446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 934/1865] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:44 2022] DELETE /identity/v3/users/30ebdd12072241a894286837a06a8681 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:45.093011 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458c8e5-7b8e-487c-a677-3dd067aadeef admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:45.099143 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3458c8e5-7b8e-487c-a677-3dd067aadeef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:45.103746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6bf0a-890b-46e4-b642-f3d7853f49f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:45.105415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6bf0a-890b-46e4-b642-f3d7853f49f8 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:45.116827 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 932/1866] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:45.117238 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6bf0a-890b-46e4-b642-f3d7853f49f8 service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:45.118788 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-70c6bf0a-890b-46e4-b642-f3d7853f49f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:45.133121 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6bf0a-890b-46e4-b642-f3d7853f49f8 service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:45.183346 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458c8e5-7b8e-487c-a677-3dd067aadeef admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:45.188819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6104e7-9e71-415b-b5a9-5f8e1969ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:45.189528 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6104e7-9e71-415b-b5a9-5f8e1969ae44 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:45.189814 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6104e7-9e71-415b-b5a9-5f8e1969ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:45.190643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6104e7-9e71-415b-b5a9-5f8e1969ae44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:45.191206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6104e7-9e71-415b-b5a9-5f8e1969ae44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:45.194794 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6104e7-9e71-415b-b5a9-5f8e1969ae44 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:45.214234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00bce4-fe63-4712-a450-1f688a3cc7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:45.215117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00bce4-fe63-4712-a450-1f688a3cc7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:45.215537 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00bce4-fe63-4712-a450-1f688a3cc7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:45.216362 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00bce4-fe63-4712-a450-1f688a3cc7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:45.217378 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00bce4-fe63-4712-a450-1f688a3cc7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:45.219683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00bce4-fe63-4712-a450-1f688a3cc7e8 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:45.231392 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 933/1867] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:45.232251 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00bce4-fe63-4712-a450-1f688a3cc7e8 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:45.234104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9c00bce4-fe63-4712-a450-1f688a3cc7e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:45.236605 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 935/1868] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:45 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:45.237399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6104e7-9e71-415b-b5a9-5f8e1969ae44 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:45.250875 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00bce4-fe63-4712-a450-1f688a3cc7e8 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:45.323008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cf30f-269d-42ea-94f9-4d371e8c0bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:45.324165 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cf30f-269d-42ea-94f9-4d371e8c0bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:45.324543 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cf30f-269d-42ea-94f9-4d371e8c0bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:45.324987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cf30f-269d-42ea-94f9-4d371e8c0bd5 admin admin] PATH_INFO: `/v3/users/87fa92b4ceae4c80a7a05f282e2e1756` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:45.326758 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cf30f-269d-42ea-94f9-4d371e8c0bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87fa92b4ceae4c80a7a05f282e2e1756)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:45.329142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cf30f-269d-42ea-94f9-4d371e8c0bd5 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:45.346408 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6104e7-9e71-415b-b5a9-5f8e1969ae44 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:45.363389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b6d9d-34dc-42fb-841c-9f6ef74ecba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:45.364207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b6d9d-34dc-42fb-841c-9f6ef74ecba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:45.364534 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b6d9d-34dc-42fb-841c-9f6ef74ecba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:45.365097 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b6d9d-34dc-42fb-841c-9f6ef74ecba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:45.366128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b6d9d-34dc-42fb-841c-9f6ef74ecba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:45.369137 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b6d9d-34dc-42fb-841c-9f6ef74ecba3 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:45.390765 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 936/1869] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:45.394902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-8a9cf30f-269d-42ea-94f9-4d371e8c0bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87fa92b4ceae4c80a7a05f282e2e1756'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:45.395848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-8a9cf30f-269d-42ea-94f9-4d371e8c0bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87fa92b4ceae4c80a7a05f282e2e1756'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:45.398661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b6d9d-34dc-42fb-841c-9f6ef74ecba3 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:45.403463 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d99b6d9d-34dc-42fb-841c-9f6ef74ecba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:45.410206 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-8a9cf30f-269d-42ea-94f9-4d371e8c0bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87fa92b4ceae4c80a7a05f282e2e1756'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:45.426159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-8a9cf30f-269d-42ea-94f9-4d371e8c0bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87fa92b4ceae4c80a7a05f282e2e1756'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:45.427067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-8a9cf30f-269d-42ea-94f9-4d371e8c0bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87fa92b4ceae4c80a7a05f282e2e1756'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:45.432019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b6d9d-34dc-42fb-841c-9f6ef74ecba3 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:45.452972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878945c-5dbf-4873-9d61-42795419aa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:45.453900 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 934/1870] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:45 2022] DELETE /identity/v3/users/87fa92b4ceae4c80a7a05f282e2e1756 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:45.454899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cf30f-269d-42ea-94f9-4d371e8c0bd5 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:45.455014 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878945c-5dbf-4873-9d61-42795419aa01 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:45.455218 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878945c-5dbf-4873-9d61-42795419aa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:45.455504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878945c-5dbf-4873-9d61-42795419aa01 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:45.456210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878945c-5dbf-4873-9d61-42795419aa01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:45.456804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8a9cf30f-269d-42ea-94f9-4d371e8c0bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:45.460049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878945c-5dbf-4873-9d61-42795419aa01 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:45.495714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 937/1871] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:45 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:45.497280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878945c-5dbf-4873-9d61-42795419aa01 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:45.500144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0878945c-5dbf-4873-9d61-42795419aa01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:45.532198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cf30f-269d-42ea-94f9-4d371e8c0bd5 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:45.534503 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878945c-5dbf-4873-9d61-42795419aa01 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:45.541333 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e43800-9116-49ba-9006-8805a9d41a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:45.542461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dad990-077a-40e1-9ea5-b98f5efd4c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:45.543169 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e43800-9116-49ba-9006-8805a9d41a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:45.543501 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dad990-077a-40e1-9ea5-b98f5efd4c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:45.543750 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e43800-9116-49ba-9006-8805a9d41a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:45.543882 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dad990-077a-40e1-9ea5-b98f5efd4c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:45.544314 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dad990-077a-40e1-9ea5-b98f5efd4c2c admin admin] PATH_INFO: `/v3/projects/8900a3903b074ce79c38456a358fbbb1/users/f6119bc505f64e1e8c2f580c87b3f22d/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:45.544588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e43800-9116-49ba-9006-8805a9d41a2e admin admin] PATH_INFO: `/v3/projects/9d72e5424de74448ae9977b50942d3cb` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:45.545953 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e43800-9116-49ba-9006-8805a9d41a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d72e5424de74448ae9977b50942d3cb)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:45.549431 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e43800-9116-49ba-9006-8805a9d41a2e admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:45.564262 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dad990-077a-40e1-9ea5-b98f5efd4c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8900a3903b074ce79c38456a358fbbb1, user_id=f6119bc505f64e1e8c2f580c87b3f22d, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:45.567980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dad990-077a-40e1-9ea5-b98f5efd4c2c admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:45.601506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 938/1872] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:45 2022] PUT /identity/v3/projects/8900a3903b074ce79c38456a358fbbb1/users/f6119bc505f64e1e8c2f580c87b3f22d/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:45.601506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ea884-fc8a-4637-a8cf-04f8d5b616f2 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:45.601506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ea884-fc8a-4637-a8cf-04f8d5b616f2 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:45.601506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ea884-fc8a-4637-a8cf-04f8d5b616f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:45.624335 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-c26ea884-fc8a-4637-a8cf-04f8d5b616f2 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:45.625580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c26ea884-fc8a-4637-a8cf-04f8d5b616f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:45.639336 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-08e43800-9116-49ba-9006-8805a9d41a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d72e5424de74448ae9977b50942d3cb', 'request_id': 'req-08e43800-9116-49ba-9006-8805a9d41a2e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:45.651644 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-08e43800-9116-49ba-9006-8805a9d41a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d72e5424de74448ae9977b50942d3cb', 'request_id': 'req-08e43800-9116-49ba-9006-8805a9d41a2e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:45.658829 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-08e43800-9116-49ba-9006-8805a9d41a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d72e5424de74448ae9977b50942d3cb', 'request_id': 'req-08e43800-9116-49ba-9006-8805a9d41a2e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:45.678302 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-08e43800-9116-49ba-9006-8805a9d41a2e admin admin] The token cache is being invalidate because project 9d72e5424de74448ae9977b50942d3cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:45.678666 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-08e43800-9116-49ba-9006-8805a9d41a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:45.679372 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-08e43800-9116-49ba-9006-8805a9d41a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:45.681502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 935/1873] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:45 2022] DELETE /identity/v3/projects/9d72e5424de74448ae9977b50942d3cb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:45.682092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e43800-9116-49ba-9006-8805a9d41a2e admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:45.683488 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-08e43800-9116-49ba-9006-8805a9d41a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:45.711624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 939/1874] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:45.713661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefa742-390a-432c-8c44-ea076728a6e3 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:45.714475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefa742-390a-432c-8c44-ea076728a6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:45.714792 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefa742-390a-432c-8c44-ea076728a6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:45.747104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-0cefa742-390a-432c-8c44-ea076728a6e3 None None] MFA Rules not processed for user `f6119bc505f64e1e8c2f580c87b3f22d`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:45.749236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0cefa742-390a-432c-8c44-ea076728a6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:45.762530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e43800-9116-49ba-9006-8805a9d41a2e admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:45.770777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505eb35-38f7-4205-9bac-b7abb4a8ac3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:45.772000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505eb35-38f7-4205-9bac-b7abb4a8ac3c admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:45.772515 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505eb35-38f7-4205-9bac-b7abb4a8ac3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:45.772901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505eb35-38f7-4205-9bac-b7abb4a8ac3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:45.773722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505eb35-38f7-4205-9bac-b7abb4a8ac3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:45.775356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505eb35-38f7-4205-9bac-b7abb4a8ac3c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:45.788330 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 936/1875] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:45.789886 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8b805-e50d-412d-ac71-63aea2d44b8a None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:45.790200 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8b805-e50d-412d-ac71-63aea2d44b8a None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:45.791022 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8b805-e50d-412d-ac71-63aea2d44b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:45.813779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-3ad8b805-e50d-412d-ac71-63aea2d44b8a None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:45.815624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-3ad8b805-e50d-412d-ac71-63aea2d44b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:45.831035 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 937/1876] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:45.839189 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8b805-e50d-412d-ac71-63aea2d44b8a None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:45.840601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-3ad8b805-e50d-412d-ac71-63aea2d44b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:45.863093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 940/1877] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:45.864399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefa742-390a-432c-8c44-ea076728a6e3 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:45.889283 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefa742-390a-432c-8c44-ea076728a6e3 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:45.897354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7136f3-57d4-439a-b225-ca75769692fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:45.898923 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7136f3-57d4-439a-b225-ca75769692fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:45.899211 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7136f3-57d4-439a-b225-ca75769692fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:45.899486 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7136f3-57d4-439a-b225-ca75769692fa admin admin] PATH_INFO: `/v3/projects/6fc7406bc13945c694ee14a355d5e3ec/users/d39f460be9634c2e8096a995ae1c86bc/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:45.935193 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7136f3-57d4-439a-b225-ca75769692fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc7406bc13945c694ee14a355d5e3ec, user_id=d39f460be9634c2e8096a995ae1c86bc, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:45.940236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7136f3-57d4-439a-b225-ca75769692fa admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:45.976532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 941/1878] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:45 2022] PUT /identity/v3/projects/6fc7406bc13945c694ee14a355d5e3ec/users/d39f460be9634c2e8096a995ae1c86bc/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:45.978136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c4b0-2afa-4376-973b-960a892f00fd None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:45.978545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c4b0-2afa-4376-973b-960a892f00fd None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:45.979857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8b805-e50d-412d-ac71-63aea2d44b8a None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:45.986939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c4b0-2afa-4376-973b-960a892f00fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.014926 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d975c4b0-2afa-4376-973b-960a892f00fd None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:46.028344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d975c4b0-2afa-4376-973b-960a892f00fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:46.088559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a4c89-b118-46a9-8720-e0e8fb29cb58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:46.089218 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a4c89-b118-46a9-8720-e0e8fb29cb58 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.089488 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a4c89-b118-46a9-8720-e0e8fb29cb58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.089765 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a4c89-b118-46a9-8720-e0e8fb29cb58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.187285 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a4c89-b118-46a9-8720-e0e8fb29cb58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:46.188915 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a4c89-b118-46a9-8720-e0e8fb29cb58 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:46.192476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 942/1879] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:46.192615 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c4b0-2afa-4376-973b-960a892f00fd None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:46.195065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d975c4b0-2afa-4376-973b-960a892f00fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:46.203968 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 938/1880] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:46.204973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a4c89-b118-46a9-8720-e0e8fb29cb58 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:46.206526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-f97a4c89-b118-46a9-8720-e0e8fb29cb58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:46.219539 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a4c89-b118-46a9-8720-e0e8fb29cb58 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:46.224559 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c4b0-2afa-4376-973b-960a892f00fd None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:46.225603 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1079a-3be7-46d9-8fdb-6f78040328a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:46.228118 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1079a-3be7-46d9-8fdb-6f78040328a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.228588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1079a-3be7-46d9-8fdb-6f78040328a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.228853 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1079a-3be7-46d9-8fdb-6f78040328a9 admin admin] PATH_INFO: `/v3/users/2c90b5a0810249b5a91a7c9d5e73ecf9` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.232175 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60cca5-ac97-4ae6-9e6f-3188be68d68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:46.233079 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60cca5-ac97-4ae6-9e6f-3188be68d68e admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.233759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60cca5-ac97-4ae6-9e6f-3188be68d68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.233887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60cca5-ac97-4ae6-9e6f-3188be68d68e admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.234506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1079a-3be7-46d9-8fdb-6f78040328a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c90b5a0810249b5a91a7c9d5e73ecf9)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:46.234697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60cca5-ac97-4ae6-9e6f-3188be68d68e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:46.236427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1079a-3be7-46d9-8fdb-6f78040328a9 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:46.238015 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60cca5-ac97-4ae6-9e6f-3188be68d68e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:46.289191 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 943/1881] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:46 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:46.290895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60cca5-ac97-4ae6-9e6f-3188be68d68e admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:46.321311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d3f1079a-3be7-46d9-8fdb-6f78040328a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c90b5a0810249b5a91a7c9d5e73ecf9'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:46.322052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d3f1079a-3be7-46d9-8fdb-6f78040328a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c90b5a0810249b5a91a7c9d5e73ecf9'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:46.333305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d3f1079a-3be7-46d9-8fdb-6f78040328a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c90b5a0810249b5a91a7c9d5e73ecf9'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:46.344381 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d3f1079a-3be7-46d9-8fdb-6f78040328a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c90b5a0810249b5a91a7c9d5e73ecf9'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:46.346738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d3f1079a-3be7-46d9-8fdb-6f78040328a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c90b5a0810249b5a91a7c9d5e73ecf9'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:46.371604 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 939/1882] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:46 2022] DELETE /identity/v3/users/2c90b5a0810249b5a91a7c9d5e73ecf9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:46.371604 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1079a-3be7-46d9-8fdb-6f78040328a9 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:46.372353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d3f1079a-3be7-46d9-8fdb-6f78040328a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:46.377616 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60cca5-ac97-4ae6-9e6f-3188be68d68e admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:46.451909 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1079a-3be7-46d9-8fdb-6f78040328a9 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:46.457516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab137df-0048-4114-92a7-8d3c09ca9360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:46.458468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab137df-0048-4114-92a7-8d3c09ca9360 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.459329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab137df-0048-4114-92a7-8d3c09ca9360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.460020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab137df-0048-4114-92a7-8d3c09ca9360 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.460961 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab137df-0048-4114-92a7-8d3c09ca9360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:46.462284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab137df-0048-4114-92a7-8d3c09ca9360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:46.463236 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab137df-0048-4114-92a7-8d3c09ca9360 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:46.464109 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02838576-1952-4d74-a1f4-6f3bfe997d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:46.479890 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 940/1883] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:46.479890 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab137df-0048-4114-92a7-8d3c09ca9360 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:46.480593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02838576-1952-4d74-a1f4-6f3bfe997d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.481224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02838576-1952-4d74-a1f4-6f3bfe997d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.481512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02838576-1952-4d74-a1f4-6f3bfe997d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.481872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-aab137df-0048-4114-92a7-8d3c09ca9360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:46.485454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02838576-1952-4d74-a1f4-6f3bfe997d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:46.487485 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02838576-1952-4d74-a1f4-6f3bfe997d3d admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:46.501722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab137df-0048-4114-92a7-8d3c09ca9360 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:46.508885 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 944/1884] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:46.513503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede22555-08ad-4c68-8b9f-37f380a7301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:46.515472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede22555-08ad-4c68-8b9f-37f380a7301f admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.517932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc449c-f23b-48f0-af9d-53e6bd50304c None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.519037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede22555-08ad-4c68-8b9f-37f380a7301f admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.519454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc449c-f23b-48f0-af9d-53e6bd50304c None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.519637 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede22555-08ad-4c68-8b9f-37f380a7301f admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.519958 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc449c-f23b-48f0-af9d-53e6bd50304c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.520637 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede22555-08ad-4c68-8b9f-37f380a7301f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:46.524344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede22555-08ad-4c68-8b9f-37f380a7301f admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:46.552757 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 941/1885] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:46 2022] POST /identity/v3/users => generated 296 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:46.552757 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede22555-08ad-4c68-8b9f-37f380a7301f admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:46.564599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-67dc449c-f23b-48f0-af9d-53e6bd50304c None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:46.566274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede22555-08ad-4c68-8b9f-37f380a7301f admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:46.566624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-67dc449c-f23b-48f0-af9d-53e6bd50304c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:46.573151 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d0b5a-5c38-4210-9265-b66aac3b1d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:46.574383 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d0b5a-5c38-4210-9265-b66aac3b1d10 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.574858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d0b5a-5c38-4210-9265-b66aac3b1d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.575286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d0b5a-5c38-4210-9265-b66aac3b1d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.576049 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d0b5a-5c38-4210-9265-b66aac3b1d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:46.576877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 945/1886] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:46.578308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc449c-f23b-48f0-af9d-53e6bd50304c None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:46.579033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d0b5a-5c38-4210-9265-b66aac3b1d10 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:46.580932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-67dc449c-f23b-48f0-af9d-53e6bd50304c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:46.606247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc449c-f23b-48f0-af9d-53e6bd50304c None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:46.611651 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150be4da-f64f-4306-9ed8-34261dc93bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:46.612595 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150be4da-f64f-4306-9ed8-34261dc93bee admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.612874 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150be4da-f64f-4306-9ed8-34261dc93bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.613148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150be4da-f64f-4306-9ed8-34261dc93bee admin admin] PATH_INFO: `/v3/projects/6fc7406bc13945c694ee14a355d5e3ec/users/d39f460be9634c2e8096a995ae1c86bc/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.615623 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150be4da-f64f-4306-9ed8-34261dc93bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc7406bc13945c694ee14a355d5e3ec, user_id=d39f460be9634c2e8096a995ae1c86bc, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:46.618749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150be4da-f64f-4306-9ed8-34261dc93bee admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:46.622487 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 942/1887] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:46 2022] POST /identity/v3/projects => generated 357 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:46.623491 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d0b5a-5c38-4210-9265-b66aac3b1d10 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:46.631103 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 946/1888] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:46 2022] PUT /identity/v3/projects/6fc7406bc13945c694ee14a355d5e3ec/users/d39f460be9634c2e8096a995ae1c86bc/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:46.632161 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150be4da-f64f-4306-9ed8-34261dc93bee admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:46.634084 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-150be4da-f64f-4306-9ed8-34261dc93bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:46.697418 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150be4da-f64f-4306-9ed8-34261dc93bee admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:46.701524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cac8a2-7ce0-4f8e-805a-ea0c40383ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:46.702269 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cac8a2-7ce0-4f8e-805a-ea0c40383ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.702482 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cac8a2-7ce0-4f8e-805a-ea0c40383ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.702753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cac8a2-7ce0-4f8e-805a-ea0c40383ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.708542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d0b5a-5c38-4210-9265-b66aac3b1d10 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:46.768001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cac8a2-7ce0-4f8e-805a-ea0c40383ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:46.769503 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cac8a2-7ce0-4f8e-805a-ea0c40383ad2 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:46.773210 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4bc66-c6a3-45a5-b143-ef64e9c30e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:46.774067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4bc66-c6a3-45a5-b143-ef64e9c30e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.774403 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4bc66-c6a3-45a5-b143-ef64e9c30e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.774794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4bc66-c6a3-45a5-b143-ef64e9c30e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.775527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4bc66-c6a3-45a5-b143-ef64e9c30e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:46.777179 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4bc66-c6a3-45a5-b143-ef64e9c30e94 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:46.779324 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 947/1889] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:46.780148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cac8a2-7ce0-4f8e-805a-ea0c40383ad2 service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:46.781564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c5cac8a2-7ce0-4f8e-805a-ea0c40383ad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:46.788711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 943/1890] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:46.789134 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4bc66-c6a3-45a5-b143-ef64e9c30e94 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:46.799299 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4bc66-c6a3-45a5-b143-ef64e9c30e94 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:46.800575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cac8a2-7ce0-4f8e-805a-ea0c40383ad2 service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:46.805604 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646024aa-8629-46e9-913c-a1366bd697ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:46.806438 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646024aa-8629-46e9-913c-a1366bd697ee admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.806722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646024aa-8629-46e9-913c-a1366bd697ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.806996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646024aa-8629-46e9-913c-a1366bd697ee admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.807301 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125a43e-27d0-4816-9c6e-91201de51eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:46.807683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646024aa-8629-46e9-913c-a1366bd697ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:46.808499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125a43e-27d0-4816-9c6e-91201de51eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.809077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125a43e-27d0-4816-9c6e-91201de51eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.809361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125a43e-27d0-4816-9c6e-91201de51eda admin admin] PATH_INFO: `/v3/projects/4fe85994069f47c5baae0c795602da37` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.809618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646024aa-8629-46e9-913c-a1366bd697ee admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:46.810954 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125a43e-27d0-4816-9c6e-91201de51eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe85994069f47c5baae0c795602da37)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:46.812932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125a43e-27d0-4816-9c6e-91201de51eda admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:46.836324 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 944/1891] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:46 2022] POST /identity/v3/users => generated 279 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:46.838691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d86f2-b18a-45f6-93b4-683b7e6f9aff None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.838994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d86f2-b18a-45f6-93b4-683b7e6f9aff None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.839280 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d86f2-b18a-45f6-93b4-683b7e6f9aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.866483 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-a125a43e-27d0-4816-9c6e-91201de51eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe85994069f47c5baae0c795602da37', 'request_id': 'req-a125a43e-27d0-4816-9c6e-91201de51eda'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:46.868709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-047d86f2-b18a-45f6-93b4-683b7e6f9aff None None] MFA Rules not processed for user `d39f460be9634c2e8096a995ae1c86bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:46.869930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-047d86f2-b18a-45f6-93b4-683b7e6f9aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:46.873208 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-a125a43e-27d0-4816-9c6e-91201de51eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe85994069f47c5baae0c795602da37', 'request_id': 'req-a125a43e-27d0-4816-9c6e-91201de51eda'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:46.879673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-a125a43e-27d0-4816-9c6e-91201de51eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe85994069f47c5baae0c795602da37', 'request_id': 'req-a125a43e-27d0-4816-9c6e-91201de51eda'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:46.894275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-a125a43e-27d0-4816-9c6e-91201de51eda admin admin] The token cache is being invalidate because project 4fe85994069f47c5baae0c795602da37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:46.894743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-a125a43e-27d0-4816-9c6e-91201de51eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:46.895969 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-a125a43e-27d0-4816-9c6e-91201de51eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:46.897998 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 948/1892] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:46 2022] DELETE /identity/v3/projects/4fe85994069f47c5baae0c795602da37 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:46.898803 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125a43e-27d0-4816-9c6e-91201de51eda admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:46.900142 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a125a43e-27d0-4816-9c6e-91201de51eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:46.968101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 945/1893] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:46.969176 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d86f2-b18a-45f6-93b4-683b7e6f9aff None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:46.972358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-047d86f2-b18a-45f6-93b4-683b7e6f9aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:46.987446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125a43e-27d0-4816-9c6e-91201de51eda admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:46.989658 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d86f2-b18a-45f6-93b4-683b7e6f9aff None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:46.995747 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4d2cc-612e-4d44-8ed5-7aff33c53ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:46.995909 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888d8ac-7175-4b1d-858a-7b9d5a6b0002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:46.996489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888d8ac-7175-4b1d-858a-7b9d5a6b0002 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.996747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888d8ac-7175-4b1d-858a-7b9d5a6b0002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.996944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4d2cc-612e-4d44-8ed5-7aff33c53ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:46.997040 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888d8ac-7175-4b1d-858a-7b9d5a6b0002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.997307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4d2cc-612e-4d44-8ed5-7aff33c53ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:46.997662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4d2cc-612e-4d44-8ed5-7aff33c53ac4 admin admin] PATH_INFO: `/v3/projects/087be7e6c58a45c3b072ed20a07454e4/users/94bc65cb3f384015960fef40d178d2da/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:46.997769 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888d8ac-7175-4b1d-858a-7b9d5a6b0002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:46.999719 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888d8ac-7175-4b1d-858a-7b9d5a6b0002 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:47.015565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 946/1894] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:47.015565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d732932-ee13-43e2-b338-52a8b8052c62 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:47.015565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d732932-ee13-43e2-b338-52a8b8052c62 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:47.015889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4d2cc-612e-4d44-8ed5-7aff33c53ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=087be7e6c58a45c3b072ed20a07454e4, user_id=94bc65cb3f384015960fef40d178d2da, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:47.016523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d732932-ee13-43e2-b338-52a8b8052c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:47.018528 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4d2cc-612e-4d44-8ed5-7aff33c53ac4 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:47.032507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 949/1895] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:46 2022] PUT /identity/v3/projects/087be7e6c58a45c3b072ed20a07454e4/users/94bc65cb3f384015960fef40d178d2da/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:47.033543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4d2cc-612e-4d44-8ed5-7aff33c53ac4 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:47.035595 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b9d4d2cc-612e-4d44-8ed5-7aff33c53ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:47.036937 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-9d732932-ee13-43e2-b338-52a8b8052c62 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:47.038328 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9d732932-ee13-43e2-b338-52a8b8052c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:47.112853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4d2cc-612e-4d44-8ed5-7aff33c53ac4 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:47.116334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 947/1896] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:47.117196 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d732932-ee13-43e2-b338-52a8b8052c62 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:47.123357 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1fc46-308c-4885-928b-312de3df68f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:47.124231 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1fc46-308c-4885-928b-312de3df68f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:47.124509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1fc46-308c-4885-928b-312de3df68f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:47.126042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1fc46-308c-4885-928b-312de3df68f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:47.137232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d732932-ee13-43e2-b338-52a8b8052c62 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:47.144205 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d726f5a-9cef-4261-b982-6919231507e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:47.144951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d726f5a-9cef-4261-b982-6919231507e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:47.145309 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d726f5a-9cef-4261-b982-6919231507e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:47.145837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d726f5a-9cef-4261-b982-6919231507e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:47.148138 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d726f5a-9cef-4261-b982-6919231507e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:47.150386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d726f5a-9cef-4261-b982-6919231507e2 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:47.163548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 948/1897] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:47.168118 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d726f5a-9cef-4261-b982-6919231507e2 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:47.179772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d726f5a-9cef-4261-b982-6919231507e2 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:47.184860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bd90d-65b5-484e-800d-db45bb8deb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:47.186322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bd90d-65b5-484e-800d-db45bb8deb98 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:47.186612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bd90d-65b5-484e-800d-db45bb8deb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:47.186884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bd90d-65b5-484e-800d-db45bb8deb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:47.187606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bd90d-65b5-484e-800d-db45bb8deb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:47.189384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bd90d-65b5-484e-800d-db45bb8deb98 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:47.200569 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 949/1898] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:47.201725 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bd90d-65b5-484e-800d-db45bb8deb98 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:47.203809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-292bd90d-65b5-484e-800d-db45bb8deb98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:47.204730 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1fc46-308c-4885-928b-312de3df68f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:47.207437 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1fc46-308c-4885-928b-312de3df68f5 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:47.220479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bd90d-65b5-484e-800d-db45bb8deb98 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:47.226470 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14980477-f26e-4787-b2ec-a444d76e9e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:47.227440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14980477-f26e-4787-b2ec-a444d76e9e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:47.227778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14980477-f26e-4787-b2ec-a444d76e9e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:47.228116 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14980477-f26e-4787-b2ec-a444d76e9e3b admin admin] PATH_INFO: `/v3/projects/c6e54e2bf9ca418597de8dd60c96c657` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:47.229403 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14980477-f26e-4787-b2ec-a444d76e9e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e54e2bf9ca418597de8dd60c96c657)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:47.231641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14980477-f26e-4787-b2ec-a444d76e9e3b admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:47.237014 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 950/1899] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:47 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:47.241003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214fbce-07e0-480c-b787-fcf6f22dad63 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:47.242149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214fbce-07e0-480c-b787-fcf6f22dad63 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:47.243712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214fbce-07e0-480c-b787-fcf6f22dad63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:47.294776 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-0214fbce-07e0-480c-b787-fcf6f22dad63 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:47.297115 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0214fbce-07e0-480c-b787-fcf6f22dad63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:47.325856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-14980477-f26e-4787-b2ec-a444d76e9e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e54e2bf9ca418597de8dd60c96c657', 'request_id': 'req-14980477-f26e-4787-b2ec-a444d76e9e3b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:47.344703 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-14980477-f26e-4787-b2ec-a444d76e9e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e54e2bf9ca418597de8dd60c96c657', 'request_id': 'req-14980477-f26e-4787-b2ec-a444d76e9e3b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:47.359138 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-14980477-f26e-4787-b2ec-a444d76e9e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e54e2bf9ca418597de8dd60c96c657', 'request_id': 'req-14980477-f26e-4787-b2ec-a444d76e9e3b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:47.379920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-14980477-f26e-4787-b2ec-a444d76e9e3b admin admin] The token cache is being invalidate because project c6e54e2bf9ca418597de8dd60c96c657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:47.380115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-14980477-f26e-4787-b2ec-a444d76e9e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:47.381353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-14980477-f26e-4787-b2ec-a444d76e9e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:47.383777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 950/1900] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:47 2022] DELETE /identity/v3/projects/c6e54e2bf9ca418597de8dd60c96c657 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:47.384602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14980477-f26e-4787-b2ec-a444d76e9e3b admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:47.399127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-14980477-f26e-4787-b2ec-a444d76e9e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:47.425000 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 951/1901] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:47.425927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214fbce-07e0-480c-b787-fcf6f22dad63 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:47.428036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0214fbce-07e0-480c-b787-fcf6f22dad63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:47.449598 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214fbce-07e0-480c-b787-fcf6f22dad63 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:47.459192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1360f-b24e-4a42-8e06-cc537ac5a425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:47.460657 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1360f-b24e-4a42-8e06-cc537ac5a425 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:47.461306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1360f-b24e-4a42-8e06-cc537ac5a425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:47.461593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1360f-b24e-4a42-8e06-cc537ac5a425 admin admin] PATH_INFO: `/v3/projects/087be7e6c58a45c3b072ed20a07454e4/users/94bc65cb3f384015960fef40d178d2da/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:47.465027 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1360f-b24e-4a42-8e06-cc537ac5a425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=087be7e6c58a45c3b072ed20a07454e4, user_id=94bc65cb3f384015960fef40d178d2da, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:47.469270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1360f-b24e-4a42-8e06-cc537ac5a425 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:47.508966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 952/1902] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:47 2022] PUT /identity/v3/projects/087be7e6c58a45c3b072ed20a07454e4/users/94bc65cb3f384015960fef40d178d2da/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:47.508966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1360f-b24e-4a42-8e06-cc537ac5a425 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:47.520614 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-96e1360f-b24e-4a42-8e06-cc537ac5a425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:47.538340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14980477-f26e-4787-b2ec-a444d76e9e3b admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:47.593762 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1360f-b24e-4a42-8e06-cc537ac5a425 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:47.597943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402e055-e740-4662-81a5-3b8accf11df4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:47.598680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402e055-e740-4662-81a5-3b8accf11df4 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:47.598961 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402e055-e740-4662-81a5-3b8accf11df4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:47.600177 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402e055-e740-4662-81a5-3b8accf11df4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:47.602341 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9402e055-e740-4662-81a5-3b8accf11df4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:47.644111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f45ba8-f1a1-49e8-b410-dbbdd59f1c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:47.657797 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f45ba8-f1a1-49e8-b410-dbbdd59f1c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:47.659778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f45ba8-f1a1-49e8-b410-dbbdd59f1c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:47.660405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f45ba8-f1a1-49e8-b410-dbbdd59f1c3d admin admin] PATH_INFO: `/v3/projects/c6c8adfd9020408aa0e154a0f83b4f24/users/09eea1c18af149a6adfb1266018fd5cb/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:47.679642 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402e055-e740-4662-81a5-3b8accf11df4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:47.681103 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402e055-e740-4662-81a5-3b8accf11df4 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:47.694647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 953/1903] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:47.695089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f45ba8-f1a1-49e8-b410-dbbdd59f1c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c8adfd9020408aa0e154a0f83b4f24, user_id=09eea1c18af149a6adfb1266018fd5cb, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:47.695808 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402e055-e740-4662-81a5-3b8accf11df4 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:47.697526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9402e055-e740-4662-81a5-3b8accf11df4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:47.702348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f45ba8-f1a1-49e8-b410-dbbdd59f1c3d admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:47.716507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402e055-e740-4662-81a5-3b8accf11df4 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:47.737940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 951/1904] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:47 2022] PUT /identity/v3/projects/c6c8adfd9020408aa0e154a0f83b4f24/users/09eea1c18af149a6adfb1266018fd5cb/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:47.737940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f45ba8-f1a1-49e8-b410-dbbdd59f1c3d admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:47.741692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600f76e-3b7a-43fd-8491-fcd3650eea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:47.742908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600f76e-3b7a-43fd-8491-fcd3650eea7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:47.743399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600f76e-3b7a-43fd-8491-fcd3650eea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:47.743873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600f76e-3b7a-43fd-8491-fcd3650eea7c admin admin] PATH_INFO: `/v3/users/95a99d86eb294185825c94db1f409e93` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:47.745356 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600f76e-3b7a-43fd-8491-fcd3650eea7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a99d86eb294185825c94db1f409e93)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:47.747692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600f76e-3b7a-43fd-8491-fcd3650eea7c admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:47.825584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0600f76e-3b7a-43fd-8491-fcd3650eea7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a99d86eb294185825c94db1f409e93'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:47.837993 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f45ba8-f1a1-49e8-b410-dbbdd59f1c3d admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:47.843857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0600f76e-3b7a-43fd-8491-fcd3650eea7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a99d86eb294185825c94db1f409e93'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:47.844436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b45c00-5c75-49b9-9bec-2e53022e0c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:47.845050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b45c00-5c75-49b9-9bec-2e53022e0c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:47.845330 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b45c00-5c75-49b9-9bec-2e53022e0c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:47.845605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b45c00-5c75-49b9-9bec-2e53022e0c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:47.846022 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0600f76e-3b7a-43fd-8491-fcd3650eea7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a99d86eb294185825c94db1f409e93'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:47.846364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b45c00-5c75-49b9-9bec-2e53022e0c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:47.846727 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b45c00-5c75-49b9-9bec-2e53022e0c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:47.847639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0600f76e-3b7a-43fd-8491-fcd3650eea7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a99d86eb294185825c94db1f409e93'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:47.849108 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b45c00-5c75-49b9-9bec-2e53022e0c60 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:47.865325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 952/1905] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:47.871659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55904c83-5d1b-412a-abdd-9e7635ac9b0d None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:47.871881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55904c83-5d1b-412a-abdd-9e7635ac9b0d None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:47.872147 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55904c83-5d1b-412a-abdd-9e7635ac9b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:47.881676 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0600f76e-3b7a-43fd-8491-fcd3650eea7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a99d86eb294185825c94db1f409e93'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:47.912999 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 954/1906] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:47 2022] DELETE /identity/v3/users/95a99d86eb294185825c94db1f409e93 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:47.917358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81fd2f-79c1-413f-b492-6d37feff71a7 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:47.917654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81fd2f-79c1-413f-b492-6d37feff71a7 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:47.917775 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-55904c83-5d1b-412a-abdd-9e7635ac9b0d None None] MFA Rules not processed for user `94bc65cb3f384015960fef40d178d2da`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:47.917955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81fd2f-79c1-413f-b492-6d37feff71a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:47.919006 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-55904c83-5d1b-412a-abdd-9e7635ac9b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:47.981263 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-be81fd2f-79c1-413f-b492-6d37feff71a7 None None] MFA Rules not processed for user `09eea1c18af149a6adfb1266018fd5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:47.983458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-be81fd2f-79c1-413f-b492-6d37feff71a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:48.065094 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 953/1907] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:48.066044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55904c83-5d1b-412a-abdd-9e7635ac9b0d None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:48.070388 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-55904c83-5d1b-412a-abdd-9e7635ac9b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:48.126479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 955/1908] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:48.127833 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81fd2f-79c1-413f-b492-6d37feff71a7 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:48.129366 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-be81fd2f-79c1-413f-b492-6d37feff71a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:48.161670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55904c83-5d1b-412a-abdd-9e7635ac9b0d None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:48.166661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1880d-1497-4d36-af11-499fbe059e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:48.167331 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1880d-1497-4d36-af11-499fbe059e04 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:48.167612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1880d-1497-4d36-af11-499fbe059e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:48.167887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1880d-1497-4d36-af11-499fbe059e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:48.169128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1880d-1497-4d36-af11-499fbe059e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:48.171968 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1880d-1497-4d36-af11-499fbe059e04 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:48.220220 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 954/1909] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:48 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:48.221513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1880d-1497-4d36-af11-499fbe059e04 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:48.223388 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-42c1880d-1497-4d36-af11-499fbe059e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:48.259082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81fd2f-79c1-413f-b492-6d37feff71a7 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:48.360006 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1880d-1497-4d36-af11-499fbe059e04 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:48.365479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf867ff-dae4-498b-bbcc-2c35124a0068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:48.366154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf867ff-dae4-498b-bbcc-2c35124a0068 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:48.366473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf867ff-dae4-498b-bbcc-2c35124a0068 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:48.366748 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf867ff-dae4-498b-bbcc-2c35124a0068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:48.382087 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edcb19-c424-4f29-bcf1-6af0318e1d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:48.383176 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edcb19-c424-4f29-bcf1-6af0318e1d17 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:48.383686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edcb19-c424-4f29-bcf1-6af0318e1d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:48.384163 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edcb19-c424-4f29-bcf1-6af0318e1d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:48.450544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf867ff-dae4-498b-bbcc-2c35124a0068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:48.452089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf867ff-dae4-498b-bbcc-2c35124a0068 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:48.482198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 955/1910] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:48 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:48.484666 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf867ff-dae4-498b-bbcc-2c35124a0068 service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:48.520500 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edcb19-c424-4f29-bcf1-6af0318e1d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:48.523082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edcb19-c424-4f29-bcf1-6af0318e1d17 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:48.536311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 956/1911] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:48.547352 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edcb19-c424-4f29-bcf1-6af0318e1d17 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:48.549748 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-04edcb19-c424-4f29-bcf1-6af0318e1d17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:48.610468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf867ff-dae4-498b-bbcc-2c35124a0068 service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:48.622810 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9294d-a2a6-4d4b-80cd-f599a9731712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:48.624586 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9294d-a2a6-4d4b-80cd-f599a9731712 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:48.624874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9294d-a2a6-4d4b-80cd-f599a9731712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:48.626407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9294d-a2a6-4d4b-80cd-f599a9731712 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:48.627677 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9294d-a2a6-4d4b-80cd-f599a9731712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:48.630191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9294d-a2a6-4d4b-80cd-f599a9731712 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:48.635889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edcb19-c424-4f29-bcf1-6af0318e1d17 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:48.645329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3fad1-748f-4d03-8a57-2c6d76c6f023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:48.648157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3fad1-748f-4d03-8a57-2c6d76c6f023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:48.648988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3fad1-748f-4d03-8a57-2c6d76c6f023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:48.650196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3fad1-748f-4d03-8a57-2c6d76c6f023 admin admin] PATH_INFO: `/v3/projects/4a955d60428444ecac4b14bff63eebee` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:48.653472 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3fad1-748f-4d03-8a57-2c6d76c6f023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a955d60428444ecac4b14bff63eebee)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:48.656647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3fad1-748f-4d03-8a57-2c6d76c6f023 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:48.681965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 956/1912] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:48 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:48.683077 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9294d-a2a6-4d4b-80cd-f599a9731712 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:48.686600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-adf9294d-a2a6-4d4b-80cd-f599a9731712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:48.712023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9294d-a2a6-4d4b-80cd-f599a9731712 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:48.723789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c7560-5989-428b-8b89-5e218b965172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:48.726121 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c7560-5989-428b-8b89-5e218b965172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:48.726483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c7560-5989-428b-8b89-5e218b965172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:48.726889 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c7560-5989-428b-8b89-5e218b965172 admin admin] PATH_INFO: `/v3/users/09eea1c18af149a6adfb1266018fd5cb` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:48.728235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c7560-5989-428b-8b89-5e218b965172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09eea1c18af149a6adfb1266018fd5cb)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:48.731823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c7560-5989-428b-8b89-5e218b965172 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:48.763623 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-eca3fad1-748f-4d03-8a57-2c6d76c6f023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a955d60428444ecac4b14bff63eebee', 'request_id': 'req-eca3fad1-748f-4d03-8a57-2c6d76c6f023'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:48.772664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-eca3fad1-748f-4d03-8a57-2c6d76c6f023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a955d60428444ecac4b14bff63eebee', 'request_id': 'req-eca3fad1-748f-4d03-8a57-2c6d76c6f023'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:48.782737 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-eca3fad1-748f-4d03-8a57-2c6d76c6f023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a955d60428444ecac4b14bff63eebee', 'request_id': 'req-eca3fad1-748f-4d03-8a57-2c6d76c6f023'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:48.806026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-eca3fad1-748f-4d03-8a57-2c6d76c6f023 admin admin] The token cache is being invalidate because project 4a955d60428444ecac4b14bff63eebee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:48.806026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-eca3fad1-748f-4d03-8a57-2c6d76c6f023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:48.806882 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-eca3fad1-748f-4d03-8a57-2c6d76c6f023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:48.810208 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 957/1913] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:48 2022] DELETE /identity/v3/projects/4a955d60428444ecac4b14bff63eebee => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:48.810208 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3fad1-748f-4d03-8a57-2c6d76c6f023 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:48.813190 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-510c7560-5989-428b-8b89-5e218b965172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09eea1c18af149a6adfb1266018fd5cb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:48.814094 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-eca3fad1-748f-4d03-8a57-2c6d76c6f023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:48.814538 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-510c7560-5989-428b-8b89-5e218b965172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09eea1c18af149a6adfb1266018fd5cb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:48.828898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-510c7560-5989-428b-8b89-5e218b965172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09eea1c18af149a6adfb1266018fd5cb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:48.838161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-510c7560-5989-428b-8b89-5e218b965172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09eea1c18af149a6adfb1266018fd5cb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:48.838950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-510c7560-5989-428b-8b89-5e218b965172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09eea1c18af149a6adfb1266018fd5cb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:48.863232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 957/1914] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:48 2022] DELETE /identity/v3/users/09eea1c18af149a6adfb1266018fd5cb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:48.865587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c7560-5989-428b-8b89-5e218b965172 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:48.867855 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-510c7560-5989-428b-8b89-5e218b965172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:48.901121 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3fad1-748f-4d03-8a57-2c6d76c6f023 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:48.963754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c7560-5989-428b-8b89-5e218b965172 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:48.975182 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85775149-07be-4705-bd69-56a1d78838f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:48.976793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb389ae9-b4ba-4da9-ab69-aac4345caf2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:48.976922 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb389ae9-b4ba-4da9-ab69-aac4345caf2a service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:48.977199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb389ae9-b4ba-4da9-ab69-aac4345caf2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:48.977880 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb389ae9-b4ba-4da9-ab69-aac4345caf2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:48.979568 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85775149-07be-4705-bd69-56a1d78838f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:48.979860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85775149-07be-4705-bd69-56a1d78838f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:48.980136 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85775149-07be-4705-bd69-56a1d78838f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:48.981585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85775149-07be-4705-bd69-56a1d78838f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:48.983987 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-fb389ae9-b4ba-4da9-ab69-aac4345caf2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:48.985678 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85775149-07be-4705-bd69-56a1d78838f3 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:49.006797 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 958/1915] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:49.007663 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85775149-07be-4705-bd69-56a1d78838f3 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:49.013509 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-85775149-07be-4705-bd69-56a1d78838f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:49.031148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85775149-07be-4705-bd69-56a1d78838f3 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:49.049658 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82340e3d-a41d-4541-8fa0-467a8caefc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:49.051263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82340e3d-a41d-4541-8fa0-467a8caefc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:49.051789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82340e3d-a41d-4541-8fa0-467a8caefc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:49.053312 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82340e3d-a41d-4541-8fa0-467a8caefc47 admin admin] PATH_INFO: `/v3/users/caeae25be9574f228d221abebeea94da` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:49.055395 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82340e3d-a41d-4541-8fa0-467a8caefc47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caeae25be9574f228d221abebeea94da)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:49.059353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82340e3d-a41d-4541-8fa0-467a8caefc47 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:49.134628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb389ae9-b4ba-4da9-ab69-aac4345caf2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:49.136383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb389ae9-b4ba-4da9-ab69-aac4345caf2a service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:49.139271 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-82340e3d-a41d-4541-8fa0-467a8caefc47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caeae25be9574f228d221abebeea94da'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:49.140185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-82340e3d-a41d-4541-8fa0-467a8caefc47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caeae25be9574f228d221abebeea94da'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:49.160693 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-82340e3d-a41d-4541-8fa0-467a8caefc47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caeae25be9574f228d221abebeea94da'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:49.160921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 958/1916] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:49.166194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7e9c-8786-4a22-b79f-8db7df119956 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:49.167747 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7e9c-8786-4a22-b79f-8db7df119956 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:49.168039 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7e9c-8786-4a22-b79f-8db7df119956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:49.169533 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-82340e3d-a41d-4541-8fa0-467a8caefc47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caeae25be9574f228d221abebeea94da'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:49.170720 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-82340e3d-a41d-4541-8fa0-467a8caefc47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caeae25be9574f228d221abebeea94da'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:49.212878 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 959/1917] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:49 2022] DELETE /identity/v3/users/caeae25be9574f228d221abebeea94da => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:49.213705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82340e3d-a41d-4541-8fa0-467a8caefc47 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:49.219033 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-25ab7e9c-8786-4a22-b79f-8db7df119956 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:49.221280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-25ab7e9c-8786-4a22-b79f-8db7df119956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:49.222045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-82340e3d-a41d-4541-8fa0-467a8caefc47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:49.346460 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 959/1918] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:49.351233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82340e3d-a41d-4541-8fa0-467a8caefc47 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:49.361126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab7e9c-8786-4a22-b79f-8db7df119956 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:49.361891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-25ab7e9c-8786-4a22-b79f-8db7df119956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:49.385397 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae32a0e-0d12-446f-8ac7-fe8ff6659ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:49.386119 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae32a0e-0d12-446f-8ac7-fe8ff6659ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:49.391877 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae32a0e-0d12-446f-8ac7-fe8ff6659ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:49.392166 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae32a0e-0d12-446f-8ac7-fe8ff6659ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:49.392930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae32a0e-0d12-446f-8ac7-fe8ff6659ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:49.409516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae32a0e-0d12-446f-8ac7-fe8ff6659ed6 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:49.461149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 960/1919] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:49.472005 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae32a0e-0d12-446f-8ac7-fe8ff6659ed6 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:49.487511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae32a0e-0d12-446f-8ac7-fe8ff6659ed6 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:49.494756 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831ea3d-8695-4209-a623-c4fe32582890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:49.496159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831ea3d-8695-4209-a623-c4fe32582890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:49.496552 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831ea3d-8695-4209-a623-c4fe32582890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:49.496937 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831ea3d-8695-4209-a623-c4fe32582890 admin admin] PATH_INFO: `/v3/projects/ce6199a8008a47b5991db50568b500ba/users/8ebdbed50bb841ac9b996203b28cd6bf/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:49.536383 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831ea3d-8695-4209-a623-c4fe32582890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6199a8008a47b5991db50568b500ba, user_id=8ebdbed50bb841ac9b996203b28cd6bf, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:49.542254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831ea3d-8695-4209-a623-c4fe32582890 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:49.562242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 961/1920] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:49 2022] PUT /identity/v3/projects/ce6199a8008a47b5991db50568b500ba/users/8ebdbed50bb841ac9b996203b28cd6bf/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:49.573684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78163c-3736-441d-9255-31349ae1c616 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:49.574313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78163c-3736-441d-9255-31349ae1c616 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:49.574662 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78163c-3736-441d-9255-31349ae1c616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:49.586558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab7e9c-8786-4a22-b79f-8db7df119956 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:49.632604 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-2c78163c-3736-441d-9255-31349ae1c616 None None] MFA Rules not processed for user `8ebdbed50bb841ac9b996203b28cd6bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:49.637290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-2c78163c-3736-441d-9255-31349ae1c616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:49.700354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bd342-d783-4cc6-a8d3-6b3abbea4711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:49.701194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bd342-d783-4cc6-a8d3-6b3abbea4711 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:49.701625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bd342-d783-4cc6-a8d3-6b3abbea4711 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:49.702003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bd342-d783-4cc6-a8d3-6b3abbea4711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:49.798037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 962/1921] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:42:49.815670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78163c-3736-441d-9255-31349ae1c616 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:49.817474 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-2c78163c-3736-441d-9255-31349ae1c616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:49.842835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bd342-d783-4cc6-a8d3-6b3abbea4711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:49.844557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bd342-d783-4cc6-a8d3-6b3abbea4711 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:49.844809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78163c-3736-441d-9255-31349ae1c616 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:49.856249 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6fa74-d7ca-43cf-a35b-5249b54e74d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:49.857130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6fa74-d7ca-43cf-a35b-5249b54e74d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:49.857412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6fa74-d7ca-43cf-a35b-5249b54e74d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:49.857684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6fa74-d7ca-43cf-a35b-5249b54e74d1 admin admin] PATH_INFO: `/v3/projects/a5167ef29b1a4e55a861a5d9959d792c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:49.859501 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 960/1922] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:42:49.860162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6fa74-d7ca-43cf-a35b-5249b54e74d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5167ef29b1a4e55a861a5d9959d792c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:49.860358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bd342-d783-4cc6-a8d3-6b3abbea4711 service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:49.861694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8f5bd342-d783-4cc6-a8d3-6b3abbea4711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:49.862137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6fa74-d7ca-43cf-a35b-5249b54e74d1 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:49.934743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bd342-d783-4cc6-a8d3-6b3abbea4711 service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:49.940806 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f3b75-2e0c-4128-95f8-5272b4a67293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:49.941710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f3b75-2e0c-4128-95f8-5272b4a67293 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:49.941996 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f3b75-2e0c-4128-95f8-5272b4a67293 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:49.942331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f3b75-2e0c-4128-95f8-5272b4a67293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:49.967064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f3b75-2e0c-4128-95f8-5272b4a67293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:49.970630 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f3b75-2e0c-4128-95f8-5272b4a67293 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:49.998846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d6c6fa74-d7ca-43cf-a35b-5249b54e74d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5167ef29b1a4e55a861a5d9959d792c', 'request_id': 'req-d6c6fa74-d7ca-43cf-a35b-5249b54e74d1'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:50.018595 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 961/1923] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:50.019928 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d6c6fa74-d7ca-43cf-a35b-5249b54e74d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5167ef29b1a4e55a861a5d9959d792c', 'request_id': 'req-d6c6fa74-d7ca-43cf-a35b-5249b54e74d1'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:50.029412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d6c6fa74-d7ca-43cf-a35b-5249b54e74d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5167ef29b1a4e55a861a5d9959d792c', 'request_id': 'req-d6c6fa74-d7ca-43cf-a35b-5249b54e74d1'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:50.062257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d6c6fa74-d7ca-43cf-a35b-5249b54e74d1 admin admin] The token cache is being invalidate because project a5167ef29b1a4e55a861a5d9959d792c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:50.062257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d6c6fa74-d7ca-43cf-a35b-5249b54e74d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:50.062653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d6c6fa74-d7ca-43cf-a35b-5249b54e74d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:50.071582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 963/1924] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:49 2022] DELETE /identity/v3/projects/a5167ef29b1a4e55a861a5d9959d792c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:42:50.078411 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae6748-a955-490d-982c-71a9897b05cd None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:50.078705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae6748-a955-490d-982c-71a9897b05cd None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:50.079056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae6748-a955-490d-982c-71a9897b05cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:50.123649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f8ae6748-a955-490d-982c-71a9897b05cd None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:50.129936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f8ae6748-a955-490d-982c-71a9897b05cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:50.314989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 962/1925] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:50.323468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225491f-97bf-40c6-af33-7826fae43148 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:50.324027 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225491f-97bf-40c6-af33-7826fae43148 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:50.324027 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225491f-97bf-40c6-af33-7826fae43148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:50.367581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-f225491f-97bf-40c6-af33-7826fae43148 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:50.368804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-f225491f-97bf-40c6-af33-7826fae43148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:50.410572 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 964/1926] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:50.415560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae6748-a955-490d-982c-71a9897b05cd None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:50.432313 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae6748-a955-490d-982c-71a9897b05cd None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:50.444514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9438e0-823b-49f1-8bcf-7211d610c000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:50.445648 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9438e0-823b-49f1-8bcf-7211d610c000 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:50.446705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9438e0-823b-49f1-8bcf-7211d610c000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:50.447954 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9438e0-823b-49f1-8bcf-7211d610c000 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:50.449041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9438e0-823b-49f1-8bcf-7211d610c000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:50.453578 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9438e0-823b-49f1-8bcf-7211d610c000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:50.455153 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9438e0-823b-49f1-8bcf-7211d610c000 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:50.487798 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 963/1927] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:50.489002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225491f-97bf-40c6-af33-7826fae43148 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:50.501094 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225491f-97bf-40c6-af33-7826fae43148 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:50.528533 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e4e2a-0beb-4e4b-ade9-88502face1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:50.529352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e4e2a-0beb-4e4b-ade9-88502face1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:50.530730 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e4e2a-0beb-4e4b-ade9-88502face1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:50.531402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e4e2a-0beb-4e4b-ade9-88502face1c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:50.532977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e4e2a-0beb-4e4b-ade9-88502face1c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:50.538091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e4e2a-0beb-4e4b-ade9-88502face1c0 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:50.612123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 965/1928] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:50 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:50.617326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9438e0-823b-49f1-8bcf-7211d610c000 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:50.644175 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9438e0-823b-49f1-8bcf-7211d610c000 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:50.682645 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e4e2a-0beb-4e4b-ade9-88502face1c0 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:50.684730 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-1e0e4e2a-0beb-4e4b-ade9-88502face1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:50.837031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e4e2a-0beb-4e4b-ade9-88502face1c0 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:50.843077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a522d-e7b9-4ada-a995-7621aef72c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:50.844698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a522d-e7b9-4ada-a995-7621aef72c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:50.845382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a522d-e7b9-4ada-a995-7621aef72c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:50.845904 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a522d-e7b9-4ada-a995-7621aef72c9b admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:50.846041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34864cce-3b70-4819-bafc-3237ccc20d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:50.846953 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a522d-e7b9-4ada-a995-7621aef72c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:50.847306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34864cce-3b70-4819-bafc-3237ccc20d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:50.847594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34864cce-3b70-4819-bafc-3237ccc20d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:50.847861 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34864cce-3b70-4819-bafc-3237ccc20d0a admin admin] PATH_INFO: `/v3/projects/c6c8adfd9020408aa0e154a0f83b4f24` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:50.849131 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34864cce-3b70-4819-bafc-3237ccc20d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c8adfd9020408aa0e154a0f83b4f24)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:50.850011 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a522d-e7b9-4ada-a995-7621aef72c9b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:50.852024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34864cce-3b70-4819-bafc-3237ccc20d0a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:50.912697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 964/1929] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:50 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:50.914312 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a522d-e7b9-4ada-a995-7621aef72c9b admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:50.935663 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a522d-e7b9-4ada-a995-7621aef72c9b admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:50.957886 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-34864cce-3b70-4819-bafc-3237ccc20d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c8adfd9020408aa0e154a0f83b4f24', 'request_id': 'req-34864cce-3b70-4819-bafc-3237ccc20d0a'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:50.964815 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-34864cce-3b70-4819-bafc-3237ccc20d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c8adfd9020408aa0e154a0f83b4f24', 'request_id': 'req-34864cce-3b70-4819-bafc-3237ccc20d0a'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:50.979141 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-34864cce-3b70-4819-bafc-3237ccc20d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c8adfd9020408aa0e154a0f83b4f24', 'request_id': 'req-34864cce-3b70-4819-bafc-3237ccc20d0a'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:51.010029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-34864cce-3b70-4819-bafc-3237ccc20d0a admin admin] The token cache is being invalidate because project c6c8adfd9020408aa0e154a0f83b4f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:51.011262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-34864cce-3b70-4819-bafc-3237ccc20d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:51.014205 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-34864cce-3b70-4819-bafc-3237ccc20d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:51.022306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 966/1930] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:50 2022] DELETE /identity/v3/projects/c6c8adfd9020408aa0e154a0f83b4f24 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:42:51.023618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f32df3-3f04-4765-898b-48413ec3e88d None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.023920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f32df3-3f04-4765-898b-48413ec3e88d None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.024189 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f32df3-3f04-4765-898b-48413ec3e88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.081854 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-a0f32df3-3f04-4765-898b-48413ec3e88d None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:51.086913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-a0f32df3-3f04-4765-898b-48413ec3e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:51.135655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79830817-6830-43e7-9cbf-a70d3b103537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:51.136380 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79830817-6830-43e7-9cbf-a70d3b103537 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.136823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79830817-6830-43e7-9cbf-a70d3b103537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.137109 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79830817-6830-43e7-9cbf-a70d3b103537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.137854 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79830817-6830-43e7-9cbf-a70d3b103537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:51.139693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79830817-6830-43e7-9cbf-a70d3b103537 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:51.167500 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 965/1931] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:51.174585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79830817-6830-43e7-9cbf-a70d3b103537 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:51.180082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-79830817-6830-43e7-9cbf-a70d3b103537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:51.217285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79830817-6830-43e7-9cbf-a70d3b103537 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:51.229182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdfe96-b87f-4cef-9be6-013094736def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:51.229943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdfe96-b87f-4cef-9be6-013094736def admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.230256 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdfe96-b87f-4cef-9be6-013094736def admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.230600 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdfe96-b87f-4cef-9be6-013094736def admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.231336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdfe96-b87f-4cef-9be6-013094736def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:51.233027 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdfe96-b87f-4cef-9be6-013094736def admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:51.250215 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 967/1932] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:51.262185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24166e64-bae9-4f6d-8547-953ad0c1f3dc None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.262615 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24166e64-bae9-4f6d-8547-953ad0c1f3dc None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.262832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24166e64-bae9-4f6d-8547-953ad0c1f3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.292354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 966/1933] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:51.308906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdfe96-b87f-4cef-9be6-013094736def admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:51.332803 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-24166e64-bae9-4f6d-8547-953ad0c1f3dc None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:51.336055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-24166e64-bae9-4f6d-8547-953ad0c1f3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:51.339433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdfe96-b87f-4cef-9be6-013094736def admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:51.350584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f7033-ff98-452c-8015-a7d37822d869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:51.352484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f7033-ff98-452c-8015-a7d37822d869 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.357126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f7033-ff98-452c-8015-a7d37822d869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.357126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f7033-ff98-452c-8015-a7d37822d869 admin admin] PATH_INFO: `/v3/projects/a497e0c9896b45c4aea16965cbf02d2f/users/8594809654ea45d598a1a934183a3b01/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.357398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 968/1934] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:51.358401 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24166e64-bae9-4f6d-8547-953ad0c1f3dc None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:51.375075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24166e64-bae9-4f6d-8547-953ad0c1f3dc None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:51.380083 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc4423-852c-4603-b3f3-d50e95ac9c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:51.381406 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc4423-852c-4603-b3f3-d50e95ac9c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.382111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc4423-852c-4603-b3f3-d50e95ac9c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.382505 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc4423-852c-4603-b3f3-d50e95ac9c53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.383325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc4423-852c-4603-b3f3-d50e95ac9c53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:51.383695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc4423-852c-4603-b3f3-d50e95ac9c53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:51.384796 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f7033-ff98-452c-8015-a7d37822d869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a497e0c9896b45c4aea16965cbf02d2f, user_id=8594809654ea45d598a1a934183a3b01, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:51.385492 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc4423-852c-4603-b3f3-d50e95ac9c53 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:51.388283 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f7033-ff98-452c-8015-a7d37822d869 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:51.401577 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 969/1935] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:51.405063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc4423-852c-4603-b3f3-d50e95ac9c53 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:51.410674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 967/1936] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:51 2022] PUT /identity/v3/projects/a497e0c9896b45c4aea16965cbf02d2f/users/8594809654ea45d598a1a934183a3b01/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:51.421629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb70c0c-e26f-4ddf-bc8a-274bb54ab756 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.421913 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb70c0c-e26f-4ddf-bc8a-274bb54ab756 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.422385 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb70c0c-e26f-4ddf-bc8a-274bb54ab756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.425079 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc4423-852c-4603-b3f3-d50e95ac9c53 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:51.472655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-fbb70c0c-e26f-4ddf-bc8a-274bb54ab756 None None] MFA Rules not processed for user `8594809654ea45d598a1a934183a3b01`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:51.474479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-fbb70c0c-e26f-4ddf-bc8a-274bb54ab756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:51.487367 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f18f7e-1f48-4343-b316-796ec9966058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:51.488162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f18f7e-1f48-4343-b316-796ec9966058 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.488471 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f18f7e-1f48-4343-b316-796ec9966058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.488817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f18f7e-1f48-4343-b316-796ec9966058 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.490333 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f18f7e-1f48-4343-b316-796ec9966058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:51.492968 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f18f7e-1f48-4343-b316-796ec9966058 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:51.531468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 970/1937] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:51 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:51.532510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f18f7e-1f48-4343-b316-796ec9966058 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:51.558239 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 968/1938] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:42:51.562404 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb70c0c-e26f-4ddf-bc8a-274bb54ab756 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:51.574824 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb70c0c-e26f-4ddf-bc8a-274bb54ab756 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:51.613031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f18f7e-1f48-4343-b316-796ec9966058 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:51.633096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a0e7b-3624-4664-b40a-2c28ff7c8f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:51.636380 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a0e7b-3624-4664-b40a-2c28ff7c8f52 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.636681 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a0e7b-3624-4664-b40a-2c28ff7c8f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.636965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a0e7b-3624-4664-b40a-2c28ff7c8f52 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.637666 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a0e7b-3624-4664-b40a-2c28ff7c8f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:51.641107 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976109d-b41b-4de0-96ce-79514f186250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:51.641775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976109d-b41b-4de0-96ce-79514f186250 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.642063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976109d-b41b-4de0-96ce-79514f186250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.642382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976109d-b41b-4de0-96ce-79514f186250 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.643081 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976109d-b41b-4de0-96ce-79514f186250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:51.644982 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976109d-b41b-4de0-96ce-79514f186250 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:51.648847 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a0e7b-3624-4664-b40a-2c28ff7c8f52 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:51.700164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 971/1939] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:51 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:42:51.703854 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a0e7b-3624-4664-b40a-2c28ff7c8f52 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:51.711936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 969/1940] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:51 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:42:51.719767 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976109d-b41b-4de0-96ce-79514f186250 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:51.727735 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a0e7b-3624-4664-b40a-2c28ff7c8f52 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:51.807679 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976109d-b41b-4de0-96ce-79514f186250 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:51.815986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079d09e-6de9-4dd3-8287-fd5c318fb585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:51.817440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079d09e-6de9-4dd3-8287-fd5c318fb585 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.818078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079d09e-6de9-4dd3-8287-fd5c318fb585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.818458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079d09e-6de9-4dd3-8287-fd5c318fb585 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.818561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9b82d-e55f-4336-a942-721bab80c3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:51.819262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9b82d-e55f-4336-a942-721bab80c3ab admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.819365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079d09e-6de9-4dd3-8287-fd5c318fb585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:51.819543 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9b82d-e55f-4336-a942-721bab80c3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.819903 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9b82d-e55f-4336-a942-721bab80c3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.820640 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9b82d-e55f-4336-a942-721bab80c3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:51.821826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079d09e-6de9-4dd3-8287-fd5c318fb585 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:51.822366 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9b82d-e55f-4336-a942-721bab80c3ab admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:51.835632 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 972/1941] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:51.840091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9b82d-e55f-4336-a942-721bab80c3ab admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:51.851624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 970/1942] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:51 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:51.857610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9b82d-e55f-4336-a942-721bab80c3ab admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:51.859100 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079d09e-6de9-4dd3-8287-fd5c318fb585 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:51.863299 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16a1da-cf82-4b66-a092-55c920949167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:51.864092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16a1da-cf82-4b66-a092-55c920949167 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.864445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16a1da-cf82-4b66-a092-55c920949167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.864840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16a1da-cf82-4b66-a092-55c920949167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.865658 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16a1da-cf82-4b66-a092-55c920949167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:51.867804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16a1da-cf82-4b66-a092-55c920949167 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:51.871676 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079d09e-6de9-4dd3-8287-fd5c318fb585 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:51.877017 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2494f4-feeb-459a-9c6d-fb2585cc09cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:51.878111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2494f4-feeb-459a-9c6d-fb2585cc09cd admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.878690 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2494f4-feeb-459a-9c6d-fb2585cc09cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.879139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2494f4-feeb-459a-9c6d-fb2585cc09cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.880059 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2494f4-feeb-459a-9c6d-fb2585cc09cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:51.884468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 973/1943] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:51.885685 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16a1da-cf82-4b66-a092-55c920949167 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:51.886649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2494f4-feeb-459a-9c6d-fb2585cc09cd admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:51.898641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 971/1944] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:51.902004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16a1da-cf82-4b66-a092-55c920949167 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:51.903066 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2494f4-feeb-459a-9c6d-fb2585cc09cd admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:51.907840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef87ce-fa30-40c6-aaf3-d95ca2c184a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:51.909874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef87ce-fa30-40c6-aaf3-d95ca2c184a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.910189 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef87ce-fa30-40c6-aaf3-d95ca2c184a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.910476 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef87ce-fa30-40c6-aaf3-d95ca2c184a0 admin admin] PATH_INFO: `/v3/projects/d4e49eb80f604a5cb27b5f86788302f0/users/d161fa00a7ee48a8a8bb77fe72ad87ba/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.917082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2494f4-feeb-459a-9c6d-fb2585cc09cd admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:51.929337 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc2745-ebd5-4c48-8a0d-6515798039b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:51.930027 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef87ce-fa30-40c6-aaf3-d95ca2c184a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4e49eb80f604a5cb27b5f86788302f0, user_id=d161fa00a7ee48a8a8bb77fe72ad87ba, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:51.930418 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc2745-ebd5-4c48-8a0d-6515798039b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.930698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc2745-ebd5-4c48-8a0d-6515798039b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.931249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc2745-ebd5-4c48-8a0d-6515798039b6 admin admin] PATH_INFO: `/v3/projects/8fa5d151967a410eaba11f0e40883883/users/69c423506c724b5ea1af49fcb6b2a919/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.932698 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef87ce-fa30-40c6-aaf3-d95ca2c184a0 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:51.948994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc2745-ebd5-4c48-8a0d-6515798039b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa5d151967a410eaba11f0e40883883, user_id=69c423506c724b5ea1af49fcb6b2a919, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:51.951101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 974/1945] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:51 2022] PUT /identity/v3/projects/d4e49eb80f604a5cb27b5f86788302f0/users/d161fa00a7ee48a8a8bb77fe72ad87ba/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:42:51.952023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc2745-ebd5-4c48-8a0d-6515798039b6 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:51.953790 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc4bd5-9553-4653-b9b6-c1470505376a None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:51.954080 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc4bd5-9553-4653-b9b6-c1470505376a None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:51.954389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc4bd5-9553-4653-b9b6-c1470505376a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:51.966861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 972/1946] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:51 2022] PUT /identity/v3/projects/8fa5d151967a410eaba11f0e40883883/users/69c423506c724b5ea1af49fcb6b2a919/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:51.970608 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc2745-ebd5-4c48-8a0d-6515798039b6 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:51.976510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-50fc4bd5-9553-4653-b9b6-c1470505376a None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:51.978607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-50fc4bd5-9553-4653-b9b6-c1470505376a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:52.040533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc2745-ebd5-4c48-8a0d-6515798039b6 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:52.051309 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 975/1947] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:42:52.055526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8779f-8897-40ec-942c-c163780dec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:52.056245 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8779f-8897-40ec-942c-c163780dec7d admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:52.056530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8779f-8897-40ec-942c-c163780dec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:52.056804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8779f-8897-40ec-942c-c163780dec7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:52.057565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8779f-8897-40ec-942c-c163780dec7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:52.058737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc4bd5-9553-4653-b9b6-c1470505376a None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:52.059882 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8779f-8897-40ec-942c-c163780dec7d admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:52.060110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-50fc4bd5-9553-4653-b9b6-c1470505376a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:52.072125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 973/1948] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:42:52.076212 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8779f-8897-40ec-942c-c163780dec7d admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:52.087379 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8779f-8897-40ec-942c-c163780dec7d admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:52.092922 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01badebd-3afd-4344-beae-6a2270b1dc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:52.094231 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01badebd-3afd-4344-beae-6a2270b1dc32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:52.094524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01badebd-3afd-4344-beae-6a2270b1dc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:52.094795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01badebd-3afd-4344-beae-6a2270b1dc32 admin admin] PATH_INFO: `/v3/projects/8fa5d151967a410eaba11f0e40883883/users/69c423506c724b5ea1af49fcb6b2a919/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:52.096994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01badebd-3afd-4344-beae-6a2270b1dc32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa5d151967a410eaba11f0e40883883, user_id=69c423506c724b5ea1af49fcb6b2a919, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:52.101423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01badebd-3afd-4344-beae-6a2270b1dc32 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:52.115308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 974/1949] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:52 2022] PUT /identity/v3/projects/8fa5d151967a410eaba11f0e40883883/users/69c423506c724b5ea1af49fcb6b2a919/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:42:52.125792 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e67cc4-4e21-433f-83a5-4ed789104e92 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:52.126073 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e67cc4-4e21-433f-83a5-4ed789104e92 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:52.127027 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e67cc4-4e21-433f-83a5-4ed789104e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:52.138158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc4bd5-9553-4653-b9b6-c1470505376a None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:52.175059 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-94e67cc4-4e21-433f-83a5-4ed789104e92 None None] MFA Rules not processed for user `69c423506c724b5ea1af49fcb6b2a919`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:52.176272 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-94e67cc4-4e21-433f-83a5-4ed789104e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:52.193404 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806149c-3df0-4c91-97cf-9544cdcb701b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:52.194187 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806149c-3df0-4c91-97cf-9544cdcb701b service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:52.194489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806149c-3df0-4c91-97cf-9544cdcb701b service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:52.194861 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806149c-3df0-4c91-97cf-9544cdcb701b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:52.259413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 975/1950] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:52.264574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806149c-3df0-4c91-97cf-9544cdcb701b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:52.266043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806149c-3df0-4c91-97cf-9544cdcb701b service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:52.276856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 976/1951] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:42:52.405085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e67cc4-4e21-433f-83a5-4ed789104e92 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:52.406794 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-94e67cc4-4e21-433f-83a5-4ed789104e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:52.465697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e67cc4-4e21-433f-83a5-4ed789104e92 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:52.469682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c11d7-d2df-454f-b759-a4b6a8668413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:52.470267 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c11d7-d2df-454f-b759-a4b6a8668413 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:52.470552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c11d7-d2df-454f-b759-a4b6a8668413 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:52.470825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c11d7-d2df-454f-b759-a4b6a8668413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:52.480382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c11d7-d2df-454f-b759-a4b6a8668413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:52.481808 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c11d7-d2df-454f-b759-a4b6a8668413 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:52.492062 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 976/1952] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:53.085516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf27f0-76ba-46b9-acc3-62c389bcca0a None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:53.085973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf27f0-76ba-46b9-acc3-62c389bcca0a None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:53.089615 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf27f0-76ba-46b9-acc3-62c389bcca0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:53.131998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-f4cf27f0-76ba-46b9-acc3-62c389bcca0a None None] MFA Rules not processed for user `d161fa00a7ee48a8a8bb77fe72ad87ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:53.134143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-f4cf27f0-76ba-46b9-acc3-62c389bcca0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:53.211208 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 977/1953] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:53.260710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c11d7-d2df-454f-b759-a4b6a8668413 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:53.270914 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c11d7-d2df-454f-b759-a4b6a8668413 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:53.275253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413fe09-7fe3-4879-be69-3dbad7af7420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:53.276017 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413fe09-7fe3-4879-be69-3dbad7af7420 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:53.276656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413fe09-7fe3-4879-be69-3dbad7af7420 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:53.276795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413fe09-7fe3-4879-be69-3dbad7af7420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:53.287177 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413fe09-7fe3-4879-be69-3dbad7af7420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:53.289027 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413fe09-7fe3-4879-be69-3dbad7af7420 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:53.298671 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 977/1954] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:53.764299 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf27f0-76ba-46b9-acc3-62c389bcca0a None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:53.775655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf27f0-76ba-46b9-acc3-62c389bcca0a None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:53.780552 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6dfda-ba67-4128-b9b5-b3b021ff30ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:53.781428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6dfda-ba67-4128-b9b5-b3b021ff30ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:53.781717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6dfda-ba67-4128-b9b5-b3b021ff30ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:53.781996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6dfda-ba67-4128-b9b5-b3b021ff30ea admin admin] PATH_INFO: `/v3/users/8594809654ea45d598a1a934183a3b01` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:53.783233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6dfda-ba67-4128-b9b5-b3b021ff30ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8594809654ea45d598a1a934183a3b01)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:53.785140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6dfda-ba67-4128-b9b5-b3b021ff30ea admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:53.831939 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-50b6dfda-ba67-4128-b9b5-b3b021ff30ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8594809654ea45d598a1a934183a3b01'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:53.832583 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-50b6dfda-ba67-4128-b9b5-b3b021ff30ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8594809654ea45d598a1a934183a3b01'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:53.840943 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-50b6dfda-ba67-4128-b9b5-b3b021ff30ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8594809654ea45d598a1a934183a3b01'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:53.847808 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-50b6dfda-ba67-4128-b9b5-b3b021ff30ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8594809654ea45d598a1a934183a3b01'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:53.848436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-50b6dfda-ba67-4128-b9b5-b3b021ff30ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8594809654ea45d598a1a934183a3b01'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:53.866380 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 978/1955] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:53 2022] DELETE /identity/v3/users/8594809654ea45d598a1a934183a3b01 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:53.871359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3471cb-3df9-4503-9c52-2d201c53301a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:53.871359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3471cb-3df9-4503-9c52-2d201c53301a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:53.871359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3471cb-3df9-4503-9c52-2d201c53301a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:53.889758 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-9c3471cb-3df9-4503-9c52-2d201c53301a None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:53.890998 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9c3471cb-3df9-4503-9c52-2d201c53301a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:53.952475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 978/1956] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:53.962469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6dfda-ba67-4128-b9b5-b3b021ff30ea admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:53.963884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-50b6dfda-ba67-4128-b9b5-b3b021ff30ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:54.019748 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6dfda-ba67-4128-b9b5-b3b021ff30ea admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:54.024571 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1865e-f60c-4d28-8c0e-c8a12015cf97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:54.025186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1865e-f60c-4d28-8c0e-c8a12015cf97 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:54.025468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1865e-f60c-4d28-8c0e-c8a12015cf97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:54.025764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1865e-f60c-4d28-8c0e-c8a12015cf97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:54.034975 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1865e-f60c-4d28-8c0e-c8a12015cf97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:54.037041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1865e-f60c-4d28-8c0e-c8a12015cf97 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:54.046751 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 979/1957] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:42:54.306105 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3471cb-3df9-4503-9c52-2d201c53301a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:54.307756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9c3471cb-3df9-4503-9c52-2d201c53301a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:54.320370 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3471cb-3df9-4503-9c52-2d201c53301a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:54.325060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09014-7874-42d6-bf5d-3d67a9b468c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:54.325914 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09014-7874-42d6-bf5d-3d67a9b468c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:54.326383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09014-7874-42d6-bf5d-3d67a9b468c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:54.326838 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09014-7874-42d6-bf5d-3d67a9b468c7 admin admin] PATH_INFO: `/v3/projects/a497e0c9896b45c4aea16965cbf02d2f` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:54.328107 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f09014-7874-42d6-bf5d-3d67a9b468c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a497e0c9896b45c4aea16965cbf02d2f)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:54.330071 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f09014-7874-42d6-bf5d-3d67a9b468c7 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:54.377213 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-04f09014-7874-42d6-bf5d-3d67a9b468c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a497e0c9896b45c4aea16965cbf02d2f', 'request_id': 'req-04f09014-7874-42d6-bf5d-3d67a9b468c7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:54.382752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-04f09014-7874-42d6-bf5d-3d67a9b468c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a497e0c9896b45c4aea16965cbf02d2f', 'request_id': 'req-04f09014-7874-42d6-bf5d-3d67a9b468c7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:54.388700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-04f09014-7874-42d6-bf5d-3d67a9b468c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a497e0c9896b45c4aea16965cbf02d2f', 'request_id': 'req-04f09014-7874-42d6-bf5d-3d67a9b468c7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:54.400231 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-04f09014-7874-42d6-bf5d-3d67a9b468c7 admin admin] The token cache is being invalidate because project a497e0c9896b45c4aea16965cbf02d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:54.400518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-04f09014-7874-42d6-bf5d-3d67a9b468c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:54.401138 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-04f09014-7874-42d6-bf5d-3d67a9b468c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:54.402719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 979/1958] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:54 2022] DELETE /identity/v3/projects/a497e0c9896b45c4aea16965cbf02d2f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:54.406645 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1865e-f60c-4d28-8c0e-c8a12015cf97 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:54.417302 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1865e-f60c-4d28-8c0e-c8a12015cf97 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:54.473868 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b6cf4-6f93-43b7-b76b-f1fd369a01c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:54.475294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b6cf4-6f93-43b7-b76b-f1fd369a01c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:54.475572 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b6cf4-6f93-43b7-b76b-f1fd369a01c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:54.475845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b6cf4-6f93-43b7-b76b-f1fd369a01c8 admin admin] PATH_INFO: `/v3/users/69c423506c724b5ea1af49fcb6b2a919` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:54.477022 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b6cf4-6f93-43b7-b76b-f1fd369a01c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c423506c724b5ea1af49fcb6b2a919)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:54.478949 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b6cf4-6f93-43b7-b76b-f1fd369a01c8 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:54.534004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-be5b6cf4-6f93-43b7-b76b-f1fd369a01c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c423506c724b5ea1af49fcb6b2a919'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:54.534717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-be5b6cf4-6f93-43b7-b76b-f1fd369a01c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c423506c724b5ea1af49fcb6b2a919'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:54.543251 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-be5b6cf4-6f93-43b7-b76b-f1fd369a01c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c423506c724b5ea1af49fcb6b2a919'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:54.550335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-be5b6cf4-6f93-43b7-b76b-f1fd369a01c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c423506c724b5ea1af49fcb6b2a919'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:54.550986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-be5b6cf4-6f93-43b7-b76b-f1fd369a01c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c423506c724b5ea1af49fcb6b2a919'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:54.567678 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 980/1959] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:42:54 2022] DELETE /identity/v3/users/69c423506c724b5ea1af49fcb6b2a919 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:54.837026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09014-7874-42d6-bf5d-3d67a9b468c7 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:54.838537 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-04f09014-7874-42d6-bf5d-3d67a9b468c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:54.855716 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09014-7874-42d6-bf5d-3d67a9b468c7 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:54.948507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138bb11-4b21-4cc5-98c9-52a4098ffb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:54.949650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138bb11-4b21-4cc5-98c9-52a4098ffb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:54.950062 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138bb11-4b21-4cc5-98c9-52a4098ffb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:54.950475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138bb11-4b21-4cc5-98c9-52a4098ffb67 admin admin] PATH_INFO: `/v3/projects/8fa5d151967a410eaba11f0e40883883` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:54.951816 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138bb11-4b21-4cc5-98c9-52a4098ffb67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa5d151967a410eaba11f0e40883883)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:54.953945 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138bb11-4b21-4cc5-98c9-52a4098ffb67 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:55.002659 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-5138bb11-4b21-4cc5-98c9-52a4098ffb67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa5d151967a410eaba11f0e40883883', 'request_id': 'req-5138bb11-4b21-4cc5-98c9-52a4098ffb67'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:55.009026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-5138bb11-4b21-4cc5-98c9-52a4098ffb67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa5d151967a410eaba11f0e40883883', 'request_id': 'req-5138bb11-4b21-4cc5-98c9-52a4098ffb67'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:55.015627 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-5138bb11-4b21-4cc5-98c9-52a4098ffb67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa5d151967a410eaba11f0e40883883', 'request_id': 'req-5138bb11-4b21-4cc5-98c9-52a4098ffb67'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:55.029244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-5138bb11-4b21-4cc5-98c9-52a4098ffb67 admin admin] The token cache is being invalidate because project 8fa5d151967a410eaba11f0e40883883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:42:55.029529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-5138bb11-4b21-4cc5-98c9-52a4098ffb67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:55.030152 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-5138bb11-4b21-4cc5-98c9-52a4098ffb67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:42:55.031801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 980/1960] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:42:54 2022] DELETE /identity/v3/projects/8fa5d151967a410eaba11f0e40883883 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:55.037816 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c6fc9-7dfa-4e8f-b306-d6f21c131903 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:55.038104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c6fc9-7dfa-4e8f-b306-d6f21c131903 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:55.038413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c6fc9-7dfa-4e8f-b306-d6f21c131903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:55.056056 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-b66c6fc9-7dfa-4e8f-b306-d6f21c131903 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:55.057257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b66c6fc9-7dfa-4e8f-b306-d6f21c131903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:55.116287 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 981/1961] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:55.124053 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9521937-f135-4705-b17c-40404c6d96e9 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:55.124344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9521937-f135-4705-b17c-40404c6d96e9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:55.124623 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9521937-f135-4705-b17c-40404c6d96e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:55.143102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e9521937-f135-4705-b17c-40404c6d96e9 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:55.144215 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e9521937-f135-4705-b17c-40404c6d96e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:55.152431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 981/1962] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:55.156789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c6fc9-7dfa-4e8f-b306-d6f21c131903 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:55.166954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c6fc9-7dfa-4e8f-b306-d6f21c131903 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:55.172208 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed65de-6a71-43b0-8d76-45c245f96219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:55.172863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed65de-6a71-43b0-8d76-45c245f96219 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:55.173147 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed65de-6a71-43b0-8d76-45c245f96219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:55.173421 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed65de-6a71-43b0-8d76-45c245f96219 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:55.174145 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed65de-6a71-43b0-8d76-45c245f96219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:42:55.174524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed65de-6a71-43b0-8d76-45c245f96219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:55.176157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed65de-6a71-43b0-8d76-45c245f96219 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:55.188101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 982/1963] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:42:55.193288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9521937-f135-4705-b17c-40404c6d96e9 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:55.202429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9521937-f135-4705-b17c-40404c6d96e9 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:55.207146 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669e5ec-e921-4f50-bcfd-43a91e08be38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:55.207811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669e5ec-e921-4f50-bcfd-43a91e08be38 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:55.208096 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669e5ec-e921-4f50-bcfd-43a91e08be38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:55.208949 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669e5ec-e921-4f50-bcfd-43a91e08be38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:55.209805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669e5ec-e921-4f50-bcfd-43a91e08be38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:55.211752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669e5ec-e921-4f50-bcfd-43a91e08be38 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:55.239081 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 982/1964] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:42:55 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:55.243721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed65de-6a71-43b0-8d76-45c245f96219 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:55.253581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed65de-6a71-43b0-8d76-45c245f96219 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:55.311971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc11fe6-82b6-4513-ad2a-193450e8b8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:55.312652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc11fe6-82b6-4513-ad2a-193450e8b8cb admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:55.312968 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc11fe6-82b6-4513-ad2a-193450e8b8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:55.313242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc11fe6-82b6-4513-ad2a-193450e8b8cb admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:55.313931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc11fe6-82b6-4513-ad2a-193450e8b8cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:55.315959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc11fe6-82b6-4513-ad2a-193450e8b8cb admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:55.335944 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 983/1965] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:42:55 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:42:55.340885 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669e5ec-e921-4f50-bcfd-43a91e08be38 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:55.352295 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669e5ec-e921-4f50-bcfd-43a91e08be38 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:55.357285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf4de4-0e99-4258-b783-491474ab0159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:55.357957 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4de4-0e99-4258-b783-491474ab0159 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:55.358300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4de4-0e99-4258-b783-491474ab0159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:55.358583 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4de4-0e99-4258-b783-491474ab0159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:55.359333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf4de4-0e99-4258-b783-491474ab0159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:55.360924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf4de4-0e99-4258-b783-491474ab0159 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:55.372449 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 983/1966] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:55.376506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc11fe6-82b6-4513-ad2a-193450e8b8cb admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:55.386918 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc11fe6-82b6-4513-ad2a-193450e8b8cb admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:55.391582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4f758-80eb-4e2d-a835-f5fef2e860c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:55.392231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4f758-80eb-4e2d-a835-f5fef2e860c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:55.392510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4f758-80eb-4e2d-a835-f5fef2e860c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:55.392781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4f758-80eb-4e2d-a835-f5fef2e860c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:55.393535 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4f758-80eb-4e2d-a835-f5fef2e860c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:55.395125 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4f758-80eb-4e2d-a835-f5fef2e860c5 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:55.404825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 984/1967] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:42:55.408685 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf4de4-0e99-4258-b783-491474ab0159 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:55.418127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf4de4-0e99-4258-b783-491474ab0159 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:55.422819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa2d5a-a426-4591-b6a0-2df057b4839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:55.423685 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa2d5a-a426-4591-b6a0-2df057b4839b admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:55.423961 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa2d5a-a426-4591-b6a0-2df057b4839b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:55.424230 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa2d5a-a426-4591-b6a0-2df057b4839b admin admin] PATH_INFO: `/v3/projects/e09f6220c16b47c583dacb8debb43cba/users/667a1fddc43f4829aa1f661d9cac8002/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:55.439035 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa2d5a-a426-4591-b6a0-2df057b4839b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09f6220c16b47c583dacb8debb43cba, user_id=667a1fddc43f4829aa1f661d9cac8002, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:55.442088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa2d5a-a426-4591-b6a0-2df057b4839b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:55.455550 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 984/1968] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:42:55 2022] PUT /identity/v3/projects/e09f6220c16b47c583dacb8debb43cba/users/667a1fddc43f4829aa1f661d9cac8002/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:42:55.466514 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e199f-582b-455d-9671-308ba47a50d1 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:55.466992 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e199f-582b-455d-9671-308ba47a50d1 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:55.467171 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e199f-582b-455d-9671-308ba47a50d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:55.493246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-b84e199f-582b-455d-9671-308ba47a50d1 None None] MFA Rules not processed for user `667a1fddc43f4829aa1f661d9cac8002`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:42:55.494482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b84e199f-582b-455d-9671-308ba47a50d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:55.557484 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 985/1969] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:42:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:42:55.569330 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa2d5a-a426-4591-b6a0-2df057b4839b admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:42:55.571108 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f6aa2d5a-a426-4591-b6a0-2df057b4839b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:42:55.626145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa2d5a-a426-4591-b6a0-2df057b4839b admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:42:55.629759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebf769-8acb-4054-86b0-215342618aec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:42:55.630536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebf769-8acb-4054-86b0-215342618aec service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:42:55.630814 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebf769-8acb-4054-86b0-215342618aec service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:42:55.631189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebf769-8acb-4054-86b0-215342618aec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:42:55.639849 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebf769-8acb-4054-86b0-215342618aec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:42:55.641283 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebf769-8acb-4054-86b0-215342618aec service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:42:55.651712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 985/1970] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:42:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:02.479842 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b27ad-7188-4208-bdaa-411dcda4bf33 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:02.480296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b27ad-7188-4208-bdaa-411dcda4bf33 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:02.480371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b27ad-7188-4208-bdaa-411dcda4bf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:02.500969 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-399b27ad-7188-4208-bdaa-411dcda4bf33 None None] MFA Rules not processed for user `d161fa00a7ee48a8a8bb77fe72ad87ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:02.502297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-399b27ad-7188-4208-bdaa-411dcda4bf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:02.572530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 986/1971] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:03.100376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebf769-8acb-4054-86b0-215342618aec service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:03.101869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-39ebf769-8acb-4054-86b0-215342618aec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:03.224369 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebf769-8acb-4054-86b0-215342618aec service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:03.230393 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458d863-0818-430a-84e0-7cb3081d467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:03.231536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458d863-0818-430a-84e0-7cb3081d467d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:03.231896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458d863-0818-430a-84e0-7cb3081d467d admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:03.232243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458d863-0818-430a-84e0-7cb3081d467d admin admin] PATH_INFO: `/v3/users/8ebdbed50bb841ac9b996203b28cd6bf` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:03.233513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458d863-0818-430a-84e0-7cb3081d467d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ebdbed50bb841ac9b996203b28cd6bf)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:03.235539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458d863-0818-430a-84e0-7cb3081d467d admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:03.309443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8458d863-0818-430a-84e0-7cb3081d467d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ebdbed50bb841ac9b996203b28cd6bf'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:03.316328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8458d863-0818-430a-84e0-7cb3081d467d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ebdbed50bb841ac9b996203b28cd6bf'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:03.317095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8458d863-0818-430a-84e0-7cb3081d467d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ebdbed50bb841ac9b996203b28cd6bf'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:03.317779 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8458d863-0818-430a-84e0-7cb3081d467d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ebdbed50bb841ac9b996203b28cd6bf'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:03.332005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8458d863-0818-430a-84e0-7cb3081d467d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ebdbed50bb841ac9b996203b28cd6bf'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:03.347874 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 986/1972] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:03 2022] DELETE /identity/v3/users/8ebdbed50bb841ac9b996203b28cd6bf => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:03.352670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffc99f-713d-4d70-994d-d5e0942ec430 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:03.352988 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffc99f-713d-4d70-994d-d5e0942ec430 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:03.353263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffc99f-713d-4d70-994d-d5e0942ec430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:03.373186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-53ffc99f-713d-4d70-994d-d5e0942ec430 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:03.374444 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-53ffc99f-713d-4d70-994d-d5e0942ec430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:03.433555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 987/1973] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:03.443052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458d863-0818-430a-84e0-7cb3081d467d admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:03.445055 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8458d863-0818-430a-84e0-7cb3081d467d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:03.505777 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458d863-0818-430a-84e0-7cb3081d467d admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:03.518846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9b82d-57fc-4e44-a519-d25d200d7b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:03.519697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9b82d-57fc-4e44-a519-d25d200d7b64 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:03.520095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9b82d-57fc-4e44-a519-d25d200d7b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:03.520500 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9b82d-57fc-4e44-a519-d25d200d7b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:03.537975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9b82d-57fc-4e44-a519-d25d200d7b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:03.539494 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9b82d-57fc-4e44-a519-d25d200d7b64 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:03.549414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 987/1974] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:03.811210 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffc99f-713d-4d70-994d-d5e0942ec430 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:03.812732 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-53ffc99f-713d-4d70-994d-d5e0942ec430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:03.837574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffc99f-713d-4d70-994d-d5e0942ec430 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:03.843992 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409931c-1f1d-45a5-882c-60c737ccdc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:03.844863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409931c-1f1d-45a5-882c-60c737ccdc17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:03.845582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409931c-1f1d-45a5-882c-60c737ccdc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:03.846850 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409931c-1f1d-45a5-882c-60c737ccdc17 admin admin] PATH_INFO: `/v3/projects/ce6199a8008a47b5991db50568b500ba` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:03.848864 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409931c-1f1d-45a5-882c-60c737ccdc17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce6199a8008a47b5991db50568b500ba)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:03.852182 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409931c-1f1d-45a5-882c-60c737ccdc17 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:03.907177 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e409931c-1f1d-45a5-882c-60c737ccdc17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce6199a8008a47b5991db50568b500ba', 'request_id': 'req-e409931c-1f1d-45a5-882c-60c737ccdc17'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:03.913162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e409931c-1f1d-45a5-882c-60c737ccdc17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce6199a8008a47b5991db50568b500ba', 'request_id': 'req-e409931c-1f1d-45a5-882c-60c737ccdc17'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:03.919394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e409931c-1f1d-45a5-882c-60c737ccdc17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce6199a8008a47b5991db50568b500ba', 'request_id': 'req-e409931c-1f1d-45a5-882c-60c737ccdc17'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:03.933904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e409931c-1f1d-45a5-882c-60c737ccdc17 admin admin] The token cache is being invalidate because project ce6199a8008a47b5991db50568b500ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:03.934399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e409931c-1f1d-45a5-882c-60c737ccdc17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:03.935175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e409931c-1f1d-45a5-882c-60c737ccdc17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:03.938666 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 988/1975] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:03 2022] DELETE /identity/v3/projects/ce6199a8008a47b5991db50568b500ba => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:03.942964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334950d-f84d-4ab9-b964-4d9360847a75 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:03.943883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334950d-f84d-4ab9-b964-4d9360847a75 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:03.944397 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334950d-f84d-4ab9-b964-4d9360847a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:03.968638 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e334950d-f84d-4ab9-b964-4d9360847a75 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:03.970610 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e334950d-f84d-4ab9-b964-4d9360847a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:04.050148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 988/1976] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:04.059607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e3da5-4209-4384-83d9-5a8abfdd8ceb None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:04.059607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e3da5-4209-4384-83d9-5a8abfdd8ceb None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:04.059607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e3da5-4209-4384-83d9-5a8abfdd8ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:04.076864 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-eb6e3da5-4209-4384-83d9-5a8abfdd8ceb None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:04.078062 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-eb6e3da5-4209-4384-83d9-5a8abfdd8ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:04.086546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 989/1977] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:04.090750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334950d-f84d-4ab9-b964-4d9360847a75 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:04.101049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334950d-f84d-4ab9-b964-4d9360847a75 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:04.105642 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67140bff-5c68-4602-b1bc-dfd41165a896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:04.106402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67140bff-5c68-4602-b1bc-dfd41165a896 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:04.106752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67140bff-5c68-4602-b1bc-dfd41165a896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:04.107091 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67140bff-5c68-4602-b1bc-dfd41165a896 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:04.107972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67140bff-5c68-4602-b1bc-dfd41165a896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:43:04.108353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67140bff-5c68-4602-b1bc-dfd41165a896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:04.110036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67140bff-5c68-4602-b1bc-dfd41165a896 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:04.125320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 989/1978] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:43:04.126503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e3da5-4209-4384-83d9-5a8abfdd8ceb None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:04.136136 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e3da5-4209-4384-83d9-5a8abfdd8ceb None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:04.140830 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed05da-3493-4a7a-8a54-8d1fe2b25e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:04.141483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed05da-3493-4a7a-8a54-8d1fe2b25e31 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:04.141813 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed05da-3493-4a7a-8a54-8d1fe2b25e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:04.142022 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed05da-3493-4a7a-8a54-8d1fe2b25e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:04.142764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed05da-3493-4a7a-8a54-8d1fe2b25e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:04.144721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed05da-3493-4a7a-8a54-8d1fe2b25e31 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:04.172437 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 990/1979] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:04 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:04.173894 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67140bff-5c68-4602-b1bc-dfd41165a896 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:04.184303 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67140bff-5c68-4602-b1bc-dfd41165a896 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:04.243792 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31211a-646d-4f25-bea4-c07f0cf1d433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:04.244472 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31211a-646d-4f25-bea4-c07f0cf1d433 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:04.244758 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31211a-646d-4f25-bea4-c07f0cf1d433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:04.245036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31211a-646d-4f25-bea4-c07f0cf1d433 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:04.245723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31211a-646d-4f25-bea4-c07f0cf1d433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:04.247653 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31211a-646d-4f25-bea4-c07f0cf1d433 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:04.270520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 990/1980] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:04 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:04.274216 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed05da-3493-4a7a-8a54-8d1fe2b25e31 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:04.284468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed05da-3493-4a7a-8a54-8d1fe2b25e31 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:04.292310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5b444-476e-424d-9515-f2a40b395eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:04.292986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5b444-476e-424d-9515-f2a40b395eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:04.293269 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5b444-476e-424d-9515-f2a40b395eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:04.293546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5b444-476e-424d-9515-f2a40b395eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:04.294329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5b444-476e-424d-9515-f2a40b395eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:04.295927 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5b444-476e-424d-9515-f2a40b395eaf admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:04.308059 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 991/1981] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:43:04.311922 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31211a-646d-4f25-bea4-c07f0cf1d433 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:04.321815 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31211a-646d-4f25-bea4-c07f0cf1d433 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:04.327363 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede74b13-7c7d-4b44-9e64-cd1d5f50aac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:04.328009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede74b13-7c7d-4b44-9e64-cd1d5f50aac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:04.328290 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede74b13-7c7d-4b44-9e64-cd1d5f50aac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:04.328594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede74b13-7c7d-4b44-9e64-cd1d5f50aac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:04.329385 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede74b13-7c7d-4b44-9e64-cd1d5f50aac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:04.331015 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede74b13-7c7d-4b44-9e64-cd1d5f50aac6 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:04.344330 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 991/1982] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:04.348532 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5b444-476e-424d-9515-f2a40b395eaf admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:04.359867 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5b444-476e-424d-9515-f2a40b395eaf admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:04.369783 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45613d2-570a-46e9-a135-683de22b4307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:04.370791 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45613d2-570a-46e9-a135-683de22b4307 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:04.371072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45613d2-570a-46e9-a135-683de22b4307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:04.371348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45613d2-570a-46e9-a135-683de22b4307 admin admin] PATH_INFO: `/v3/projects/681b908a1696496dbedc572188a0d9ab/users/b891c5f54506445687e405e619134e57/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:04.386968 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45613d2-570a-46e9-a135-683de22b4307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=681b908a1696496dbedc572188a0d9ab, user_id=b891c5f54506445687e405e619134e57, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:04.389594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45613d2-570a-46e9-a135-683de22b4307 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:04.402719 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 992/1983] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:04 2022] PUT /identity/v3/projects/681b908a1696496dbedc572188a0d9ab/users/b891c5f54506445687e405e619134e57/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:04.414250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175c228-bbae-44ba-b538-9507c0bab739 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:04.414514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175c228-bbae-44ba-b538-9507c0bab739 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:04.414800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175c228-bbae-44ba-b538-9507c0bab739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:04.442100 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8175c228-bbae-44ba-b538-9507c0bab739 None None] MFA Rules not processed for user `b891c5f54506445687e405e619134e57`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:04.444214 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8175c228-bbae-44ba-b538-9507c0bab739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:04.507890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 992/1984] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:04.519114 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45613d2-570a-46e9-a135-683de22b4307 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:04.520796 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d45613d2-570a-46e9-a135-683de22b4307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:04.576575 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45613d2-570a-46e9-a135-683de22b4307 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:04.580144 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69652163-956c-4524-976b-8224d92e3b6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:04.580783 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69652163-956c-4524-976b-8224d92e3b6e service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:04.581061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69652163-956c-4524-976b-8224d92e3b6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:04.581331 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69652163-956c-4524-976b-8224d92e3b6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:04.591136 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69652163-956c-4524-976b-8224d92e3b6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:04.592829 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69652163-956c-4524-976b-8224d92e3b6e service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:04.602642 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 993/1985] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:09.627914 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175c228-bbae-44ba-b538-9507c0bab739 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:09.629308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8175c228-bbae-44ba-b538-9507c0bab739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:09.695363 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175c228-bbae-44ba-b538-9507c0bab739 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:09.705123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1f59d-e669-44cd-ab46-733205d08abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:09.706194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1f59d-e669-44cd-ab46-733205d08abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:09.706389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1f59d-e669-44cd-ab46-733205d08abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:09.706723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1f59d-e669-44cd-ab46-733205d08abb admin admin] PATH_INFO: `/v3/users/c1c0b48412614d5dbf0edfff42f7aa19` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:09.707959 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1f59d-e669-44cd-ab46-733205d08abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c0b48412614d5dbf0edfff42f7aa19)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:09.710811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1f59d-e669-44cd-ab46-733205d08abb admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:09.762865 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-56f1f59d-e669-44cd-ab46-733205d08abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c0b48412614d5dbf0edfff42f7aa19'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:09.777723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-56f1f59d-e669-44cd-ab46-733205d08abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c0b48412614d5dbf0edfff42f7aa19'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:09.779572 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-56f1f59d-e669-44cd-ab46-733205d08abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c0b48412614d5dbf0edfff42f7aa19'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:09.780250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-56f1f59d-e669-44cd-ab46-733205d08abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c0b48412614d5dbf0edfff42f7aa19'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:09.793641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-56f1f59d-e669-44cd-ab46-733205d08abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c0b48412614d5dbf0edfff42f7aa19'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:09.799518 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69652163-956c-4524-976b-8224d92e3b6e service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:09.802019 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-69652163-956c-4524-976b-8224d92e3b6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:09.811652 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 993/1986] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:09 2022] DELETE /identity/v3/users/c1c0b48412614d5dbf0edfff42f7aa19 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:09.816777 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348c1fd-080b-4174-97f0-1f500111858e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:09.817253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348c1fd-080b-4174-97f0-1f500111858e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:09.817716 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69652163-956c-4524-976b-8224d92e3b6e service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:09.818663 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348c1fd-080b-4174-97f0-1f500111858e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:09.845498 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a348c1fd-080b-4174-97f0-1f500111858e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:09.846825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a348c1fd-080b-4174-97f0-1f500111858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:09.924900 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 994/1987] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:09.935098 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348c1fd-080b-4174-97f0-1f500111858e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:09.936564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a348c1fd-080b-4174-97f0-1f500111858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:09.942078 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0b4f1-c43c-4b56-b45e-a9b607b6a307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:09.943558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0b4f1-c43c-4b56-b45e-a9b607b6a307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:09.943833 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0b4f1-c43c-4b56-b45e-a9b607b6a307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:09.944280 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0b4f1-c43c-4b56-b45e-a9b607b6a307 admin admin] PATH_INFO: `/v3/users/f6119bc505f64e1e8c2f580c87b3f22d` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:09.946319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0b4f1-c43c-4b56-b45e-a9b607b6a307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6119bc505f64e1e8c2f580c87b3f22d)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:09.948388 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0b4f1-c43c-4b56-b45e-a9b607b6a307 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:10.001997 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348c1fd-080b-4174-97f0-1f500111858e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:10.006624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d234f-3bee-48b8-bc76-cca0ea1166a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:10.007474 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d234f-3bee-48b8-bc76-cca0ea1166a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:10.007676 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d234f-3bee-48b8-bc76-cca0ea1166a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:10.008003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d234f-3bee-48b8-bc76-cca0ea1166a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:10.011417 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-62a0b4f1-c43c-4b56-b45e-a9b607b6a307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6119bc505f64e1e8c2f580c87b3f22d'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.012094 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-62a0b4f1-c43c-4b56-b45e-a9b607b6a307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6119bc505f64e1e8c2f580c87b3f22d'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.017729 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d234f-3bee-48b8-bc76-cca0ea1166a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:10.019344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d234f-3bee-48b8-bc76-cca0ea1166a7 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:10.020307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-62a0b4f1-c43c-4b56-b45e-a9b607b6a307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6119bc505f64e1e8c2f580c87b3f22d'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.028723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-62a0b4f1-c43c-4b56-b45e-a9b607b6a307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6119bc505f64e1e8c2f580c87b3f22d'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.029523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-62a0b4f1-c43c-4b56-b45e-a9b607b6a307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6119bc505f64e1e8c2f580c87b3f22d'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.031384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 995/1988] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:43:10.051268 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 994/1989] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:09 2022] DELETE /identity/v3/users/f6119bc505f64e1e8c2f580c87b3f22d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:10.055695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139688fc-64e1-4017-97f2-c43a29e2bc14 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:10.055985 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139688fc-64e1-4017-97f2-c43a29e2bc14 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:10.056265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139688fc-64e1-4017-97f2-c43a29e2bc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:10.075696 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-139688fc-64e1-4017-97f2-c43a29e2bc14 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:10.076988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-139688fc-64e1-4017-97f2-c43a29e2bc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:10.155921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 996/1990] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:10.173326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0b4f1-c43c-4b56-b45e-a9b607b6a307 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:10.174865 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-62a0b4f1-c43c-4b56-b45e-a9b607b6a307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:10.283123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0b4f1-c43c-4b56-b45e-a9b607b6a307 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:10.289325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677a968-c8d3-48bb-a6c9-91414d947ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:10.290173 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677a968-c8d3-48bb-a6c9-91414d947ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:10.290479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677a968-c8d3-48bb-a6c9-91414d947ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:10.290825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677a968-c8d3-48bb-a6c9-91414d947ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:10.300890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139688fc-64e1-4017-97f2-c43a29e2bc14 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:10.302976 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-139688fc-64e1-4017-97f2-c43a29e2bc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:10.305060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677a968-c8d3-48bb-a6c9-91414d947ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:10.306570 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677a968-c8d3-48bb-a6c9-91414d947ec2 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:10.317470 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 995/1991] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:10.319164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139688fc-64e1-4017-97f2-c43a29e2bc14 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:10.326211 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad577d-bc7e-4777-908c-268ad748bba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:10.326560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad577d-bc7e-4777-908c-268ad748bba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:10.330629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad577d-bc7e-4777-908c-268ad748bba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:10.331072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad577d-bc7e-4777-908c-268ad748bba5 admin admin] PATH_INFO: `/v3/users/b891c5f54506445687e405e619134e57` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:10.333291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad577d-bc7e-4777-908c-268ad748bba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b891c5f54506445687e405e619134e57)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:10.337353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad577d-bc7e-4777-908c-268ad748bba5 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:10.395502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677a968-c8d3-48bb-a6c9-91414d947ec2 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:10.403796 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d677a968-c8d3-48bb-a6c9-91414d947ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:10.432060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-9aad577d-bc7e-4777-908c-268ad748bba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b891c5f54506445687e405e619134e57'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.434286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677a968-c8d3-48bb-a6c9-91414d947ec2 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:10.439369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127506bd-cee7-4954-8aeb-c56833aecb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:10.440390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127506bd-cee7-4954-8aeb-c56833aecb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:10.441206 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127506bd-cee7-4954-8aeb-c56833aecb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:10.441684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127506bd-cee7-4954-8aeb-c56833aecb29 admin admin] PATH_INFO: `/v3/projects/4145914ca74e4aff9a987fdeb19ce831` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:10.444496 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127506bd-cee7-4954-8aeb-c56833aecb29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4145914ca74e4aff9a987fdeb19ce831)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:10.446924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127506bd-cee7-4954-8aeb-c56833aecb29 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:10.458099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-9aad577d-bc7e-4777-908c-268ad748bba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b891c5f54506445687e405e619134e57'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.460057 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-9aad577d-bc7e-4777-908c-268ad748bba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b891c5f54506445687e405e619134e57'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.460414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-9aad577d-bc7e-4777-908c-268ad748bba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b891c5f54506445687e405e619134e57'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.477261 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-9aad577d-bc7e-4777-908c-268ad748bba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b891c5f54506445687e405e619134e57'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.525287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 997/1992] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:10 2022] DELETE /identity/v3/users/b891c5f54506445687e405e619134e57 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:10.526924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b6dd9-fea4-45e1-9d3e-04a4005df269 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:10.527222 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b6dd9-fea4-45e1-9d3e-04a4005df269 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:10.527500 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b6dd9-fea4-45e1-9d3e-04a4005df269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:10.570569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f66b6dd9-fea4-45e1-9d3e-04a4005df269 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:10.571819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f66b6dd9-fea4-45e1-9d3e-04a4005df269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:10.572660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-127506bd-cee7-4954-8aeb-c56833aecb29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4145914ca74e4aff9a987fdeb19ce831', 'request_id': 'req-127506bd-cee7-4954-8aeb-c56833aecb29'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.589917 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-127506bd-cee7-4954-8aeb-c56833aecb29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4145914ca74e4aff9a987fdeb19ce831', 'request_id': 'req-127506bd-cee7-4954-8aeb-c56833aecb29'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.604582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-127506bd-cee7-4954-8aeb-c56833aecb29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4145914ca74e4aff9a987fdeb19ce831', 'request_id': 'req-127506bd-cee7-4954-8aeb-c56833aecb29'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.637147 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-127506bd-cee7-4954-8aeb-c56833aecb29 admin admin] The token cache is being invalidate because project 4145914ca74e4aff9a987fdeb19ce831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:10.637615 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-127506bd-cee7-4954-8aeb-c56833aecb29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.642008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-127506bd-cee7-4954-8aeb-c56833aecb29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.650061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 996/1993] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:10 2022] DELETE /identity/v3/projects/4145914ca74e4aff9a987fdeb19ce831 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:10.651292 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127506bd-cee7-4954-8aeb-c56833aecb29 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:10.652869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-127506bd-cee7-4954-8aeb-c56833aecb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:10.663830 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 998/1994] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:10.673062 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b6dd9-fea4-45e1-9d3e-04a4005df269 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:10.676466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f66b6dd9-fea4-45e1-9d3e-04a4005df269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:10.679468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127506bd-cee7-4954-8aeb-c56833aecb29 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:10.696272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47071f95-338d-4947-9521-b722e3147306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:10.697192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47071f95-338d-4947-9521-b722e3147306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:10.697480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47071f95-338d-4947-9521-b722e3147306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:10.697761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47071f95-338d-4947-9521-b722e3147306 admin admin] PATH_INFO: `/v3/users/d39f460be9634c2e8096a995ae1c86bc` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:10.699327 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47071f95-338d-4947-9521-b722e3147306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39f460be9634c2e8096a995ae1c86bc)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:10.701302 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47071f95-338d-4947-9521-b722e3147306 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:10.750415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b6dd9-fea4-45e1-9d3e-04a4005df269 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:10.754580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b16fb-3b9c-4662-89ee-87a013adb0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:10.755305 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b16fb-3b9c-4662-89ee-87a013adb0ee service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:10.756566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b16fb-3b9c-4662-89ee-87a013adb0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:10.756951 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b16fb-3b9c-4662-89ee-87a013adb0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:10.758021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-47071f95-338d-4947-9521-b722e3147306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39f460be9634c2e8096a995ae1c86bc'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.758857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-47071f95-338d-4947-9521-b722e3147306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39f460be9634c2e8096a995ae1c86bc'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.767318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b16fb-3b9c-4662-89ee-87a013adb0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:10.769858 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b16fb-3b9c-4662-89ee-87a013adb0ee service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:10.772515 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-47071f95-338d-4947-9521-b722e3147306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39f460be9634c2e8096a995ae1c86bc'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.781093 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-47071f95-338d-4947-9521-b722e3147306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39f460be9634c2e8096a995ae1c86bc'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.782195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-47071f95-338d-4947-9521-b722e3147306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39f460be9634c2e8096a995ae1c86bc'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:10.783123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 999/1995] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:10.804418 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 997/1996] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:10 2022] DELETE /identity/v3/users/d39f460be9634c2e8096a995ae1c86bc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:11.055825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b16fb-3b9c-4662-89ee-87a013adb0ee service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:11.059174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c81b16fb-3b9c-4662-89ee-87a013adb0ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:11.076121 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b16fb-3b9c-4662-89ee-87a013adb0ee service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:11.233003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7c65c-9f97-4c31-9d07-de61f00718e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:11.233882 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7c65c-9f97-4c31-9d07-de61f00718e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:11.234653 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7c65c-9f97-4c31-9d07-de61f00718e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:11.234653 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7c65c-9f97-4c31-9d07-de61f00718e0 admin admin] PATH_INFO: `/v3/projects/8900a3903b074ce79c38456a358fbbb1` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:11.236039 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7c65c-9f97-4c31-9d07-de61f00718e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8900a3903b074ce79c38456a358fbbb1)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:11.241966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7c65c-9f97-4c31-9d07-de61f00718e0 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:11.320733 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-efd7c65c-9f97-4c31-9d07-de61f00718e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8900a3903b074ce79c38456a358fbbb1', 'request_id': 'req-efd7c65c-9f97-4c31-9d07-de61f00718e0'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:11.341422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-efd7c65c-9f97-4c31-9d07-de61f00718e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8900a3903b074ce79c38456a358fbbb1', 'request_id': 'req-efd7c65c-9f97-4c31-9d07-de61f00718e0'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:11.363091 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-efd7c65c-9f97-4c31-9d07-de61f00718e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8900a3903b074ce79c38456a358fbbb1', 'request_id': 'req-efd7c65c-9f97-4c31-9d07-de61f00718e0'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:11.399328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-efd7c65c-9f97-4c31-9d07-de61f00718e0 admin admin] The token cache is being invalidate because project 8900a3903b074ce79c38456a358fbbb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:11.399634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-efd7c65c-9f97-4c31-9d07-de61f00718e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:11.401657 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-efd7c65c-9f97-4c31-9d07-de61f00718e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:11.404801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1000/1997] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:11 2022] DELETE /identity/v3/projects/8900a3903b074ce79c38456a358fbbb1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:11.408825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47071f95-338d-4947-9521-b722e3147306 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:11.410572 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-47071f95-338d-4947-9521-b722e3147306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:11.436834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47071f95-338d-4947-9521-b722e3147306 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:11.554004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbd967-7c74-4498-a823-dbafae0fc3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:11.555579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbd967-7c74-4498-a823-dbafae0fc3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:11.557266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbd967-7c74-4498-a823-dbafae0fc3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:11.557897 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbd967-7c74-4498-a823-dbafae0fc3c0 admin admin] PATH_INFO: `/v3/users/94bc65cb3f384015960fef40d178d2da` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:11.561035 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7c65c-9f97-4c31-9d07-de61f00718e0 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:11.561903 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbd967-7c74-4498-a823-dbafae0fc3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94bc65cb3f384015960fef40d178d2da)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:11.563113 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-efd7c65c-9f97-4c31-9d07-de61f00718e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:11.576718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbd967-7c74-4498-a823-dbafae0fc3c0 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:11.594180 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7c65c-9f97-4c31-9d07-de61f00718e0 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:11.603210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb8aa4-b309-4dd6-8c2a-279f899152fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:11.604100 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb8aa4-b309-4dd6-8c2a-279f899152fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:11.604382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb8aa4-b309-4dd6-8c2a-279f899152fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:11.604659 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb8aa4-b309-4dd6-8c2a-279f899152fe admin admin] PATH_INFO: `/v3/projects/6fc7406bc13945c694ee14a355d5e3ec` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:11.607699 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb8aa4-b309-4dd6-8c2a-279f899152fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc7406bc13945c694ee14a355d5e3ec)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:11.609543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb8aa4-b309-4dd6-8c2a-279f899152fe admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:11.669917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e4cb8aa4-b309-4dd6-8c2a-279f899152fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc7406bc13945c694ee14a355d5e3ec', 'request_id': 'req-e4cb8aa4-b309-4dd6-8c2a-279f899152fe'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:11.679673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e4cb8aa4-b309-4dd6-8c2a-279f899152fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc7406bc13945c694ee14a355d5e3ec', 'request_id': 'req-e4cb8aa4-b309-4dd6-8c2a-279f899152fe'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:11.691376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e4cb8aa4-b309-4dd6-8c2a-279f899152fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc7406bc13945c694ee14a355d5e3ec', 'request_id': 'req-e4cb8aa4-b309-4dd6-8c2a-279f899152fe'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:11.710735 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-11cbd967-7c74-4498-a823-dbafae0fc3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94bc65cb3f384015960fef40d178d2da'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:11.711838 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-11cbd967-7c74-4498-a823-dbafae0fc3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94bc65cb3f384015960fef40d178d2da'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:11.714358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e4cb8aa4-b309-4dd6-8c2a-279f899152fe admin admin] The token cache is being invalidate because project 6fc7406bc13945c694ee14a355d5e3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:11.714671 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e4cb8aa4-b309-4dd6-8c2a-279f899152fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:11.715495 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e4cb8aa4-b309-4dd6-8c2a-279f899152fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:11.722330 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1001/1998] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:11 2022] DELETE /identity/v3/projects/6fc7406bc13945c694ee14a355d5e3ec => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:11.726588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-11cbd967-7c74-4498-a823-dbafae0fc3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94bc65cb3f384015960fef40d178d2da'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:11.728625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27396c92-1db5-42d8-aec9-c7f594c254dd None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:11.729551 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27396c92-1db5-42d8-aec9-c7f594c254dd None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:11.729834 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27396c92-1db5-42d8-aec9-c7f594c254dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:11.743232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-11cbd967-7c74-4498-a823-dbafae0fc3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94bc65cb3f384015960fef40d178d2da'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:11.746274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-11cbd967-7c74-4498-a823-dbafae0fc3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94bc65cb3f384015960fef40d178d2da'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:11.759988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-27396c92-1db5-42d8-aec9-c7f594c254dd None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:11.759988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-27396c92-1db5-42d8-aec9-c7f594c254dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:11.796575 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 998/1999] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:11 2022] DELETE /identity/v3/users/94bc65cb3f384015960fef40d178d2da => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:11.818819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbd967-7c74-4498-a823-dbafae0fc3c0 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:11.822777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-11cbd967-7c74-4498-a823-dbafae0fc3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:11.866110 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1002/2000] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:11.874592 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbed369-2dbb-4a37-b6b2-34e159419fc7 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:11.875807 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbed369-2dbb-4a37-b6b2-34e159419fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:11.876728 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbed369-2dbb-4a37-b6b2-34e159419fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:11.921142 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-5fbed369-2dbb-4a37-b6b2-34e159419fc7 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:11.923909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5fbed369-2dbb-4a37-b6b2-34e159419fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:12.045723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbd967-7c74-4498-a823-dbafae0fc3c0 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:12.074631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad04841-20d7-4056-9783-b9ababec9751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:12.075759 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad04841-20d7-4056-9783-b9ababec9751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.076198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad04841-20d7-4056-9783-b9ababec9751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.076624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad04841-20d7-4056-9783-b9ababec9751 admin admin] PATH_INFO: `/v3/projects/681b908a1696496dbedc572188a0d9ab` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.080817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad04841-20d7-4056-9783-b9ababec9751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=681b908a1696496dbedc572188a0d9ab)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:12.085065 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad04841-20d7-4056-9783-b9ababec9751 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:12.191630 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1003/2001] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:43:12.196725 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbed369-2dbb-4a37-b6b2-34e159419fc7 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:12.203967 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-aad04841-20d7-4056-9783-b9ababec9751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '681b908a1696496dbedc572188a0d9ab', 'request_id': 'req-aad04841-20d7-4056-9783-b9ababec9751'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:12.209944 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-aad04841-20d7-4056-9783-b9ababec9751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '681b908a1696496dbedc572188a0d9ab', 'request_id': 'req-aad04841-20d7-4056-9783-b9ababec9751'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:12.215923 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbed369-2dbb-4a37-b6b2-34e159419fc7 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:12.219651 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-aad04841-20d7-4056-9783-b9ababec9751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '681b908a1696496dbedc572188a0d9ab', 'request_id': 'req-aad04841-20d7-4056-9783-b9ababec9751'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:12.245672 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-aad04841-20d7-4056-9783-b9ababec9751 admin admin] The token cache is being invalidate because project 681b908a1696496dbedc572188a0d9ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:12.247541 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-aad04841-20d7-4056-9783-b9ababec9751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:12.248805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-aad04841-20d7-4056-9783-b9ababec9751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:12.252615 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 999/2002] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:11 2022] DELETE /identity/v3/projects/681b908a1696496dbedc572188a0d9ab => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:12.258740 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c63203-1f00-4763-acab-be726264571e None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.262022 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c63203-1f00-4763-acab-be726264571e None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.263717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c63203-1f00-4763-acab-be726264571e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.303623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-76c63203-1f00-4763-acab-be726264571e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:12.305204 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-76c63203-1f00-4763-acab-be726264571e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:12.347527 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7da10-003d-413c-a9bf-b78db2bdb16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:12.348204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7da10-003d-413c-a9bf-b78db2bdb16c admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.348968 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7da10-003d-413c-a9bf-b78db2bdb16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.348968 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7da10-003d-413c-a9bf-b78db2bdb16c admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.350607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7da10-003d-413c-a9bf-b78db2bdb16c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:43:12.350994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7da10-003d-413c-a9bf-b78db2bdb16c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:12.352769 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7da10-003d-413c-a9bf-b78db2bdb16c admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:12.369394 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1004/2003] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:43:12.371059 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7da10-003d-413c-a9bf-b78db2bdb16c admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:12.379600 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a6b7da10-003d-413c-a9bf-b78db2bdb16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:12.385997 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1000/2004] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:12.394951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399d70a-51b0-4775-aa1e-28516d81572f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.395469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399d70a-51b0-4775-aa1e-28516d81572f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.396826 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399d70a-51b0-4775-aa1e-28516d81572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.401542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7da10-003d-413c-a9bf-b78db2bdb16c admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:12.428285 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-0399d70a-51b0-4775-aa1e-28516d81572f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:12.429916 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-0399d70a-51b0-4775-aa1e-28516d81572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:12.436892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc47ab-f71a-4b36-9d69-ccec2df82314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:12.437797 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc47ab-f71a-4b36-9d69-ccec2df82314 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.439066 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc47ab-f71a-4b36-9d69-ccec2df82314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.439925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc47ab-f71a-4b36-9d69-ccec2df82314 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.440517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc47ab-f71a-4b36-9d69-ccec2df82314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:12.441843 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1001/2005] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:12.446252 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399d70a-51b0-4775-aa1e-28516d81572f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:12.447420 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc47ab-f71a-4b36-9d69-ccec2df82314 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:12.457659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399d70a-51b0-4775-aa1e-28516d81572f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:12.464529 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b0de7-c26d-49b2-b8a0-c0c52b9c6ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:12.465701 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b0de7-c26d-49b2-b8a0-c0c52b9c6ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.466242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b0de7-c26d-49b2-b8a0-c0c52b9c6ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.466906 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b0de7-c26d-49b2-b8a0-c0c52b9c6ff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.468306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b0de7-c26d-49b2-b8a0-c0c52b9c6ff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:43:12.468827 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b0de7-c26d-49b2-b8a0-c0c52b9c6ff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:12.471443 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b0de7-c26d-49b2-b8a0-c0c52b9c6ff4 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:12.488288 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1002/2006] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:43:12.489454 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b0de7-c26d-49b2-b8a0-c0c52b9c6ff4 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:12.499469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-951b0de7-c26d-49b2-b8a0-c0c52b9c6ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:12.515440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b0de7-c26d-49b2-b8a0-c0c52b9c6ff4 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:12.526360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1005/2007] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:12 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:43:12.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6a649-0657-4df5-8087-956c92eb117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:12.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6a649-0657-4df5-8087-956c92eb117e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6a649-0657-4df5-8087-956c92eb117e admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.526526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6a649-0657-4df5-8087-956c92eb117e admin admin] PATH_INFO: `/v3/projects/087be7e6c58a45c3b072ed20a07454e4` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.526841 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc47ab-f71a-4b36-9d69-ccec2df82314 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:12.526919 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6a649-0657-4df5-8087-956c92eb117e admin admin] RBAC: Authorizing `identity:delete_project(project_id=087be7e6c58a45c3b072ed20a07454e4)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:12.529493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6a649-0657-4df5-8087-956c92eb117e admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:12.605599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d3c6a649-0657-4df5-8087-956c92eb117e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '087be7e6c58a45c3b072ed20a07454e4', 'request_id': 'req-d3c6a649-0657-4df5-8087-956c92eb117e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:12.611403 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d3c6a649-0657-4df5-8087-956c92eb117e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '087be7e6c58a45c3b072ed20a07454e4', 'request_id': 'req-d3c6a649-0657-4df5-8087-956c92eb117e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:12.618701 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d3c6a649-0657-4df5-8087-956c92eb117e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '087be7e6c58a45c3b072ed20a07454e4', 'request_id': 'req-d3c6a649-0657-4df5-8087-956c92eb117e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:12.640961 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d3c6a649-0657-4df5-8087-956c92eb117e admin admin] The token cache is being invalidate because project 087be7e6c58a45c3b072ed20a07454e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:12.641255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d3c6a649-0657-4df5-8087-956c92eb117e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:12.641934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d3c6a649-0657-4df5-8087-956c92eb117e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:12.643567 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1003/2008] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:12 2022] DELETE /identity/v3/projects/087be7e6c58a45c3b072ed20a07454e4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:12.647843 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6a649-0657-4df5-8087-956c92eb117e admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:12.648472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d3c6a649-0657-4df5-8087-956c92eb117e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:12.667886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc47ab-f71a-4b36-9d69-ccec2df82314 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:12.740761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6a649-0657-4df5-8087-956c92eb117e admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:12.741274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ed03a-ca89-4f5d-9b44-1dbe02661675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:12.741944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ed03a-ca89-4f5d-9b44-1dbe02661675 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.742256 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ed03a-ca89-4f5d-9b44-1dbe02661675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.742651 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ed03a-ca89-4f5d-9b44-1dbe02661675 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.743346 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ed03a-ca89-4f5d-9b44-1dbe02661675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:12.745250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ed03a-ca89-4f5d-9b44-1dbe02661675 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:12.746657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0c85e-7552-4c5c-beb3-d156cde2b90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:12.747401 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0c85e-7552-4c5c-beb3-d156cde2b90f admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.747756 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0c85e-7552-4c5c-beb3-d156cde2b90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.748108 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0c85e-7552-4c5c-beb3-d156cde2b90f admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.748869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0c85e-7552-4c5c-beb3-d156cde2b90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:12.750908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0c85e-7552-4c5c-beb3-d156cde2b90f admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:12.775007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1006/2009] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:12 2022] POST /identity/v3/projects => generated 383 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:12.776603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a3f1b-7fb7-4822-925b-34755b135d55 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.776889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a3f1b-7fb7-4822-925b-34755b135d55 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.777168 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a3f1b-7fb7-4822-925b-34755b135d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.778502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1004/2010] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:12 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:12.779361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0c85e-7552-4c5c-beb3-d156cde2b90f admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:12.780994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-99c0c85e-7552-4c5c-beb3-d156cde2b90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:12.794218 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0c85e-7552-4c5c-beb3-d156cde2b90f admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:12.796440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-dc8a3f1b-7fb7-4822-925b-34755b135d55 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:12.797639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-dc8a3f1b-7fb7-4822-925b-34755b135d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:12.854926 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e60be-594b-465a-86c0-2b7004c1eec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:12.855697 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e60be-594b-465a-86c0-2b7004c1eec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.856053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e60be-594b-465a-86c0-2b7004c1eec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.856382 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e60be-594b-465a-86c0-2b7004c1eec2 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.857129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e60be-594b-465a-86c0-2b7004c1eec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:12.857493 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1007/2011] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:12.858376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a3f1b-7fb7-4822-925b-34755b135d55 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:12.859588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e60be-594b-465a-86c0-2b7004c1eec2 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:12.868010 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a3f1b-7fb7-4822-925b-34755b135d55 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:12.873003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c737d7c-412a-4bb1-907c-d5b8ea02108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:12.873555 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c737d7c-412a-4bb1-907c-d5b8ea02108c admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.873863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c737d7c-412a-4bb1-907c-d5b8ea02108c admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.874405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c737d7c-412a-4bb1-907c-d5b8ea02108c admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.875160 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c737d7c-412a-4bb1-907c-d5b8ea02108c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:12.876890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c737d7c-412a-4bb1-907c-d5b8ea02108c admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:12.882870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1005/2012] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:12 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:12.884250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af733a-c808-4206-9574-d853a32fd46b None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.884472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af733a-c808-4206-9574-d853a32fd46b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.884716 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af733a-c808-4206-9574-d853a32fd46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.890149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1008/2013] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:12.890149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c737d7c-412a-4bb1-907c-d5b8ea02108c admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:12.897951 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c737d7c-412a-4bb1-907c-d5b8ea02108c admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:12.902743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2d893-083a-456c-a227-f5c264b9b036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:12.903478 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d893-083a-456c-a227-f5c264b9b036 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.903663 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d893-083a-456c-a227-f5c264b9b036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.903931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d893-083a-456c-a227-f5c264b9b036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.904566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-58af733a-c808-4206-9574-d853a32fd46b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:12.904905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2d893-083a-456c-a227-f5c264b9b036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:12.906448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-58af733a-c808-4206-9574-d853a32fd46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:12.906559 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2d893-083a-456c-a227-f5c264b9b036 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:12.918012 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1006/2014] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:12.919155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af733a-c808-4206-9574-d853a32fd46b None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:12.924411 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1009/2015] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:12.925716 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2d893-083a-456c-a227-f5c264b9b036 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:12.932776 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af733a-c808-4206-9574-d853a32fd46b None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:12.938131 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2d893-083a-456c-a227-f5c264b9b036 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:12.940175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8f1b1-0422-4ab3-b943-e5a5c53a19eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:12.940994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8f1b1-0422-4ab3-b943-e5a5c53a19eb admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.941402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8f1b1-0422-4ab3-b943-e5a5c53a19eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.942393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8f1b1-0422-4ab3-b943-e5a5c53a19eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.943657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8f1b1-0422-4ab3-b943-e5a5c53a19eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:12.945168 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b51a13-f598-4730-8da5-69253f6b1352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:12.945937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b51a13-f598-4730-8da5-69253f6b1352 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.946053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8f1b1-0422-4ab3-b943-e5a5c53a19eb admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:12.946462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b51a13-f598-4730-8da5-69253f6b1352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.946836 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b51a13-f598-4730-8da5-69253f6b1352 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.947820 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b51a13-f598-4730-8da5-69253f6b1352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:43:12.948242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b51a13-f598-4730-8da5-69253f6b1352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:12.950560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b51a13-f598-4730-8da5-69253f6b1352 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:12.959205 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1007/2016] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:12.959786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8f1b1-0422-4ab3-b943-e5a5c53a19eb admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:12.970401 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8f1b1-0422-4ab3-b943-e5a5c53a19eb admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:12.976240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70fe62-ed1b-4631-a6c0-965eac94b9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:12.977061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70fe62-ed1b-4631-a6c0-965eac94b9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:12.977545 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70fe62-ed1b-4631-a6c0-965eac94b9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:12.977971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70fe62-ed1b-4631-a6c0-965eac94b9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:12.978949 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70fe62-ed1b-4631-a6c0-965eac94b9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:12.981254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70fe62-ed1b-4631-a6c0-965eac94b9b8 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:12.983075 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1010/2017] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:43:12.984989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b51a13-f598-4730-8da5-69253f6b1352 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:12.998865 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b51a13-f598-4730-8da5-69253f6b1352 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:12.999470 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1008/2018] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:13.001282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a0d49-9893-478f-9303-a0c523859673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:13.002196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a0d49-9893-478f-9303-a0c523859673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.002451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70fe62-ed1b-4631-a6c0-965eac94b9b8 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:13.002560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a0d49-9893-478f-9303-a0c523859673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.002783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a0d49-9893-478f-9303-a0c523859673 admin admin] PATH_INFO: `/v3/projects/1802f1d70ab74ebca54f29a13d279ef8/users/b97042eb950242e99c2c05ab463845c8/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.015971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70fe62-ed1b-4631-a6c0-965eac94b9b8 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:13.022390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a0d49-9893-478f-9303-a0c523859673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1802f1d70ab74ebca54f29a13d279ef8, user_id=b97042eb950242e99c2c05ab463845c8, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:13.023861 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0612611-6016-4bd0-9728-12452c02342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:13.024623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0612611-6016-4bd0-9728-12452c02342c admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.024909 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0612611-6016-4bd0-9728-12452c02342c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.025678 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0612611-6016-4bd0-9728-12452c02342c admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.025789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a0d49-9893-478f-9303-a0c523859673 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:13.025992 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0612611-6016-4bd0-9728-12452c02342c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:13.027921 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0612611-6016-4bd0-9728-12452c02342c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:13.046292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1011/2019] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:12 2022] PUT /identity/v3/projects/1802f1d70ab74ebca54f29a13d279ef8/users/b97042eb950242e99c2c05ab463845c8/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:13.046292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a0d49-9893-478f-9303-a0c523859673 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:13.071974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1009/2020] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:12 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:13.071974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6d5bc-63d0-4678-9701-6e42c28f5d6c None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.071974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6d5bc-63d0-4678-9701-6e42c28f5d6c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.071974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6d5bc-63d0-4678-9701-6e42c28f5d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.103126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-3ba6d5bc-63d0-4678-9701-6e42c28f5d6c None None] MFA Rules not processed for user `b97042eb950242e99c2c05ab463845c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:13.104440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-3ba6d5bc-63d0-4678-9701-6e42c28f5d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:13.123530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a0d49-9893-478f-9303-a0c523859673 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:13.178822 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1010/2021] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:13.179441 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6d5bc-63d0-4678-9701-6e42c28f5d6c None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:13.201251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504977d-6ce4-4ced-b7b4-c6ee6240f9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:13.202300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504977d-6ce4-4ced-b7b4-c6ee6240f9ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.202581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504977d-6ce4-4ced-b7b4-c6ee6240f9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.202866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504977d-6ce4-4ced-b7b4-c6ee6240f9ab admin admin] PATH_INFO: `/v3/projects/b17842fa85384865aba313f5fa724882/users/ac454c6b807842ba821a9087f1cf4e2d/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.219379 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504977d-6ce4-4ced-b7b4-c6ee6240f9ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b17842fa85384865aba313f5fa724882, user_id=ac454c6b807842ba821a9087f1cf4e2d, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:13.222148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504977d-6ce4-4ced-b7b4-c6ee6240f9ab admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:13.241334 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1012/2022] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:13 2022] PUT /identity/v3/projects/b17842fa85384865aba313f5fa724882/users/ac454c6b807842ba821a9087f1cf4e2d/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:13.241901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504977d-6ce4-4ced-b7b4-c6ee6240f9ab admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:13.254747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6d5bc-63d0-4678-9701-6e42c28f5d6c None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:13.334021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fff739-b1de-4ac0-aff5-8611a38c730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:13.334765 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fff739-b1de-4ac0-aff5-8611a38c730a admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.335052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fff739-b1de-4ac0-aff5-8611a38c730a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.335606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fff739-b1de-4ac0-aff5-8611a38c730a admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.336015 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fff739-b1de-4ac0-aff5-8611a38c730a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:13.337980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fff739-b1de-4ac0-aff5-8611a38c730a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:13.352243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504977d-6ce4-4ced-b7b4-c6ee6240f9ab admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:13.358411 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7247057-2427-4fd5-b68a-68c4759ca2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:13.359612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247057-2427-4fd5-b68a-68c4759ca2fc admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.360156 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247057-2427-4fd5-b68a-68c4759ca2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.360576 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247057-2427-4fd5-b68a-68c4759ca2fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.361391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7247057-2427-4fd5-b68a-68c4759ca2fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:13.362012 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1011/2023] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:13 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:13.363458 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b56ab5-63d7-4cc1-b4e3-aea9f4507099 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.363750 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b56ab5-63d7-4cc1-b4e3-aea9f4507099 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.364065 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b56ab5-63d7-4cc1-b4e3-aea9f4507099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.367240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7247057-2427-4fd5-b68a-68c4759ca2fc admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:13.383097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-c1b56ab5-63d7-4cc1-b4e3-aea9f4507099 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:13.384404 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c1b56ab5-63d7-4cc1-b4e3-aea9f4507099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:13.398379 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1012/2024] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:13.398614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b56ab5-63d7-4cc1-b4e3-aea9f4507099 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:13.402810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1013/2025] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:13 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:13.410868 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b56ab5-63d7-4cc1-b4e3-aea9f4507099 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:13.427850 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7247057-2427-4fd5-b68a-68c4759ca2fc admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:13.483161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f2288-6585-4039-9619-b097cb98a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:13.484147 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f2288-6585-4039-9619-b097cb98a73a admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.484435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f2288-6585-4039-9619-b097cb98a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.484866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f2288-6585-4039-9619-b097cb98a73a admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.485588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f2288-6585-4039-9619-b097cb98a73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:13.487289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f2288-6585-4039-9619-b097cb98a73a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:13.505020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1013/2026] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:13.505020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f2288-6585-4039-9619-b097cb98a73a admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:13.510243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-3d6f2288-6585-4039-9619-b097cb98a73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:13.532288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7247057-2427-4fd5-b68a-68c4759ca2fc admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:13.537326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47654fb5-a3cc-4521-bd80-b7017e0e23d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:13.538128 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47654fb5-a3cc-4521-bd80-b7017e0e23d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.538545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47654fb5-a3cc-4521-bd80-b7017e0e23d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.538827 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47654fb5-a3cc-4521-bd80-b7017e0e23d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.539517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47654fb5-a3cc-4521-bd80-b7017e0e23d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:13.541711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47654fb5-a3cc-4521-bd80-b7017e0e23d4 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:13.562991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1014/2027] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:13 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:13.567037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47654fb5-a3cc-4521-bd80-b7017e0e23d4 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:13.571067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f2288-6585-4039-9619-b097cb98a73a admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:13.575130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22934368-b444-4654-b9f6-99822045f76d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:13.575885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22934368-b444-4654-b9f6-99822045f76d service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.576245 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22934368-b444-4654-b9f6-99822045f76d service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.576610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22934368-b444-4654-b9f6-99822045f76d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.578147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47654fb5-a3cc-4521-bd80-b7017e0e23d4 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:13.583294 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd563a94-06a0-4004-97ec-5ca328046425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:13.583998 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd563a94-06a0-4004-97ec-5ca328046425 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.584279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd563a94-06a0-4004-97ec-5ca328046425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.584552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd563a94-06a0-4004-97ec-5ca328046425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.585337 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd563a94-06a0-4004-97ec-5ca328046425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:13.587155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd563a94-06a0-4004-97ec-5ca328046425 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:13.590612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22934368-b444-4654-b9f6-99822045f76d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:13.592283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22934368-b444-4654-b9f6-99822045f76d service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:13.600333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1015/2028] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:13.601169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd563a94-06a0-4004-97ec-5ca328046425 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:13.604545 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1014/2029] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:13.605679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22934368-b444-4654-b9f6-99822045f76d service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:13.616627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22934368-b444-4654-b9f6-99822045f76d service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:13.621044 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd563a94-06a0-4004-97ec-5ca328046425 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:13.621925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc6d90-3ae5-45b5-90d2-c9ffcee9e156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:13.622916 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc6d90-3ae5-45b5-90d2-c9ffcee9e156 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.623196 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc6d90-3ae5-45b5-90d2-c9ffcee9e156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.623469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc6d90-3ae5-45b5-90d2-c9ffcee9e156 admin admin] PATH_INFO: `/v3/projects/baa5617869134faa88b79e323becb4bc/users/2c47a0d1b20b4450b871e2a307e04ad7/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.628024 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f35c8-1a8a-4e66-ac6f-95d831bad5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:13.628788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f35c8-1a8a-4e66-ac6f-95d831bad5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.629096 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f35c8-1a8a-4e66-ac6f-95d831bad5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.629393 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f35c8-1a8a-4e66-ac6f-95d831bad5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.630420 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f35c8-1a8a-4e66-ac6f-95d831bad5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:13.632735 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f35c8-1a8a-4e66-ac6f-95d831bad5a3 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:13.645424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc6d90-3ae5-45b5-90d2-c9ffcee9e156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa5617869134faa88b79e323becb4bc, user_id=2c47a0d1b20b4450b871e2a307e04ad7, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:13.645646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1016/2030] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:13.649094 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc6d90-3ae5-45b5-90d2-c9ffcee9e156 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:13.650571 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f35c8-1a8a-4e66-ac6f-95d831bad5a3 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:13.663038 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f35c8-1a8a-4e66-ac6f-95d831bad5a3 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:13.667676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1015/2031] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:13 2022] PUT /identity/v3/projects/baa5617869134faa88b79e323becb4bc/users/2c47a0d1b20b4450b871e2a307e04ad7/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:13.690959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e337b8d-620a-4f04-ab57-21f1877c0e95 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.693530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e337b8d-620a-4f04-ab57-21f1877c0e95 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.693679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e337b8d-620a-4f04-ab57-21f1877c0e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.764928 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-7e337b8d-620a-4f04-ab57-21f1877c0e95 None None] MFA Rules not processed for user `2c47a0d1b20b4450b871e2a307e04ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:13.766340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7e337b8d-620a-4f04-ab57-21f1877c0e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:13.767104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f41df-6e21-461b-a8e8-0de600392ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:13.768425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f41df-6e21-461b-a8e8-0de600392ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.768787 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f41df-6e21-461b-a8e8-0de600392ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.769520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f41df-6e21-461b-a8e8-0de600392ba3 admin admin] PATH_INFO: `/v3/projects/d0512c6339274355ba3df8c676c4e78a/users/44de771f9ea64698a00078e7af0d7c46/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.793523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f41df-6e21-461b-a8e8-0de600392ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0512c6339274355ba3df8c676c4e78a, user_id=44de771f9ea64698a00078e7af0d7c46, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:13.797729 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f41df-6e21-461b-a8e8-0de600392ba3 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:13.819664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1017/2032] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:13 2022] PUT /identity/v3/projects/d0512c6339274355ba3df8c676c4e78a/users/44de771f9ea64698a00078e7af0d7c46/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:13.824009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f41df-6e21-461b-a8e8-0de600392ba3 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:13.858345 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1016/2033] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:13.863381 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e337b8d-620a-4f04-ab57-21f1877c0e95 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:13.878084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e337b8d-620a-4f04-ab57-21f1877c0e95 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:13.921622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f41df-6e21-461b-a8e8-0de600392ba3 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:13.928778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d20fb-ef59-48b2-98e1-c1b8b8abc302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:13.929482 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d20fb-ef59-48b2-98e1-c1b8b8abc302 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.929786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d20fb-ef59-48b2-98e1-c1b8b8abc302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.930591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d20fb-ef59-48b2-98e1-c1b8b8abc302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.931320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d20fb-ef59-48b2-98e1-c1b8b8abc302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:13.933519 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d20fb-ef59-48b2-98e1-c1b8b8abc302 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:13.949218 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1018/2034] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:43:13.953265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d20fb-ef59-48b2-98e1-c1b8b8abc302 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:13.971250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b847c65-b658-4ea7-acaf-88255ae41036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:13.971982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b847c65-b658-4ea7-acaf-88255ae41036 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.972207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b847c65-b658-4ea7-acaf-88255ae41036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.973636 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b847c65-b658-4ea7-acaf-88255ae41036 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.974415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b847c65-b658-4ea7-acaf-88255ae41036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:13.976359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b847c65-b658-4ea7-acaf-88255ae41036 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:13.977877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d20fb-ef59-48b2-98e1-c1b8b8abc302 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:13.983698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b0cdb-1f62-4064-9a08-cb2394bb215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:13.984354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b0cdb-1f62-4064-9a08-cb2394bb215a admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:13.984686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b0cdb-1f62-4064-9a08-cb2394bb215a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:13.984958 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b0cdb-1f62-4064-9a08-cb2394bb215a admin admin] PATH_INFO: `/v3/projects/d0512c6339274355ba3df8c676c4e78a/users/44de771f9ea64698a00078e7af0d7c46/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:13.987595 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b0cdb-1f62-4064-9a08-cb2394bb215a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0512c6339274355ba3df8c676c4e78a, user_id=44de771f9ea64698a00078e7af0d7c46, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:13.990803 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b0cdb-1f62-4064-9a08-cb2394bb215a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:14.005025 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1019/2035] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:13 2022] PUT /identity/v3/projects/d0512c6339274355ba3df8c676c4e78a/users/44de771f9ea64698a00078e7af0d7c46/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:14.017483 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3a970-8886-4d6d-b694-5752e5ee94fe None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:14.018523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3a970-8886-4d6d-b694-5752e5ee94fe None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:14.018805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3a970-8886-4d6d-b694-5752e5ee94fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:14.025166 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1017/2036] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:13 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:14.028880 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b847c65-b658-4ea7-acaf-88255ae41036 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:14.070783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a5a3a970-8886-4d6d-b694-5752e5ee94fe None None] MFA Rules not processed for user `44de771f9ea64698a00078e7af0d7c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:14.072081 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a5a3a970-8886-4d6d-b694-5752e5ee94fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:14.128697 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b847c65-b658-4ea7-acaf-88255ae41036 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:14.137995 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ce5e9-0547-45de-842a-ade2ebc863f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:14.138792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ce5e9-0547-45de-842a-ade2ebc863f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:14.138977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ce5e9-0547-45de-842a-ade2ebc863f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:14.139293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ce5e9-0547-45de-842a-ade2ebc863f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:14.140061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ce5e9-0547-45de-842a-ade2ebc863f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:14.145310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ce5e9-0547-45de-842a-ade2ebc863f1 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:14.183509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1020/2037] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:14 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:14.188261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1018/2038] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:14 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:14.191646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3a970-8886-4d6d-b694-5752e5ee94fe None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:14.197463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ce5e9-0547-45de-842a-ade2ebc863f1 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:14.200327 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-784ce5e9-0547-45de-842a-ade2ebc863f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:14.203582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3a970-8886-4d6d-b694-5752e5ee94fe None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:14.210461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6348e-6fc6-4439-9671-4c63434e6002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:14.212003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6348e-6fc6-4439-9671-4c63434e6002 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:14.212595 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6348e-6fc6-4439-9671-4c63434e6002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:14.213041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6348e-6fc6-4439-9671-4c63434e6002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:14.214001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6348e-6fc6-4439-9671-4c63434e6002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:14.216122 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6348e-6fc6-4439-9671-4c63434e6002 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:14.228422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1021/2039] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:14.231966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6348e-6fc6-4439-9671-4c63434e6002 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:14.244411 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6348e-6fc6-4439-9671-4c63434e6002 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:14.250432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8842706-c951-45fc-a7d4-3b8211bf5f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:14.251642 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8842706-c951-45fc-a7d4-3b8211bf5f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:14.253583 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8842706-c951-45fc-a7d4-3b8211bf5f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:14.254060 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8842706-c951-45fc-a7d4-3b8211bf5f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:14.257691 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8842706-c951-45fc-a7d4-3b8211bf5f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:14.260752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8842706-c951-45fc-a7d4-3b8211bf5f1b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:14.275158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1022/2040] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:43:14.280746 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8842706-c951-45fc-a7d4-3b8211bf5f1b admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:14.293270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8842706-c951-45fc-a7d4-3b8211bf5f1b admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:14.294089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ce5e9-0547-45de-842a-ade2ebc863f1 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:14.299566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ad061-fbc5-4b69-8bab-0bfb1df31d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:14.300489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ad061-fbc5-4b69-8bab-0bfb1df31d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:14.300907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ad061-fbc5-4b69-8bab-0bfb1df31d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:14.301187 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ad061-fbc5-4b69-8bab-0bfb1df31d19 admin admin] PATH_INFO: `/v3/projects/59bf036a695c4381826479e26c25024d/users/f96a7b1664054cd88bd26b2e72567cb9/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:14.304584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc329b52-a770-4f9f-a8eb-655a58d3ffd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:14.305802 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc329b52-a770-4f9f-a8eb-655a58d3ffd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:14.305802 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc329b52-a770-4f9f-a8eb-655a58d3ffd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:14.305802 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc329b52-a770-4f9f-a8eb-655a58d3ffd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:14.316329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc329b52-a770-4f9f-a8eb-655a58d3ffd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:14.318840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc329b52-a770-4f9f-a8eb-655a58d3ffd6 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:14.325785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ad061-fbc5-4b69-8bab-0bfb1df31d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59bf036a695c4381826479e26c25024d, user_id=f96a7b1664054cd88bd26b2e72567cb9, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:14.328630 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ad061-fbc5-4b69-8bab-0bfb1df31d19 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:14.342064 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1019/2041] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:14 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:43:14.356801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1023/2042] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:14 2022] PUT /identity/v3/projects/59bf036a695c4381826479e26c25024d/users/f96a7b1664054cd88bd26b2e72567cb9/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:14.357749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff138b9b-f77a-4323-bad4-05953cb31f37 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:14.358041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff138b9b-f77a-4323-bad4-05953cb31f37 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:14.358349 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff138b9b-f77a-4323-bad4-05953cb31f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:14.396042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-ff138b9b-f77a-4323-bad4-05953cb31f37 None None] MFA Rules not processed for user `f96a7b1664054cd88bd26b2e72567cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:14.397880 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-ff138b9b-f77a-4323-bad4-05953cb31f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:14.506560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1020/2043] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:43:14.507664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ad061-fbc5-4b69-8bab-0bfb1df31d19 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:14.596559 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ad061-fbc5-4b69-8bab-0bfb1df31d19 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:14.603387 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37fe7f-72a7-4264-8104-92b911bf5dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:14.604078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37fe7f-72a7-4264-8104-92b911bf5dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:14.604851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37fe7f-72a7-4264-8104-92b911bf5dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:14.604851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37fe7f-72a7-4264-8104-92b911bf5dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:14.605673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37fe7f-72a7-4264-8104-92b911bf5dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:14.626190 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37fe7f-72a7-4264-8104-92b911bf5dc2 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:14.678389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1024/2044] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:14 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:43:14.679564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff138b9b-f77a-4323-bad4-05953cb31f37 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:14.707407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff138b9b-f77a-4323-bad4-05953cb31f37 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:14.730686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a299d0-6c10-4ab6-a1dc-641bfd06527c None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:14.730980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a299d0-6c10-4ab6-a1dc-641bfd06527c None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:14.731265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a299d0-6c10-4ab6-a1dc-641bfd06527c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:14.772021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-73a299d0-6c10-4ab6-a1dc-641bfd06527c None None] MFA Rules not processed for user `ac454c6b807842ba821a9087f1cf4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:14.773345 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-73a299d0-6c10-4ab6-a1dc-641bfd06527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:14.796779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd28f4-e840-48ef-b1ff-32d94ec0df10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:14.797519 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd28f4-e840-48ef-b1ff-32d94ec0df10 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:14.797753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd28f4-e840-48ef-b1ff-32d94ec0df10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:14.798029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd28f4-e840-48ef-b1ff-32d94ec0df10 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:14.798894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd28f4-e840-48ef-b1ff-32d94ec0df10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:14.801036 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd28f4-e840-48ef-b1ff-32d94ec0df10 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:14.839962 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1021/2045] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:14 2022] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:43:14.840792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd28f4-e840-48ef-b1ff-32d94ec0df10 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:14.864459 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd28f4-e840-48ef-b1ff-32d94ec0df10 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:14.871504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcc264-bda4-4497-b8c0-7374ef6229ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:14.872339 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcc264-bda4-4497-b8c0-7374ef6229ff admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:14.873478 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcc264-bda4-4497-b8c0-7374ef6229ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:14.873838 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcc264-bda4-4497-b8c0-7374ef6229ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:14.874830 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcc264-bda4-4497-b8c0-7374ef6229ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:14.876844 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcc264-bda4-4497-b8c0-7374ef6229ff admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:14.888182 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1022/2046] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:43:14.892516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcc264-bda4-4497-b8c0-7374ef6229ff admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:14.905704 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcc264-bda4-4497-b8c0-7374ef6229ff admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:14.919080 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839a516-e288-4fa3-a77c-77a52d1d82ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:14.919982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839a516-e288-4fa3-a77c-77a52d1d82ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:14.920816 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839a516-e288-4fa3-a77c-77a52d1d82ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:14.921110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839a516-e288-4fa3-a77c-77a52d1d82ab admin admin] PATH_INFO: `/v3/projects/bd54e6dcdf99439faad23ebd980bcd06/users/9620459a8f1e4d248f75533cdeec10f5/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:14.931339 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1025/2047] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:14.932492 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a299d0-6c10-4ab6-a1dc-641bfd06527c None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:14.935144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-73a299d0-6c10-4ab6-a1dc-641bfd06527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:14.945546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839a516-e288-4fa3-a77c-77a52d1d82ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd54e6dcdf99439faad23ebd980bcd06, user_id=9620459a8f1e4d248f75533cdeec10f5, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:14.953170 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839a516-e288-4fa3-a77c-77a52d1d82ab admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:14.988482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1023/2048] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:14 2022] PUT /identity/v3/projects/bd54e6dcdf99439faad23ebd980bcd06/users/9620459a8f1e4d248f75533cdeec10f5/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:14.991623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839a516-e288-4fa3-a77c-77a52d1d82ab admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:15.032634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a299d0-6c10-4ab6-a1dc-641bfd06527c None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:15.083331 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839a516-e288-4fa3-a77c-77a52d1d82ab admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:15.090453 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de1258-bad9-42dc-a594-8b98b4349855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:15.091176 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de1258-bad9-42dc-a594-8b98b4349855 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:15.091588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de1258-bad9-42dc-a594-8b98b4349855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:15.091893 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de1258-bad9-42dc-a594-8b98b4349855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:15.092725 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de1258-bad9-42dc-a594-8b98b4349855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:15.095157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de1258-bad9-42dc-a594-8b98b4349855 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:15.103256 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfebc08-ca0a-440c-9945-c8a720a38905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:15.104155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfebc08-ca0a-440c-9945-c8a720a38905 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:15.104615 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfebc08-ca0a-440c-9945-c8a720a38905 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:15.105074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfebc08-ca0a-440c-9945-c8a720a38905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:15.116160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1024/2049] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:43:15.117515 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de1258-bad9-42dc-a594-8b98b4349855 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:15.132357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de1258-bad9-42dc-a594-8b98b4349855 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:15.137982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd510087-7c46-499d-966c-c42f952fdc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:15.139642 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd510087-7c46-499d-966c-c42f952fdc7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:15.140113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd510087-7c46-499d-966c-c42f952fdc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:15.140571 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd510087-7c46-499d-966c-c42f952fdc7d admin admin] PATH_INFO: `/v3/projects/bd54e6dcdf99439faad23ebd980bcd06/users/9620459a8f1e4d248f75533cdeec10f5/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:15.142934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd510087-7c46-499d-966c-c42f952fdc7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd54e6dcdf99439faad23ebd980bcd06, user_id=9620459a8f1e4d248f75533cdeec10f5, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:15.145712 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd510087-7c46-499d-966c-c42f952fdc7d admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:15.159485 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1025/2050] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:15 2022] PUT /identity/v3/projects/bd54e6dcdf99439faad23ebd980bcd06/users/9620459a8f1e4d248f75533cdeec10f5/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:15.174182 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902c78f-7862-49d5-a996-84f738e8295b None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:15.174684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902c78f-7862-49d5-a996-84f738e8295b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:15.175421 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902c78f-7862-49d5-a996-84f738e8295b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:15.212466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfebc08-ca0a-440c-9945-c8a720a38905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:15.220666 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfebc08-ca0a-440c-9945-c8a720a38905 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:15.285134 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-b902c78f-7862-49d5-a996-84f738e8295b None None] MFA Rules not processed for user `9620459a8f1e4d248f75533cdeec10f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:15.287042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1026/2051] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:15.288709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b902c78f-7862-49d5-a996-84f738e8295b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:15.471630 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1026/2052] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:15.492661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfebc08-ca0a-440c-9945-c8a720a38905 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:15.507093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfebc08-ca0a-440c-9945-c8a720a38905 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:15.595254 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa7d0e-b00d-40a0-a9e1-f7ed4b392752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:15.596042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa7d0e-b00d-40a0-a9e1-f7ed4b392752 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:15.596413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa7d0e-b00d-40a0-a9e1-f7ed4b392752 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:15.596603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa7d0e-b00d-40a0-a9e1-f7ed4b392752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:15.609247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa7d0e-b00d-40a0-a9e1-f7ed4b392752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:15.610759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa7d0e-b00d-40a0-a9e1-f7ed4b392752 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:15.625777 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1027/2053] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:16.374399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902c78f-7862-49d5-a996-84f738e8295b None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:16.378207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa7d0e-b00d-40a0-a9e1-f7ed4b392752 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:16.387178 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa7d0e-b00d-40a0-a9e1-f7ed4b392752 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:16.391070 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc68e3-b77b-4460-8a40-108304a522d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:16.391774 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc68e3-b77b-4460-8a40-108304a522d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:16.391990 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc68e3-b77b-4460-8a40-108304a522d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:16.392262 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc68e3-b77b-4460-8a40-108304a522d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:16.440120 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902c78f-7862-49d5-a996-84f738e8295b None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:16.445617 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d21bb8-3048-4625-ad12-fdd32e83c88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:16.446520 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d21bb8-3048-4625-ad12-fdd32e83c88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:16.446848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d21bb8-3048-4625-ad12-fdd32e83c88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:16.447586 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d21bb8-3048-4625-ad12-fdd32e83c88f admin admin] PATH_INFO: `/v3/users/b97042eb950242e99c2c05ab463845c8` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:16.448316 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d21bb8-3048-4625-ad12-fdd32e83c88f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b97042eb950242e99c2c05ab463845c8)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:16.450293 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d21bb8-3048-4625-ad12-fdd32e83c88f admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:16.454357 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc68e3-b77b-4460-8a40-108304a522d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:16.455854 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc68e3-b77b-4460-8a40-108304a522d1 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:16.468376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1028/2054] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:43:16.535090 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-67d21bb8-3048-4625-ad12-fdd32e83c88f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b97042eb950242e99c2c05ab463845c8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:16.537200 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-67d21bb8-3048-4625-ad12-fdd32e83c88f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b97042eb950242e99c2c05ab463845c8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:16.559990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-67d21bb8-3048-4625-ad12-fdd32e83c88f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b97042eb950242e99c2c05ab463845c8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:16.571072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-67d21bb8-3048-4625-ad12-fdd32e83c88f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b97042eb950242e99c2c05ab463845c8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:16.572285 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-67d21bb8-3048-4625-ad12-fdd32e83c88f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b97042eb950242e99c2c05ab463845c8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:16.610765 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1027/2055] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:16 2022] DELETE /identity/v3/users/b97042eb950242e99c2c05ab463845c8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:16.617607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f4150-281d-4492-af33-f7eda7f4b7ae None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:16.617886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f4150-281d-4492-af33-f7eda7f4b7ae None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:16.618188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f4150-281d-4492-af33-f7eda7f4b7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:16.681224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-037f4150-281d-4492-af33-f7eda7f4b7ae None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:16.682715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-037f4150-281d-4492-af33-f7eda7f4b7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:16.828020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1029/2056] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:16.852779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d21bb8-3048-4625-ad12-fdd32e83c88f admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:16.854921 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-67d21bb8-3048-4625-ad12-fdd32e83c88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:16.930324 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d21bb8-3048-4625-ad12-fdd32e83c88f admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:16.935064 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09a624-c50d-42f1-9d64-f34dab6ae16a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:16.936109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09a624-c50d-42f1-9d64-f34dab6ae16a service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:16.936629 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09a624-c50d-42f1-9d64-f34dab6ae16a service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:16.937380 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09a624-c50d-42f1-9d64-f34dab6ae16a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:16.978927 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09a624-c50d-42f1-9d64-f34dab6ae16a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:16.982370 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09a624-c50d-42f1-9d64-f34dab6ae16a service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:16.982516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b4dd4-7471-4bcf-a8bf-cb49f8dbc734 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:16.982880 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b4dd4-7471-4bcf-a8bf-cb49f8dbc734 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:16.983223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b4dd4-7471-4bcf-a8bf-cb49f8dbc734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:17.002133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-575b4dd4-7471-4bcf-a8bf-cb49f8dbc734 None None] MFA Rules not processed for user `ac454c6b807842ba821a9087f1cf4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:17.003514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-575b4dd4-7471-4bcf-a8bf-cb49f8dbc734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:17.010219 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1028/2057] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:17.079411 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1030/2058] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:17.642630 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09a624-c50d-42f1-9d64-f34dab6ae16a service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:17.645254 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bb09a624-c50d-42f1-9d64-f34dab6ae16a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:17.661653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09a624-c50d-42f1-9d64-f34dab6ae16a service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:17.667575 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeced7-17fe-43a7-8b58-a750e941980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:17.669402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeced7-17fe-43a7-8b58-a750e941980f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:17.669701 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeced7-17fe-43a7-8b58-a750e941980f admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:17.670003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeced7-17fe-43a7-8b58-a750e941980f admin admin] PATH_INFO: `/v3/projects/1802f1d70ab74ebca54f29a13d279ef8` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:17.671988 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeced7-17fe-43a7-8b58-a750e941980f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1802f1d70ab74ebca54f29a13d279ef8)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:17.675123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeced7-17fe-43a7-8b58-a750e941980f admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:17.726025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-03eeced7-17fe-43a7-8b58-a750e941980f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1802f1d70ab74ebca54f29a13d279ef8', 'request_id': 'req-03eeced7-17fe-43a7-8b58-a750e941980f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:17.731368 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-03eeced7-17fe-43a7-8b58-a750e941980f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1802f1d70ab74ebca54f29a13d279ef8', 'request_id': 'req-03eeced7-17fe-43a7-8b58-a750e941980f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:17.737683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-03eeced7-17fe-43a7-8b58-a750e941980f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1802f1d70ab74ebca54f29a13d279ef8', 'request_id': 'req-03eeced7-17fe-43a7-8b58-a750e941980f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:17.750476 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-03eeced7-17fe-43a7-8b58-a750e941980f admin admin] The token cache is being invalidate because project 1802f1d70ab74ebca54f29a13d279ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:17.750766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-03eeced7-17fe-43a7-8b58-a750e941980f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:17.751371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-03eeced7-17fe-43a7-8b58-a750e941980f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:17.752900 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1029/2059] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:17 2022] DELETE /identity/v3/projects/1802f1d70ab74ebca54f29a13d279ef8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:17.757730 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b4dd4-7471-4bcf-a8bf-cb49f8dbc734 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:17.769784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b4dd4-7471-4bcf-a8bf-cb49f8dbc734 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:17.834733 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9942bf4-821d-4af9-9b64-a008705b627a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:17.835730 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9942bf4-821d-4af9-9b64-a008705b627a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:17.836015 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9942bf4-821d-4af9-9b64-a008705b627a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:17.836687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9942bf4-821d-4af9-9b64-a008705b627a admin admin] PATH_INFO: `/v3/users/44de771f9ea64698a00078e7af0d7c46` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:17.837904 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9942bf4-821d-4af9-9b64-a008705b627a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44de771f9ea64698a00078e7af0d7c46)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:17.840022 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9942bf4-821d-4af9-9b64-a008705b627a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:17.892163 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d9942bf4-821d-4af9-9b64-a008705b627a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44de771f9ea64698a00078e7af0d7c46'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:17.900042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d9942bf4-821d-4af9-9b64-a008705b627a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44de771f9ea64698a00078e7af0d7c46'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:17.901678 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d9942bf4-821d-4af9-9b64-a008705b627a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44de771f9ea64698a00078e7af0d7c46'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:17.901678 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d9942bf4-821d-4af9-9b64-a008705b627a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44de771f9ea64698a00078e7af0d7c46'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:17.914422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d9942bf4-821d-4af9-9b64-a008705b627a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44de771f9ea64698a00078e7af0d7c46'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:17.940836 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1031/2060] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:17 2022] DELETE /identity/v3/users/44de771f9ea64698a00078e7af0d7c46 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:18.805120 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeced7-17fe-43a7-8b58-a750e941980f admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:18.806838 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-03eeced7-17fe-43a7-8b58-a750e941980f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:18.825381 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeced7-17fe-43a7-8b58-a750e941980f admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:18.894480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd051dad-5f27-492c-9b43-7bae3271d795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:18.895381 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd051dad-5f27-492c-9b43-7bae3271d795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:18.895736 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd051dad-5f27-492c-9b43-7bae3271d795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:18.896009 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd051dad-5f27-492c-9b43-7bae3271d795 admin admin] PATH_INFO: `/v3/projects/d0512c6339274355ba3df8c676c4e78a` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:18.897337 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd051dad-5f27-492c-9b43-7bae3271d795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0512c6339274355ba3df8c676c4e78a)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:18.899317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd051dad-5f27-492c-9b43-7bae3271d795 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:18.947573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cd051dad-5f27-492c-9b43-7bae3271d795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0512c6339274355ba3df8c676c4e78a', 'request_id': 'req-cd051dad-5f27-492c-9b43-7bae3271d795'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:18.952975 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cd051dad-5f27-492c-9b43-7bae3271d795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0512c6339274355ba3df8c676c4e78a', 'request_id': 'req-cd051dad-5f27-492c-9b43-7bae3271d795'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:18.959227 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cd051dad-5f27-492c-9b43-7bae3271d795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0512c6339274355ba3df8c676c4e78a', 'request_id': 'req-cd051dad-5f27-492c-9b43-7bae3271d795'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:18.973624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cd051dad-5f27-492c-9b43-7bae3271d795 admin admin] The token cache is being invalidate because project d0512c6339274355ba3df8c676c4e78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:18.974848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cd051dad-5f27-492c-9b43-7bae3271d795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:18.975449 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cd051dad-5f27-492c-9b43-7bae3271d795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:18.977071 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1030/2061] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:18 2022] DELETE /identity/v3/projects/d0512c6339274355ba3df8c676c4e78a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:18.984007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74296-45d3-4c68-95b2-ad0b9f6bfa4e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:18.984519 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74296-45d3-4c68-95b2-ad0b9f6bfa4e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:18.984693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74296-45d3-4c68-95b2-ad0b9f6bfa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:19.005373 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-99d74296-45d3-4c68-95b2-ad0b9f6bfa4e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:19.006588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-99d74296-45d3-4c68-95b2-ad0b9f6bfa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:19.070514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1032/2062] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:43:19.077995 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4264dc-76e2-4224-8d0e-aabb4ad31de5 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:19.078306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4264dc-76e2-4224-8d0e-aabb4ad31de5 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:19.078590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4264dc-76e2-4224-8d0e-aabb4ad31de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:19.096909 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-df4264dc-76e2-4224-8d0e-aabb4ad31de5 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:19.098110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-df4264dc-76e2-4224-8d0e-aabb4ad31de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:19.106850 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1031/2063] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:19.110940 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d74296-45d3-4c68-95b2-ad0b9f6bfa4e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:19.120805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d74296-45d3-4c68-95b2-ad0b9f6bfa4e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:19.125304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99e447-6ce0-4db7-981f-1c69879f350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:19.125945 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99e447-6ce0-4db7-981f-1c69879f350d admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:19.126261 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99e447-6ce0-4db7-981f-1c69879f350d admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:19.126536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99e447-6ce0-4db7-981f-1c69879f350d admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:19.127248 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99e447-6ce0-4db7-981f-1c69879f350d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:43:19.127549 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99e447-6ce0-4db7-981f-1c69879f350d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:19.129126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99e447-6ce0-4db7-981f-1c69879f350d admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:19.140624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1033/2064] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:43:19.144770 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4264dc-76e2-4224-8d0e-aabb4ad31de5 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:19.153908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4264dc-76e2-4224-8d0e-aabb4ad31de5 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:19.158683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddef50-50c6-4308-b777-1fc4804b7699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:19.159325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddef50-50c6-4308-b777-1fc4804b7699 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:19.159609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddef50-50c6-4308-b777-1fc4804b7699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:19.159890 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddef50-50c6-4308-b777-1fc4804b7699 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:19.160576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddef50-50c6-4308-b777-1fc4804b7699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:19.163295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddef50-50c6-4308-b777-1fc4804b7699 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:19.188185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1032/2065] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:19 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:19.192939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99e447-6ce0-4db7-981f-1c69879f350d admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:19.202641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99e447-6ce0-4db7-981f-1c69879f350d admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:19.257100 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18547e-9ace-4724-979c-90b4e899a8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:19.257757 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18547e-9ace-4724-979c-90b4e899a8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:19.258040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18547e-9ace-4724-979c-90b4e899a8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:19.258344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18547e-9ace-4724-979c-90b4e899a8f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:19.259030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18547e-9ace-4724-979c-90b4e899a8f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:19.260928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18547e-9ace-4724-979c-90b4e899a8f3 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:19.283012 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1034/2066] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:19 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:19.287315 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddef50-50c6-4308-b777-1fc4804b7699 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:19.297797 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddef50-50c6-4308-b777-1fc4804b7699 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:19.302286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0ea25-9c38-4857-94a1-25bb09ffaf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:19.302935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0ea25-9c38-4857-94a1-25bb09ffaf1a admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:19.303214 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0ea25-9c38-4857-94a1-25bb09ffaf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:19.303644 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0ea25-9c38-4857-94a1-25bb09ffaf1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:19.304359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0ea25-9c38-4857-94a1-25bb09ffaf1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:19.305940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0ea25-9c38-4857-94a1-25bb09ffaf1a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:19.316478 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1033/2067] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:43:19.320716 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18547e-9ace-4724-979c-90b4e899a8f3 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:19.330395 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18547e-9ace-4724-979c-90b4e899a8f3 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:19.335619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bbf6c-14e5-4bf0-b52e-3a38d305b6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:19.336279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bbf6c-14e5-4bf0-b52e-3a38d305b6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:19.336563 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bbf6c-14e5-4bf0-b52e-3a38d305b6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:19.336838 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bbf6c-14e5-4bf0-b52e-3a38d305b6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:19.337553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601bbf6c-14e5-4bf0-b52e-3a38d305b6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:19.339159 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601bbf6c-14e5-4bf0-b52e-3a38d305b6d8 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:19.350643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1035/2068] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:19.354916 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0ea25-9c38-4857-94a1-25bb09ffaf1a admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:19.365015 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0ea25-9c38-4857-94a1-25bb09ffaf1a admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:19.370901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff858fb-e54c-48f6-9e05-f16270c87f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:19.371875 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff858fb-e54c-48f6-9e05-f16270c87f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:19.372251 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff858fb-e54c-48f6-9e05-f16270c87f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:19.372602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff858fb-e54c-48f6-9e05-f16270c87f3e admin admin] PATH_INFO: `/v3/projects/69717ed1fabf49769bbba77a8046ebcf/users/d32fc495a1d842268a93c9285f9ef298/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:19.388859 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff858fb-e54c-48f6-9e05-f16270c87f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=69717ed1fabf49769bbba77a8046ebcf, user_id=d32fc495a1d842268a93c9285f9ef298, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:19.391866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff858fb-e54c-48f6-9e05-f16270c87f3e admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:19.406714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1034/2069] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:19 2022] PUT /identity/v3/projects/69717ed1fabf49769bbba77a8046ebcf/users/d32fc495a1d842268a93c9285f9ef298/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:19.418375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c4280-5879-419d-8580-a2d15c1c7ae8 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:19.418692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c4280-5879-419d-8580-a2d15c1c7ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:19.418963 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c4280-5879-419d-8580-a2d15c1c7ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:19.449298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-aa6c4280-5879-419d-8580-a2d15c1c7ae8 None None] MFA Rules not processed for user `d32fc495a1d842268a93c9285f9ef298`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:19.450593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-aa6c4280-5879-419d-8580-a2d15c1c7ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:19.525010 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1036/2070] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:19.529536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff858fb-e54c-48f6-9e05-f16270c87f3e admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:19.597342 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff858fb-e54c-48f6-9e05-f16270c87f3e admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:19.602537 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13ee2b-c640-46de-9ec0-b8f5a324239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:19.603200 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13ee2b-c640-46de-9ec0-b8f5a324239f admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:19.603481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13ee2b-c640-46de-9ec0-b8f5a324239f admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:19.603757 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13ee2b-c640-46de-9ec0-b8f5a324239f admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:19.604424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13ee2b-c640-46de-9ec0-b8f5a324239f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:19.606363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13ee2b-c640-46de-9ec0-b8f5a324239f admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:19.635151 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1035/2071] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:19 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:43:19.639309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c4280-5879-419d-8580-a2d15c1c7ae8 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:19.653660 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c4280-5879-419d-8580-a2d15c1c7ae8 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:19.852190 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518cf52-c0c6-4277-a751-87798a8f723f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:19.853585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518cf52-c0c6-4277-a751-87798a8f723f admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:19.854545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518cf52-c0c6-4277-a751-87798a8f723f admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:19.854902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518cf52-c0c6-4277-a751-87798a8f723f admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:19.855719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518cf52-c0c6-4277-a751-87798a8f723f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:19.857920 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518cf52-c0c6-4277-a751-87798a8f723f admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:19.900048 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1037/2072] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:19 2022] POST /identity/v3/users => generated 294 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:43:19.905862 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13ee2b-c640-46de-9ec0-b8f5a324239f admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:19.921418 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13ee2b-c640-46de-9ec0-b8f5a324239f admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:19.929456 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780e0d1-aa5d-4a39-88f9-0630a875eb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:19.930831 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780e0d1-aa5d-4a39-88f9-0630a875eb5a admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:19.931554 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780e0d1-aa5d-4a39-88f9-0630a875eb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:19.932057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780e0d1-aa5d-4a39-88f9-0630a875eb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:19.933399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780e0d1-aa5d-4a39-88f9-0630a875eb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:19.950754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780e0d1-aa5d-4a39-88f9-0630a875eb5a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:19.972847 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1036/2073] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:19.974468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518cf52-c0c6-4277-a751-87798a8f723f admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:19.988217 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518cf52-c0c6-4277-a751-87798a8f723f admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:19.996190 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e7f36-4707-441f-96ea-f9b1fe40da69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:19.997241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e7f36-4707-441f-96ea-f9b1fe40da69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:19.997758 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e7f36-4707-441f-96ea-f9b1fe40da69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:19.998249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e7f36-4707-441f-96ea-f9b1fe40da69 admin admin] PATH_INFO: `/v3/projects/5f0274d39a2c414a8f9951c7b963c093/users/3ed8a7dc592742c9aa2e0b9a6ccb852d/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:20.020981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e7f36-4707-441f-96ea-f9b1fe40da69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0274d39a2c414a8f9951c7b963c093, user_id=3ed8a7dc592742c9aa2e0b9a6ccb852d, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:20.024426 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e7f36-4707-441f-96ea-f9b1fe40da69 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:20.044126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1038/2074] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:19 2022] PUT /identity/v3/projects/5f0274d39a2c414a8f9951c7b963c093/users/3ed8a7dc592742c9aa2e0b9a6ccb852d/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:20.048023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780e0d1-aa5d-4a39-88f9-0630a875eb5a admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:20.061347 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780e0d1-aa5d-4a39-88f9-0630a875eb5a admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:20.154115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419eab16-5fd3-4213-b7eb-6b5d78123ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:20.155137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419eab16-5fd3-4213-b7eb-6b5d78123ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:20.155639 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419eab16-5fd3-4213-b7eb-6b5d78123ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:20.156048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419eab16-5fd3-4213-b7eb-6b5d78123ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:20.156982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419eab16-5fd3-4213-b7eb-6b5d78123ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:20.158616 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419eab16-5fd3-4213-b7eb-6b5d78123ca2 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:20.170724 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1037/2075] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:43:20.177677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e7f36-4707-441f-96ea-f9b1fe40da69 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:20.188394 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e7f36-4707-441f-96ea-f9b1fe40da69 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:20.193960 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb35666-37f3-4bec-a36e-27bfb54b10cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:20.199331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb35666-37f3-4bec-a36e-27bfb54b10cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:20.201157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb35666-37f3-4bec-a36e-27bfb54b10cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:20.204654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb35666-37f3-4bec-a36e-27bfb54b10cc admin admin] PATH_INFO: `/v3/projects/5f0274d39a2c414a8f9951c7b963c093/users/3ed8a7dc592742c9aa2e0b9a6ccb852d/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:20.207863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb35666-37f3-4bec-a36e-27bfb54b10cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0274d39a2c414a8f9951c7b963c093, user_id=3ed8a7dc592742c9aa2e0b9a6ccb852d, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:20.212335 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb35666-37f3-4bec-a36e-27bfb54b10cc admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:20.230207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1039/2076] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:20 2022] PUT /identity/v3/projects/5f0274d39a2c414a8f9951c7b963c093/users/3ed8a7dc592742c9aa2e0b9a6ccb852d/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:20.238000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7b15d-704f-43c4-bfc5-2084ac4c6abd None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:20.238649 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7b15d-704f-43c4-bfc5-2084ac4c6abd None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:20.240554 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7b15d-704f-43c4-bfc5-2084ac4c6abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:20.286057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-55e7b15d-704f-43c4-bfc5-2084ac4c6abd None None] MFA Rules not processed for user `3ed8a7dc592742c9aa2e0b9a6ccb852d`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:20.291657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-55e7b15d-704f-43c4-bfc5-2084ac4c6abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:20.362310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1038/2077] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:20.374455 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb35666-37f3-4bec-a36e-27bfb54b10cc admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:20.376205 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-fbb35666-37f3-4bec-a36e-27bfb54b10cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:20.434554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb35666-37f3-4bec-a36e-27bfb54b10cc admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:20.438133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727225d-9926-4439-a054-ba84343b43f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:20.438795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727225d-9926-4439-a054-ba84343b43f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:20.439076 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727225d-9926-4439-a054-ba84343b43f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:20.439350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727225d-9926-4439-a054-ba84343b43f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:20.494028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727225d-9926-4439-a054-ba84343b43f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:20.495479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727225d-9926-4439-a054-ba84343b43f7 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:20.504250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1040/2078] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:21.004964 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7b15d-704f-43c4-bfc5-2084ac4c6abd None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:21.014624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7b15d-704f-43c4-bfc5-2084ac4c6abd None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:21.018123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ed5f9-78cb-4ab8-9fe3-14d9e9a0aaae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:21.018786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ed5f9-78cb-4ab8-9fe3-14d9e9a0aaae service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:21.019067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ed5f9-78cb-4ab8-9fe3-14d9e9a0aaae service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:21.019341 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ed5f9-78cb-4ab8-9fe3-14d9e9a0aaae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:21.021678 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-061ed5f9-78cb-4ab8-9fe3-14d9e9a0aaae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:21.079705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ed5f9-78cb-4ab8-9fe3-14d9e9a0aaae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:21.081128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ed5f9-78cb-4ab8-9fe3-14d9e9a0aaae service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:21.091073 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1039/2079] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:21.153546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727225d-9926-4439-a054-ba84343b43f7 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:21.155336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a727225d-9926-4439-a054-ba84343b43f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:21.247728 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727225d-9926-4439-a054-ba84343b43f7 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:21.255521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825680d3-1cf0-40c4-81e7-5fd07c30bda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:21.256780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825680d3-1cf0-40c4-81e7-5fd07c30bda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:21.257262 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825680d3-1cf0-40c4-81e7-5fd07c30bda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:21.257705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825680d3-1cf0-40c4-81e7-5fd07c30bda6 admin admin] PATH_INFO: `/v3/users/667a1fddc43f4829aa1f661d9cac8002` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:21.259255 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825680d3-1cf0-40c4-81e7-5fd07c30bda6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=667a1fddc43f4829aa1f661d9cac8002)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:21.261518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825680d3-1cf0-40c4-81e7-5fd07c30bda6 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:21.344608 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-825680d3-1cf0-40c4-81e7-5fd07c30bda6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '667a1fddc43f4829aa1f661d9cac8002'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:21.358202 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-825680d3-1cf0-40c4-81e7-5fd07c30bda6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '667a1fddc43f4829aa1f661d9cac8002'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:21.359158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-825680d3-1cf0-40c4-81e7-5fd07c30bda6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '667a1fddc43f4829aa1f661d9cac8002'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:21.360173 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-825680d3-1cf0-40c4-81e7-5fd07c30bda6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '667a1fddc43f4829aa1f661d9cac8002'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:21.379578 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-825680d3-1cf0-40c4-81e7-5fd07c30bda6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '667a1fddc43f4829aa1f661d9cac8002'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:21.401174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1041/2080] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:21 2022] DELETE /identity/v3/users/667a1fddc43f4829aa1f661d9cac8002 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:21.406154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95829bd8-00d7-43d5-b952-e30e0386f67f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:21.406704 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95829bd8-00d7-43d5-b952-e30e0386f67f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:21.407031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95829bd8-00d7-43d5-b952-e30e0386f67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:21.430366 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-95829bd8-00d7-43d5-b952-e30e0386f67f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:21.431854 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-95829bd8-00d7-43d5-b952-e30e0386f67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:21.506188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1040/2081] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:21.522857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825680d3-1cf0-40c4-81e7-5fd07c30bda6 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:21.526007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-825680d3-1cf0-40c4-81e7-5fd07c30bda6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:21.643099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825680d3-1cf0-40c4-81e7-5fd07c30bda6 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:21.678649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d98a9-175b-4243-90ec-dc2ee8eadf0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:21.681238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d98a9-175b-4243-90ec-dc2ee8eadf0c service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:21.681594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d98a9-175b-4243-90ec-dc2ee8eadf0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:21.683004 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d98a9-175b-4243-90ec-dc2ee8eadf0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:21.703227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d98a9-175b-4243-90ec-dc2ee8eadf0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:21.705350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d98a9-175b-4243-90ec-dc2ee8eadf0c service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:21.721710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1042/2082] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:22.641739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95829bd8-00d7-43d5-b952-e30e0386f67f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:22.648739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-95829bd8-00d7-43d5-b952-e30e0386f67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:22.671119 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95829bd8-00d7-43d5-b952-e30e0386f67f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:22.679741 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a6d18-1c36-4f5d-a1ff-2ee551406751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:22.681240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6d18-1c36-4f5d-a1ff-2ee551406751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:22.681538 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6d18-1c36-4f5d-a1ff-2ee551406751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:22.681819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a6d18-1c36-4f5d-a1ff-2ee551406751 admin admin] PATH_INFO: `/v3/projects/e09f6220c16b47c583dacb8debb43cba` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:22.683182 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a6d18-1c36-4f5d-a1ff-2ee551406751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09f6220c16b47c583dacb8debb43cba)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:22.685950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a6d18-1c36-4f5d-a1ff-2ee551406751 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:22.740638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b48a6d18-1c36-4f5d-a1ff-2ee551406751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09f6220c16b47c583dacb8debb43cba', 'request_id': 'req-b48a6d18-1c36-4f5d-a1ff-2ee551406751'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:22.746667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b48a6d18-1c36-4f5d-a1ff-2ee551406751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09f6220c16b47c583dacb8debb43cba', 'request_id': 'req-b48a6d18-1c36-4f5d-a1ff-2ee551406751'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:22.754031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b48a6d18-1c36-4f5d-a1ff-2ee551406751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09f6220c16b47c583dacb8debb43cba', 'request_id': 'req-b48a6d18-1c36-4f5d-a1ff-2ee551406751'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:22.768348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b48a6d18-1c36-4f5d-a1ff-2ee551406751 admin admin] The token cache is being invalidate because project e09f6220c16b47c583dacb8debb43cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:22.768637 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b48a6d18-1c36-4f5d-a1ff-2ee551406751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:22.769344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b48a6d18-1c36-4f5d-a1ff-2ee551406751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:22.772032 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1041/2083] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:22 2022] DELETE /identity/v3/projects/e09f6220c16b47c583dacb8debb43cba => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:22.777639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b324c1-e3d5-4e6e-a68f-b571b4ca333a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:22.778058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b324c1-e3d5-4e6e-a68f-b571b4ca333a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:22.778389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b324c1-e3d5-4e6e-a68f-b571b4ca333a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:22.798328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-06b324c1-e3d5-4e6e-a68f-b571b4ca333a None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:22.799568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-06b324c1-e3d5-4e6e-a68f-b571b4ca333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:22.869101 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1043/2084] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:22.877000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200e9ca-4dd3-4ee0-b903-f9df4e137f0c None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:22.877321 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200e9ca-4dd3-4ee0-b903-f9df4e137f0c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:22.877599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200e9ca-4dd3-4ee0-b903-f9df4e137f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:22.896458 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-2200e9ca-4dd3-4ee0-b903-f9df4e137f0c None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:22.897653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-2200e9ca-4dd3-4ee0-b903-f9df4e137f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:22.905542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1042/2085] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:22.909924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b324c1-e3d5-4e6e-a68f-b571b4ca333a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:22.919774 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b324c1-e3d5-4e6e-a68f-b571b4ca333a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:22.924340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7708-fde0-4676-b5c2-4fe141f65811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:22.924995 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7708-fde0-4676-b5c2-4fe141f65811 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:22.925282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7708-fde0-4676-b5c2-4fe141f65811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:22.925561 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7708-fde0-4676-b5c2-4fe141f65811 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:22.926322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c7708-fde0-4676-b5c2-4fe141f65811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:43:22.926662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c7708-fde0-4676-b5c2-4fe141f65811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:22.928292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c7708-fde0-4676-b5c2-4fe141f65811 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:22.940268 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1044/2086] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:43:22.945526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200e9ca-4dd3-4ee0-b903-f9df4e137f0c None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:22.954804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200e9ca-4dd3-4ee0-b903-f9df4e137f0c None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:22.960719 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab912819-e42d-4439-8802-10a9591260b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:22.961369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab912819-e42d-4439-8802-10a9591260b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:22.961649 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab912819-e42d-4439-8802-10a9591260b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:22.961920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab912819-e42d-4439-8802-10a9591260b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:22.962655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab912819-e42d-4439-8802-10a9591260b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:22.964673 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab912819-e42d-4439-8802-10a9591260b2 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:22.996423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1043/2087] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:22 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:23.000718 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7708-fde0-4676-b5c2-4fe141f65811 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:23.012044 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7708-fde0-4676-b5c2-4fe141f65811 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:23.071136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745ab59-532e-460d-b651-0802dcef10d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:23.071889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745ab59-532e-460d-b651-0802dcef10d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:23.072176 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745ab59-532e-460d-b651-0802dcef10d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:23.072450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745ab59-532e-460d-b651-0802dcef10d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:23.073144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745ab59-532e-460d-b651-0802dcef10d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:23.075078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745ab59-532e-460d-b651-0802dcef10d9 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:23.095481 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1045/2088] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:22 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:23.100483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab912819-e42d-4439-8802-10a9591260b2 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:23.111664 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab912819-e42d-4439-8802-10a9591260b2 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:23.117067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba449128-3ef0-42fd-9039-fd04c6b78938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:23.117722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba449128-3ef0-42fd-9039-fd04c6b78938 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:23.118000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba449128-3ef0-42fd-9039-fd04c6b78938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:23.118340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba449128-3ef0-42fd-9039-fd04c6b78938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:23.119015 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba449128-3ef0-42fd-9039-fd04c6b78938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:23.120600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba449128-3ef0-42fd-9039-fd04c6b78938 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:23.132021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1044/2089] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:23.135934 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745ab59-532e-460d-b651-0802dcef10d9 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:23.146314 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745ab59-532e-460d-b651-0802dcef10d9 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:23.151104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834dc0e-94f1-4d3b-afa0-18d1a00fd084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:23.151770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834dc0e-94f1-4d3b-afa0-18d1a00fd084 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:23.152054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834dc0e-94f1-4d3b-afa0-18d1a00fd084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:23.152328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834dc0e-94f1-4d3b-afa0-18d1a00fd084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:23.153048 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834dc0e-94f1-4d3b-afa0-18d1a00fd084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:23.154839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834dc0e-94f1-4d3b-afa0-18d1a00fd084 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:23.168129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1046/2090] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:23.169690 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba449128-3ef0-42fd-9039-fd04c6b78938 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:23.189004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba449128-3ef0-42fd-9039-fd04c6b78938 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:23.195026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ea930-c01d-4c52-bd28-f908f7458c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:23.195974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ea930-c01d-4c52-bd28-f908f7458c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:23.196396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ea930-c01d-4c52-bd28-f908f7458c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:23.196767 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ea930-c01d-4c52-bd28-f908f7458c51 admin admin] PATH_INFO: `/v3/projects/89fca92b565f42ffba33b22f01fbc248/users/5953ab291e2844b297285ae3bb92be85/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:23.213030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ea930-c01d-4c52-bd28-f908f7458c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89fca92b565f42ffba33b22f01fbc248, user_id=5953ab291e2844b297285ae3bb92be85, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:23.215801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ea930-c01d-4c52-bd28-f908f7458c51 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:23.230590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1045/2091] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:23 2022] PUT /identity/v3/projects/89fca92b565f42ffba33b22f01fbc248/users/5953ab291e2844b297285ae3bb92be85/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:23.235384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ccbdf-72da-47cf-81a6-6bab7829c744 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:23.235881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ccbdf-72da-47cf-81a6-6bab7829c744 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:23.236167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ccbdf-72da-47cf-81a6-6bab7829c744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:23.254326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a56ccbdf-72da-47cf-81a6-6bab7829c744 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:23.255595 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a56ccbdf-72da-47cf-81a6-6bab7829c744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:23.328359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1047/2092] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:23.338119 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ea930-c01d-4c52-bd28-f908f7458c51 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:23.340264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-1d8ea930-c01d-4c52-bd28-f908f7458c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:23.432525 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ea930-c01d-4c52-bd28-f908f7458c51 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:23.436604 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dc465-db2a-41ee-a6e8-ffec17aa5dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:23.437504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dc465-db2a-41ee-a6e8-ffec17aa5dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:23.438143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dc465-db2a-41ee-a6e8-ffec17aa5dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:23.438996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dc465-db2a-41ee-a6e8-ffec17aa5dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:23.452645 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dc465-db2a-41ee-a6e8-ffec17aa5dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:23.454698 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dc465-db2a-41ee-a6e8-ffec17aa5dc6 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:23.467361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1046/2093] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:23.761531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ccbdf-72da-47cf-81a6-6bab7829c744 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:23.763061 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a56ccbdf-72da-47cf-81a6-6bab7829c744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:23.775420 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ccbdf-72da-47cf-81a6-6bab7829c744 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:23.780301 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdeb32-729d-4b7a-b52c-afd13649e6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:23.781178 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdeb32-729d-4b7a-b52c-afd13649e6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:23.781492 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdeb32-729d-4b7a-b52c-afd13649e6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:23.781773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdeb32-729d-4b7a-b52c-afd13649e6d2 admin admin] PATH_INFO: `/v3/users/2c47a0d1b20b4450b871e2a307e04ad7` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:23.783078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdeb32-729d-4b7a-b52c-afd13649e6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c47a0d1b20b4450b871e2a307e04ad7)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:23.785025 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdeb32-729d-4b7a-b52c-afd13649e6d2 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:23.840383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b3cdeb32-729d-4b7a-b52c-afd13649e6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c47a0d1b20b4450b871e2a307e04ad7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:23.851450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b3cdeb32-729d-4b7a-b52c-afd13649e6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c47a0d1b20b4450b871e2a307e04ad7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:23.852568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b3cdeb32-729d-4b7a-b52c-afd13649e6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c47a0d1b20b4450b871e2a307e04ad7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:23.853289 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b3cdeb32-729d-4b7a-b52c-afd13649e6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c47a0d1b20b4450b871e2a307e04ad7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:23.868566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b3cdeb32-729d-4b7a-b52c-afd13649e6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c47a0d1b20b4450b871e2a307e04ad7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:23.886868 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1048/2094] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:23 2022] DELETE /identity/v3/users/2c47a0d1b20b4450b871e2a307e04ad7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:23.888938 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35247daa-dfd8-4e41-9396-432a4657ad80 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:23.889330 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35247daa-dfd8-4e41-9396-432a4657ad80 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:23.889555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35247daa-dfd8-4e41-9396-432a4657ad80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:23.906542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-35247daa-dfd8-4e41-9396-432a4657ad80 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:23.907745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-35247daa-dfd8-4e41-9396-432a4657ad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:23.970968 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1047/2095] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:23.981690 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdeb32-729d-4b7a-b52c-afd13649e6d2 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:23.983148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b3cdeb32-729d-4b7a-b52c-afd13649e6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:24.041854 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdeb32-729d-4b7a-b52c-afd13649e6d2 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:24.045573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695b2e8-23ce-4dcb-8a4c-f64a41bb9ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:24.046249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695b2e8-23ce-4dcb-8a4c-f64a41bb9ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:24.046536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695b2e8-23ce-4dcb-8a4c-f64a41bb9ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:24.046813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695b2e8-23ce-4dcb-8a4c-f64a41bb9ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:24.057054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695b2e8-23ce-4dcb-8a4c-f64a41bb9ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:24.058531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695b2e8-23ce-4dcb-8a4c-f64a41bb9ff3 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:24.069838 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1049/2096] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:24.377239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35247daa-dfd8-4e41-9396-432a4657ad80 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:24.379031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-35247daa-dfd8-4e41-9396-432a4657ad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:24.401224 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35247daa-dfd8-4e41-9396-432a4657ad80 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:24.408103 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5c245-24db-4d33-b280-20ff6ccd5f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:24.409264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5c245-24db-4d33-b280-20ff6ccd5f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:24.409551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5c245-24db-4d33-b280-20ff6ccd5f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:24.409824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5c245-24db-4d33-b280-20ff6ccd5f5f admin admin] PATH_INFO: `/v3/projects/baa5617869134faa88b79e323becb4bc` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:24.411701 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5c245-24db-4d33-b280-20ff6ccd5f5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa5617869134faa88b79e323becb4bc)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:24.413842 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5c245-24db-4d33-b280-20ff6ccd5f5f admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:24.487667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0af5c245-24db-4d33-b280-20ff6ccd5f5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa5617869134faa88b79e323becb4bc', 'request_id': 'req-0af5c245-24db-4d33-b280-20ff6ccd5f5f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:24.495777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0af5c245-24db-4d33-b280-20ff6ccd5f5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa5617869134faa88b79e323becb4bc', 'request_id': 'req-0af5c245-24db-4d33-b280-20ff6ccd5f5f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:24.503387 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0af5c245-24db-4d33-b280-20ff6ccd5f5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa5617869134faa88b79e323becb4bc', 'request_id': 'req-0af5c245-24db-4d33-b280-20ff6ccd5f5f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:24.528686 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0af5c245-24db-4d33-b280-20ff6ccd5f5f admin admin] The token cache is being invalidate because project baa5617869134faa88b79e323becb4bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:24.529202 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0af5c245-24db-4d33-b280-20ff6ccd5f5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:24.541284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0af5c245-24db-4d33-b280-20ff6ccd5f5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:24.543238 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1048/2097] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:24 2022] DELETE /identity/v3/projects/baa5617869134faa88b79e323becb4bc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:24.548858 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695b2e8-23ce-4dcb-8a4c-f64a41bb9ff3 service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:24.570247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695b2e8-23ce-4dcb-8a4c-f64a41bb9ff3 service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:24.661005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e32936-54d2-4b3a-b8fd-e82495353994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:24.661975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e32936-54d2-4b3a-b8fd-e82495353994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:24.662462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e32936-54d2-4b3a-b8fd-e82495353994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:24.662883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e32936-54d2-4b3a-b8fd-e82495353994 admin admin] PATH_INFO: `/v3/users/f96a7b1664054cd88bd26b2e72567cb9` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:24.664120 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e32936-54d2-4b3a-b8fd-e82495353994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f96a7b1664054cd88bd26b2e72567cb9)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:24.666030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e32936-54d2-4b3a-b8fd-e82495353994 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:24.734334 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d6e32936-54d2-4b3a-b8fd-e82495353994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f96a7b1664054cd88bd26b2e72567cb9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:24.744700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d6e32936-54d2-4b3a-b8fd-e82495353994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f96a7b1664054cd88bd26b2e72567cb9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:24.745505 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d6e32936-54d2-4b3a-b8fd-e82495353994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f96a7b1664054cd88bd26b2e72567cb9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:24.746110 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d6e32936-54d2-4b3a-b8fd-e82495353994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f96a7b1664054cd88bd26b2e72567cb9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:24.760524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d6e32936-54d2-4b3a-b8fd-e82495353994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f96a7b1664054cd88bd26b2e72567cb9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:24.781468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1050/2098] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:24 2022] DELETE /identity/v3/users/f96a7b1664054cd88bd26b2e72567cb9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:25.469366 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5c245-24db-4d33-b280-20ff6ccd5f5f admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:25.471887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-0af5c245-24db-4d33-b280-20ff6ccd5f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:25.494459 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5c245-24db-4d33-b280-20ff6ccd5f5f admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:25.570320 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66615987-bc63-497b-a25b-37a25f470373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:25.571422 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66615987-bc63-497b-a25b-37a25f470373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:25.571846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66615987-bc63-497b-a25b-37a25f470373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:25.572262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66615987-bc63-497b-a25b-37a25f470373 admin admin] PATH_INFO: `/v3/projects/59bf036a695c4381826479e26c25024d` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:25.573626 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66615987-bc63-497b-a25b-37a25f470373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59bf036a695c4381826479e26c25024d)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:25.575884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66615987-bc63-497b-a25b-37a25f470373 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:25.666692 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-66615987-bc63-497b-a25b-37a25f470373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59bf036a695c4381826479e26c25024d', 'request_id': 'req-66615987-bc63-497b-a25b-37a25f470373'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:25.673866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-66615987-bc63-497b-a25b-37a25f470373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59bf036a695c4381826479e26c25024d', 'request_id': 'req-66615987-bc63-497b-a25b-37a25f470373'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:25.682353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-66615987-bc63-497b-a25b-37a25f470373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59bf036a695c4381826479e26c25024d', 'request_id': 'req-66615987-bc63-497b-a25b-37a25f470373'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:25.704142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-66615987-bc63-497b-a25b-37a25f470373 admin admin] The token cache is being invalidate because project 59bf036a695c4381826479e26c25024d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:25.704590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-66615987-bc63-497b-a25b-37a25f470373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:25.705585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-66615987-bc63-497b-a25b-37a25f470373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:25.708489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1049/2099] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:25 2022] DELETE /identity/v3/projects/59bf036a695c4381826479e26c25024d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:25.713157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e32936-54d2-4b3a-b8fd-e82495353994 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:25.715082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d6e32936-54d2-4b3a-b8fd-e82495353994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:25.734999 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e32936-54d2-4b3a-b8fd-e82495353994 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:25.822648 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6f322-2606-4a2b-ac79-131d589646cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:25.826451 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6f322-2606-4a2b-ac79-131d589646cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:25.829156 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6f322-2606-4a2b-ac79-131d589646cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:25.829639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6f322-2606-4a2b-ac79-131d589646cc admin admin] PATH_INFO: `/v3/users/9620459a8f1e4d248f75533cdeec10f5` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:25.833664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6f322-2606-4a2b-ac79-131d589646cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9620459a8f1e4d248f75533cdeec10f5)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:25.835741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6f322-2606-4a2b-ac79-131d589646cc admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:25.950911 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-efb6f322-2606-4a2b-ac79-131d589646cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9620459a8f1e4d248f75533cdeec10f5'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:25.964056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-efb6f322-2606-4a2b-ac79-131d589646cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9620459a8f1e4d248f75533cdeec10f5'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:25.965174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-efb6f322-2606-4a2b-ac79-131d589646cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9620459a8f1e4d248f75533cdeec10f5'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:25.966489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-efb6f322-2606-4a2b-ac79-131d589646cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9620459a8f1e4d248f75533cdeec10f5'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:26.001306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-efb6f322-2606-4a2b-ac79-131d589646cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9620459a8f1e4d248f75533cdeec10f5'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:26.047703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1051/2100] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:25 2022] DELETE /identity/v3/users/9620459a8f1e4d248f75533cdeec10f5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:26.563308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66615987-bc63-497b-a25b-37a25f470373 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:26.565053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-66615987-bc63-497b-a25b-37a25f470373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:26.659730 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66615987-bc63-497b-a25b-37a25f470373 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:26.756576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3408d-2416-434c-ba7d-838dde84fc3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:26.757881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3408d-2416-434c-ba7d-838dde84fc3b service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:26.760135 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3408d-2416-434c-ba7d-838dde84fc3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:26.761064 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3408d-2416-434c-ba7d-838dde84fc3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:26.779400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-25c3408d-2416-434c-ba7d-838dde84fc3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:26.867391 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3408d-2416-434c-ba7d-838dde84fc3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:26.870024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3408d-2416-434c-ba7d-838dde84fc3b service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:26.881656 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1050/2101] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:27.220768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6f322-2606-4a2b-ac79-131d589646cc admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:27.223021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-efb6f322-2606-4a2b-ac79-131d589646cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:27.393754 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6f322-2606-4a2b-ac79-131d589646cc admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:27.399522 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66ee36-f0de-4160-ac92-1fde4558f887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:27.400584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66ee36-f0de-4160-ac92-1fde4558f887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:27.400864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66ee36-f0de-4160-ac92-1fde4558f887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:27.401134 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66ee36-f0de-4160-ac92-1fde4558f887 admin admin] PATH_INFO: `/v3/projects/bd54e6dcdf99439faad23ebd980bcd06` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:27.402539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66ee36-f0de-4160-ac92-1fde4558f887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd54e6dcdf99439faad23ebd980bcd06)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:27.404447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66ee36-f0de-4160-ac92-1fde4558f887 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:27.461061 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8f66ee36-f0de-4160-ac92-1fde4558f887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd54e6dcdf99439faad23ebd980bcd06', 'request_id': 'req-8f66ee36-f0de-4160-ac92-1fde4558f887'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:27.470796 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8f66ee36-f0de-4160-ac92-1fde4558f887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd54e6dcdf99439faad23ebd980bcd06', 'request_id': 'req-8f66ee36-f0de-4160-ac92-1fde4558f887'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:27.478958 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8f66ee36-f0de-4160-ac92-1fde4558f887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd54e6dcdf99439faad23ebd980bcd06', 'request_id': 'req-8f66ee36-f0de-4160-ac92-1fde4558f887'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:27.489160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3408d-2416-434c-ba7d-838dde84fc3b service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:27.490849 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-25c3408d-2416-434c-ba7d-838dde84fc3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:27.495973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8f66ee36-f0de-4160-ac92-1fde4558f887 admin admin] The token cache is being invalidate because project bd54e6dcdf99439faad23ebd980bcd06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:27.496266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8f66ee36-f0de-4160-ac92-1fde4558f887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:27.496915 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8f66ee36-f0de-4160-ac92-1fde4558f887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:27.498507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1052/2102] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:27 2022] DELETE /identity/v3/projects/bd54e6dcdf99439faad23ebd980bcd06 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:27.504631 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40116fd1-adc5-469e-a26a-f082dd261a59 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:27.505129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40116fd1-adc5-469e-a26a-f082dd261a59 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:27.505542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40116fd1-adc5-469e-a26a-f082dd261a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:27.509659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3408d-2416-434c-ba7d-838dde84fc3b service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:27.531800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-40116fd1-adc5-469e-a26a-f082dd261a59 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:27.533004 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-40116fd1-adc5-469e-a26a-f082dd261a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:27.585476 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b867a0-add9-4476-b4c0-f0fed8959fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:27.586384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b867a0-add9-4476-b4c0-f0fed8959fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:27.586659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b867a0-add9-4476-b4c0-f0fed8959fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:27.587595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b867a0-add9-4476-b4c0-f0fed8959fe3 admin admin] PATH_INFO: `/v3/users/b1d30649f0904dbe841c23d8e091531e` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:27.588872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b867a0-add9-4476-b4c0-f0fed8959fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d30649f0904dbe841c23d8e091531e)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:27.590853 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b867a0-add9-4476-b4c0-f0fed8959fe3 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:27.601369 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1053/2103] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:27.609823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c334122-88bb-440e-8fac-e05153b941d4 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:27.610110 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c334122-88bb-440e-8fac-e05153b941d4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:27.610416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c334122-88bb-440e-8fac-e05153b941d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:27.644597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-6c334122-88bb-440e-8fac-e05153b941d4 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:27.645949 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6c334122-88bb-440e-8fac-e05153b941d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:27.659359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1054/2104] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:27.660611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c334122-88bb-440e-8fac-e05153b941d4 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:27.670247 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b2b867a0-add9-4476-b4c0-f0fed8959fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d30649f0904dbe841c23d8e091531e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:27.670970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b2b867a0-add9-4476-b4c0-f0fed8959fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d30649f0904dbe841c23d8e091531e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:27.672241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c334122-88bb-440e-8fac-e05153b941d4 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:27.678975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391b7b6-7d4b-4469-ac34-b6fd675fd539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:27.679698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391b7b6-7d4b-4469-ac34-b6fd675fd539 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:27.680019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391b7b6-7d4b-4469-ac34-b6fd675fd539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:27.680346 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391b7b6-7d4b-4469-ac34-b6fd675fd539 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:27.681190 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391b7b6-7d4b-4469-ac34-b6fd675fd539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:43:27.681506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391b7b6-7d4b-4469-ac34-b6fd675fd539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:27.683543 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391b7b6-7d4b-4469-ac34-b6fd675fd539 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:27.685311 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b2b867a0-add9-4476-b4c0-f0fed8959fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d30649f0904dbe841c23d8e091531e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:27.700400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1055/2105] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:43:27.700593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b2b867a0-add9-4476-b4c0-f0fed8959fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d30649f0904dbe841c23d8e091531e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:27.700593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b2b867a0-add9-4476-b4c0-f0fed8959fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d30649f0904dbe841c23d8e091531e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:27.703755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391b7b6-7d4b-4469-ac34-b6fd675fd539 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:27.705704 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3391b7b6-7d4b-4469-ac34-b6fd675fd539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:27.722242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391b7b6-7d4b-4469-ac34-b6fd675fd539 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:27.728559 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7146eda-db3c-4291-b486-a7bcd5720b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:27.729299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7146eda-db3c-4291-b486-a7bcd5720b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:27.729652 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7146eda-db3c-4291-b486-a7bcd5720b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:27.730003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7146eda-db3c-4291-b486-a7bcd5720b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:27.730831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7146eda-db3c-4291-b486-a7bcd5720b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:27.732805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7146eda-db3c-4291-b486-a7bcd5720b7c admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:27.734012 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1051/2106] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:27 2022] DELETE /identity/v3/users/b1d30649f0904dbe841c23d8e091531e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:27.781276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b867a0-add9-4476-b4c0-f0fed8959fe3 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:27.781512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1056/2107] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:27 2022] POST /identity/v3/projects => generated 401 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:27.857565 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b867a0-add9-4476-b4c0-f0fed8959fe3 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:27.920578 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef15af6-2f66-48a0-ae3a-99c170376f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:27.921343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef15af6-2f66-48a0-ae3a-99c170376f16 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:27.921627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef15af6-2f66-48a0-ae3a-99c170376f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:27.921905 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef15af6-2f66-48a0-ae3a-99c170376f16 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:27.922650 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef15af6-2f66-48a0-ae3a-99c170376f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:27.924575 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef15af6-2f66-48a0-ae3a-99c170376f16 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:27.949858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1052/2108] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:27 2022] POST /identity/v3/users => generated 301 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:43:27.953862 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7146eda-db3c-4291-b486-a7bcd5720b7c admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:27.972135 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7146eda-db3c-4291-b486-a7bcd5720b7c admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:27.979009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e940aa6-2947-40ab-a1d2-783205c7aa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:27.979866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e940aa6-2947-40ab-a1d2-783205c7aa82 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:27.980232 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e940aa6-2947-40ab-a1d2-783205c7aa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:27.980598 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e940aa6-2947-40ab-a1d2-783205c7aa82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:27.981690 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e940aa6-2947-40ab-a1d2-783205c7aa82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:27.983763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e940aa6-2947-40ab-a1d2-783205c7aa82 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:27.993614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef15af6-2f66-48a0-ae3a-99c170376f16 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:27.995721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8ef15af6-2f66-48a0-ae3a-99c170376f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:27.999701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1057/2109] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:28.003131 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e940aa6-2947-40ab-a1d2-783205c7aa82 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:28.015159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef15af6-2f66-48a0-ae3a-99c170376f16 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:28.022117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15d904-3c08-446f-8baf-748f413ea19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:28.023195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15d904-3c08-446f-8baf-748f413ea19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.023649 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15d904-3c08-446f-8baf-748f413ea19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.023935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15d904-3c08-446f-8baf-748f413ea19c admin admin] PATH_INFO: `/v3/projects/fc23d2719647485fa73eb4cc29134b0d` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.025345 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15d904-3c08-446f-8baf-748f413ea19c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc23d2719647485fa73eb4cc29134b0d)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:28.027429 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15d904-3c08-446f-8baf-748f413ea19c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:28.031279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e940aa6-2947-40ab-a1d2-783205c7aa82 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:28.037793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86573067-251f-4da8-bdb9-bf131cae5563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:28.038486 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86573067-251f-4da8-bdb9-bf131cae5563 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.038759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86573067-251f-4da8-bdb9-bf131cae5563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.039114 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86573067-251f-4da8-bdb9-bf131cae5563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.039843 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86573067-251f-4da8-bdb9-bf131cae5563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:28.041572 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86573067-251f-4da8-bdb9-bf131cae5563 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:28.057784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1058/2110] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:43:28.061557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86573067-251f-4da8-bdb9-bf131cae5563 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:28.075687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86573067-251f-4da8-bdb9-bf131cae5563 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:28.080845 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cc5a4-a73b-42a0-ab25-3ef70e9e3931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:28.081981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cc5a4-a73b-42a0-ab25-3ef70e9e3931 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.082301 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cc5a4-a73b-42a0-ab25-3ef70e9e3931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.082689 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cc5a4-a73b-42a0-ab25-3ef70e9e3931 admin admin] PATH_INFO: `/v3/projects/be928a480c5843aca5be46d4e257c2ce/users/7c18d1c9cec44a118cec6ecc09c01cd8/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.104175 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cc5a4-a73b-42a0-ab25-3ef70e9e3931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be928a480c5843aca5be46d4e257c2ce, user_id=7c18d1c9cec44a118cec6ecc09c01cd8, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:28.107042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cc5a4-a73b-42a0-ab25-3ef70e9e3931 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:28.118153 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6a15d904-3c08-446f-8baf-748f413ea19c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc23d2719647485fa73eb4cc29134b0d', 'request_id': 'req-6a15d904-3c08-446f-8baf-748f413ea19c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:28.124925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6a15d904-3c08-446f-8baf-748f413ea19c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc23d2719647485fa73eb4cc29134b0d', 'request_id': 'req-6a15d904-3c08-446f-8baf-748f413ea19c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:28.137365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1059/2111] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:28 2022] PUT /identity/v3/projects/be928a480c5843aca5be46d4e257c2ce/users/7c18d1c9cec44a118cec6ecc09c01cd8/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:28.143054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907465fa-4636-4374-aeb2-6d53bd1f3a9f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.143352 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907465fa-4636-4374-aeb2-6d53bd1f3a9f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.143633 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907465fa-4636-4374-aeb2-6d53bd1f3a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.146216 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6a15d904-3c08-446f-8baf-748f413ea19c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc23d2719647485fa73eb4cc29134b0d', 'request_id': 'req-6a15d904-3c08-446f-8baf-748f413ea19c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:28.168073 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6a15d904-3c08-446f-8baf-748f413ea19c admin admin] The token cache is being invalidate because project fc23d2719647485fa73eb4cc29134b0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:28.168675 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6a15d904-3c08-446f-8baf-748f413ea19c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:28.169479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6a15d904-3c08-446f-8baf-748f413ea19c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:28.175745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-907465fa-4636-4374-aeb2-6d53bd1f3a9f None None] MFA Rules not processed for user `7c18d1c9cec44a118cec6ecc09c01cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:28.175932 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1053/2112] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:27 2022] DELETE /identity/v3/projects/fc23d2719647485fa73eb4cc29134b0d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:28.178009 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa26915-091a-4578-95bc-eafd004c0122 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.178325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa26915-091a-4578-95bc-eafd004c0122 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.178546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-907465fa-4636-4374-aeb2-6d53bd1f3a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:28.178781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa26915-091a-4578-95bc-eafd004c0122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.202579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-faa26915-091a-4578-95bc-eafd004c0122 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:28.204546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-faa26915-091a-4578-95bc-eafd004c0122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:28.260324 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1060/2113] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:28.262053 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907465fa-4636-4374-aeb2-6d53bd1f3a9f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:28.263565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-907465fa-4636-4374-aeb2-6d53bd1f3a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:28.274713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1054/2114] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:28.282538 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316681a-5ac1-432f-bcd6-30d8fb848fc2 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.283142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316681a-5ac1-432f-bcd6-30d8fb848fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.283613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316681a-5ac1-432f-bcd6-30d8fb848fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.307498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-1316681a-5ac1-432f-bcd6-30d8fb848fc2 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:28.308731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-1316681a-5ac1-432f-bcd6-30d8fb848fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:28.320870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1055/2115] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:43:28.325004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316681a-5ac1-432f-bcd6-30d8fb848fc2 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:28.335777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316681a-5ac1-432f-bcd6-30d8fb848fc2 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:28.342763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12bbbe-2908-44da-b369-b8eaf15d83dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:28.343422 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12bbbe-2908-44da-b369-b8eaf15d83dc admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.344850 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12bbbe-2908-44da-b369-b8eaf15d83dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.345138 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12bbbe-2908-44da-b369-b8eaf15d83dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.345715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907465fa-4636-4374-aeb2-6d53bd1f3a9f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:28.346440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12bbbe-2908-44da-b369-b8eaf15d83dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:43:28.346750 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12bbbe-2908-44da-b369-b8eaf15d83dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:28.348723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12bbbe-2908-44da-b369-b8eaf15d83dc admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:28.351780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1125661-5b49-4340-bf98-ea2dd0898b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:28.352757 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1125661-5b49-4340-bf98-ea2dd0898b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.353194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1125661-5b49-4340-bf98-ea2dd0898b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.353775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1125661-5b49-4340-bf98-ea2dd0898b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.355088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1125661-5b49-4340-bf98-ea2dd0898b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:28.357124 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1125661-5b49-4340-bf98-ea2dd0898b9b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:28.366854 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1056/2116] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:43:28.371022 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12bbbe-2908-44da-b369-b8eaf15d83dc admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:28.383624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12bbbe-2908-44da-b369-b8eaf15d83dc admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:28.389376 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373f278-3d33-4e9e-9396-2f4f088fa2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:28.390388 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373f278-3d33-4e9e-9396-2f4f088fa2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.390679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373f278-3d33-4e9e-9396-2f4f088fa2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.390953 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373f278-3d33-4e9e-9396-2f4f088fa2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.391656 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373f278-3d33-4e9e-9396-2f4f088fa2e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:28.394154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373f278-3d33-4e9e-9396-2f4f088fa2e7 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:28.418046 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1061/2117] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:28 2022] POST /identity/v3/projects => generated 401 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:28.419231 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1125661-5b49-4340-bf98-ea2dd0898b9b admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:28.431287 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1057/2118] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:28 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:28.435468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373f278-3d33-4e9e-9396-2f4f088fa2e7 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:28.492204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1125661-5b49-4340-bf98-ea2dd0898b9b admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:28.530747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373f278-3d33-4e9e-9396-2f4f088fa2e7 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:28.537252 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e0801-d51a-4ae3-bf9b-f38375cab052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:28.538362 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e0801-d51a-4ae3-bf9b-f38375cab052 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.538826 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e0801-d51a-4ae3-bf9b-f38375cab052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.539277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e0801-d51a-4ae3-bf9b-f38375cab052 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.540141 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e0801-d51a-4ae3-bf9b-f38375cab052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:28.542587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e0801-d51a-4ae3-bf9b-f38375cab052 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:28.557770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da24ff6-db9b-4243-81bc-09fb24632c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:28.558627 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da24ff6-db9b-4243-81bc-09fb24632c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.559110 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da24ff6-db9b-4243-81bc-09fb24632c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.559269 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da24ff6-db9b-4243-81bc-09fb24632c6e admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.560073 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da24ff6-db9b-4243-81bc-09fb24632c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:28.563696 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da24ff6-db9b-4243-81bc-09fb24632c6e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:28.569368 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1058/2119] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:28 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:43:28.574746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e0801-d51a-4ae3-bf9b-f38375cab052 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:28.591044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e0801-d51a-4ae3-bf9b-f38375cab052 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:28.598965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1062/2120] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:28 2022] POST /identity/v3/users => generated 307 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:28.600131 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da24ff6-db9b-4243-81bc-09fb24632c6e admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:28.605459 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b698474-38c9-4cea-8557-740797aa26ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:28.606213 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b698474-38c9-4cea-8557-740797aa26ef admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.606470 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b698474-38c9-4cea-8557-740797aa26ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.606753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b698474-38c9-4cea-8557-740797aa26ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.607522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b698474-38c9-4cea-8557-740797aa26ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:28.609131 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b698474-38c9-4cea-8557-740797aa26ef admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:28.611592 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da24ff6-db9b-4243-81bc-09fb24632c6e admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:28.617389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca55668-6c4b-4f9d-9ab6-969c0adb5563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:28.618516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca55668-6c4b-4f9d-9ab6-969c0adb5563 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.619018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca55668-6c4b-4f9d-9ab6-969c0adb5563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.619489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca55668-6c4b-4f9d-9ab6-969c0adb5563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.620406 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca55668-6c4b-4f9d-9ab6-969c0adb5563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:28.620936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1059/2121] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:43:28.622475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca55668-6c4b-4f9d-9ab6-969c0adb5563 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:28.627275 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b698474-38c9-4cea-8557-740797aa26ef admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:28.635388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1063/2122] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:28.640089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca55668-6c4b-4f9d-9ab6-969c0adb5563 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:28.641327 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b698474-38c9-4cea-8557-740797aa26ef admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:28.648092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80bdc5-ebcd-4585-bd58-caf9b0aa2a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:28.649194 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80bdc5-ebcd-4585-bd58-caf9b0aa2a8c admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.650423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80bdc5-ebcd-4585-bd58-caf9b0aa2a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.650838 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80bdc5-ebcd-4585-bd58-caf9b0aa2a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.652151 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80bdc5-ebcd-4585-bd58-caf9b0aa2a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:28.653962 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80bdc5-ebcd-4585-bd58-caf9b0aa2a8c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:28.655003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca55668-6c4b-4f9d-9ab6-969c0adb5563 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:28.663556 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5a466-0f01-4ed0-9867-ee9150e0db28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:28.664497 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5a466-0f01-4ed0-9867-ee9150e0db28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.666446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5a466-0f01-4ed0-9867-ee9150e0db28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.669513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5a466-0f01-4ed0-9867-ee9150e0db28 admin admin] PATH_INFO: `/v3/projects/e3227a96a8c94619a9ef6e1d6e9dab82/users/ac3581767dd046b9ae8fb5c836e0f92f/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.678343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1060/2123] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:28.683833 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80bdc5-ebcd-4585-bd58-caf9b0aa2a8c admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:28.692598 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5a466-0f01-4ed0-9867-ee9150e0db28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3227a96a8c94619a9ef6e1d6e9dab82, user_id=ac3581767dd046b9ae8fb5c836e0f92f, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:28.697136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5a466-0f01-4ed0-9867-ee9150e0db28 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:28.697686 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80bdc5-ebcd-4585-bd58-caf9b0aa2a8c admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:28.703536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04bcfd-0c4c-47f2-8767-8c2de7e914ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:28.705530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04bcfd-0c4c-47f2-8767-8c2de7e914ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.706244 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04bcfd-0c4c-47f2-8767-8c2de7e914ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.707097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04bcfd-0c4c-47f2-8767-8c2de7e914ae admin admin] PATH_INFO: `/v3/projects/36bd656881bb44fab197749e5d69cc9f/users/96e49dd610b14cb28ae4bb2a5d8e1966/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.722284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1064/2124] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:28 2022] PUT /identity/v3/projects/e3227a96a8c94619a9ef6e1d6e9dab82/users/ac3581767dd046b9ae8fb5c836e0f92f/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:28.726520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5a466-0f01-4ed0-9867-ee9150e0db28 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:28.735448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04bcfd-0c4c-47f2-8767-8c2de7e914ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=36bd656881bb44fab197749e5d69cc9f, user_id=96e49dd610b14cb28ae4bb2a5d8e1966, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:28.738694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04bcfd-0c4c-47f2-8767-8c2de7e914ae admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:28.759324 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1061/2125] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:28 2022] PUT /identity/v3/projects/36bd656881bb44fab197749e5d69cc9f/users/96e49dd610b14cb28ae4bb2a5d8e1966/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:28.771521 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9fcf5-fdf7-46e2-ab7c-e09ce29d04f5 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.772070 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9fcf5-fdf7-46e2-ab7c-e09ce29d04f5 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.772366 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9fcf5-fdf7-46e2-ab7c-e09ce29d04f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.804699 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-bae9fcf5-fdf7-46e2-ab7c-e09ce29d04f5 None None] MFA Rules not processed for user `96e49dd610b14cb28ae4bb2a5d8e1966`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:28.806069 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bae9fcf5-fdf7-46e2-ab7c-e09ce29d04f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:28.811459 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5a466-0f01-4ed0-9867-ee9150e0db28 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:28.900810 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1062/2126] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:28.917415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9fcf5-fdf7-46e2-ab7c-e09ce29d04f5 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:28.920061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bae9fcf5-fdf7-46e2-ab7c-e09ce29d04f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:28.937049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7404c-7914-4e2c-81f5-97f4642f52fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:28.938225 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7404c-7914-4e2c-81f5-97f4642f52fc admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:28.938550 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7404c-7914-4e2c-81f5-97f4642f52fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:28.938915 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7404c-7914-4e2c-81f5-97f4642f52fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:28.939821 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7404c-7914-4e2c-81f5-97f4642f52fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:28.941588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7404c-7914-4e2c-81f5-97f4642f52fc admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:28.961887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1065/2127] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:43:28.970595 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7404c-7914-4e2c-81f5-97f4642f52fc admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:28.988526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7404c-7914-4e2c-81f5-97f4642f52fc admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:29.010933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5dcec-d0d1-4794-922c-885849bab411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:29.011973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5dcec-d0d1-4794-922c-885849bab411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:29.012399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5dcec-d0d1-4794-922c-885849bab411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:29.012718 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5dcec-d0d1-4794-922c-885849bab411 admin admin] PATH_INFO: `/v3/projects/e3227a96a8c94619a9ef6e1d6e9dab82/users/ac3581767dd046b9ae8fb5c836e0f92f/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:29.017647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5dcec-d0d1-4794-922c-885849bab411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3227a96a8c94619a9ef6e1d6e9dab82, user_id=ac3581767dd046b9ae8fb5c836e0f92f, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:29.021818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5dcec-d0d1-4794-922c-885849bab411 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:29.056597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1066/2128] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:28 2022] PUT /identity/v3/projects/e3227a96a8c94619a9ef6e1d6e9dab82/users/ac3581767dd046b9ae8fb5c836e0f92f/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:29.071287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e88e2a-30a7-42bf-b177-6af966a53a2e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:29.071575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e88e2a-30a7-42bf-b177-6af966a53a2e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:29.072816 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e88e2a-30a7-42bf-b177-6af966a53a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:29.094662 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9fcf5-fdf7-46e2-ab7c-e09ce29d04f5 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:29.127507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-79e88e2a-30a7-42bf-b177-6af966a53a2e None None] MFA Rules not processed for user `ac3581767dd046b9ae8fb5c836e0f92f`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:29.128853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-79e88e2a-30a7-42bf-b177-6af966a53a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:29.214626 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9e1e4-6d66-4c75-9cd4-48676a6e3055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:29.215553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9e1e4-6d66-4c75-9cd4-48676a6e3055 service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:29.215940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9e1e4-6d66-4c75-9cd4-48676a6e3055 service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:29.216360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9e1e4-6d66-4c75-9cd4-48676a6e3055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:29.222004 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1067/2129] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:29 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:29.234924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e88e2a-30a7-42bf-b177-6af966a53a2e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:29.236868 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-79e88e2a-30a7-42bf-b177-6af966a53a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:29.324524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e88e2a-30a7-42bf-b177-6af966a53a2e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:29.336055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9e1e4-6d66-4c75-9cd4-48676a6e3055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:29.338500 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9e1e4-6d66-4c75-9cd4-48676a6e3055 service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:29.345331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd58e52-dc02-47dc-adf7-9552c64308b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:29.346000 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd58e52-dc02-47dc-adf7-9552c64308b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:29.346308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd58e52-dc02-47dc-adf7-9552c64308b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:29.346583 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd58e52-dc02-47dc-adf7-9552c64308b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:29.352864 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1063/2130] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:29.366802 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd58e52-dc02-47dc-adf7-9552c64308b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:29.368332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd58e52-dc02-47dc-adf7-9552c64308b3 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:29.394877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1068/2131] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:29 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:43:29.564276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9e1e4-6d66-4c75-9cd4-48676a6e3055 service nova] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:29.577563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9e1e4-6d66-4c75-9cd4-48676a6e3055 service nova] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:29.588469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f318b2-85b0-47d8-bc91-e3928ef08bad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:29.590029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f318b2-85b0-47d8-bc91-e3928ef08bad service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:29.590549 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f318b2-85b0-47d8-bc91-e3928ef08bad service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:29.591020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f318b2-85b0-47d8-bc91-e3928ef08bad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:29.749180 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f318b2-85b0-47d8-bc91-e3928ef08bad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:29.750942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f318b2-85b0-47d8-bc91-e3928ef08bad service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:29.778908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1064/2132] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:30.620489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e03ad-812e-488d-ad5e-231833f76c72 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:30.621029 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e03ad-812e-488d-ad5e-231833f76c72 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:30.621121 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e03ad-812e-488d-ad5e-231833f76c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:30.649134 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e16e03ad-812e-488d-ad5e-231833f76c72 None None] MFA Rules not processed for user `5953ab291e2844b297285ae3bb92be85`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:30.651177 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e16e03ad-812e-488d-ad5e-231833f76c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:30.752540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1069/2133] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:30.757893 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f318b2-85b0-47d8-bc91-e3928ef08bad service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:30.760333 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e2f318b2-85b0-47d8-bc91-e3928ef08bad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:30.834874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f318b2-85b0-47d8-bc91-e3928ef08bad service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:30.839349 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72692e9f-cb55-4d5b-b50f-8c893deb8c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:30.840004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72692e9f-cb55-4d5b-b50f-8c893deb8c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:30.840281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72692e9f-cb55-4d5b-b50f-8c893deb8c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:30.840551 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72692e9f-cb55-4d5b-b50f-8c893deb8c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:30.841264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72692e9f-cb55-4d5b-b50f-8c893deb8c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:30.843969 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72692e9f-cb55-4d5b-b50f-8c893deb8c51 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:30.871742 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1065/2134] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:30 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:43:30.876506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e03ad-812e-488d-ad5e-231833f76c72 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:30.887700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e03ad-812e-488d-ad5e-231833f76c72 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:30.943550 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8324c91-3210-43f3-b6c9-09e9d16a7f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:30.944225 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8324c91-3210-43f3-b6c9-09e9d16a7f9a admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:30.944507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8324c91-3210-43f3-b6c9-09e9d16a7f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:30.944782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8324c91-3210-43f3-b6c9-09e9d16a7f9a admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:30.945485 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8324c91-3210-43f3-b6c9-09e9d16a7f9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:30.947433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8324c91-3210-43f3-b6c9-09e9d16a7f9a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:30.966737 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1070/2135] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:30 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:43:30.970872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72692e9f-cb55-4d5b-b50f-8c893deb8c51 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:30.981877 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72692e9f-cb55-4d5b-b50f-8c893deb8c51 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:30.987573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553ac39-cf9d-409e-ac5a-944d95044387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:30.988301 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553ac39-cf9d-409e-ac5a-944d95044387 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:30.988532 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553ac39-cf9d-409e-ac5a-944d95044387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:30.989330 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553ac39-cf9d-409e-ac5a-944d95044387 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:30.990063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553ac39-cf9d-409e-ac5a-944d95044387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:30.991691 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553ac39-cf9d-409e-ac5a-944d95044387 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:31.007223 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1066/2136] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:31.007804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8324c91-3210-43f3-b6c9-09e9d16a7f9a admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:31.022673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8324c91-3210-43f3-b6c9-09e9d16a7f9a admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:31.030091 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64c32b-15f7-4cd3-9b97-6971b4020efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:31.031037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64c32b-15f7-4cd3-9b97-6971b4020efc admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:31.031323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64c32b-15f7-4cd3-9b97-6971b4020efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:31.031602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64c32b-15f7-4cd3-9b97-6971b4020efc admin admin] PATH_INFO: `/v3/projects/ebeee4150d6e4e46b82b1c0e8449d0f7/users/fd63ddcbb387417ab4fe5863e6777bde/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:31.081218 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64c32b-15f7-4cd3-9b97-6971b4020efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebeee4150d6e4e46b82b1c0e8449d0f7, user_id=fd63ddcbb387417ab4fe5863e6777bde, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:31.085718 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64c32b-15f7-4cd3-9b97-6971b4020efc admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:31.117112 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1071/2137] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:31 2022] PUT /identity/v3/projects/ebeee4150d6e4e46b82b1c0e8449d0f7/users/fd63ddcbb387417ab4fe5863e6777bde/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:31.126540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553ac39-cf9d-409e-ac5a-944d95044387 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:31.140548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553ac39-cf9d-409e-ac5a-944d95044387 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:31.222235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da59ea3-115a-483e-a8fd-0007a2f1241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:31.222925 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da59ea3-115a-483e-a8fd-0007a2f1241c admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:31.223269 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da59ea3-115a-483e-a8fd-0007a2f1241c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:31.223547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da59ea3-115a-483e-a8fd-0007a2f1241c admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:31.224281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da59ea3-115a-483e-a8fd-0007a2f1241c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:31.225892 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da59ea3-115a-483e-a8fd-0007a2f1241c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:31.253912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1067/2138] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:31.258741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64c32b-15f7-4cd3-9b97-6971b4020efc admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:31.282119 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64c32b-15f7-4cd3-9b97-6971b4020efc admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:31.295902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3cd6e-7d8c-4ee3-a244-e1b40b710533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:31.299250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3cd6e-7d8c-4ee3-a244-e1b40b710533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:31.299571 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3cd6e-7d8c-4ee3-a244-e1b40b710533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:31.300606 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3cd6e-7d8c-4ee3-a244-e1b40b710533 admin admin] PATH_INFO: `/v3/projects/ebeee4150d6e4e46b82b1c0e8449d0f7/users/fd63ddcbb387417ab4fe5863e6777bde/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:31.306507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3cd6e-7d8c-4ee3-a244-e1b40b710533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebeee4150d6e4e46b82b1c0e8449d0f7, user_id=fd63ddcbb387417ab4fe5863e6777bde, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:31.312687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3cd6e-7d8c-4ee3-a244-e1b40b710533 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:31.336821 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1072/2139] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:31 2022] PUT /identity/v3/projects/ebeee4150d6e4e46b82b1c0e8449d0f7/users/fd63ddcbb387417ab4fe5863e6777bde/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:35.819990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da59ea3-115a-483e-a8fd-0007a2f1241c admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:35.830626 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da59ea3-115a-483e-a8fd-0007a2f1241c admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:35.989042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645723ca-a126-4274-b668-3d4b49896b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:35.990266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645723ca-a126-4274-b668-3d4b49896b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:35.990717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645723ca-a126-4274-b668-3d4b49896b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:35.991117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645723ca-a126-4274-b668-3d4b49896b9c admin admin] PATH_INFO: `/v3/users/7c18d1c9cec44a118cec6ecc09c01cd8` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:35.995017 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645723ca-a126-4274-b668-3d4b49896b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c18d1c9cec44a118cec6ecc09c01cd8)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:35.997285 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645723ca-a126-4274-b668-3d4b49896b9c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:36.099143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-645723ca-a126-4274-b668-3d4b49896b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c18d1c9cec44a118cec6ecc09c01cd8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:36.100390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-645723ca-a126-4274-b668-3d4b49896b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c18d1c9cec44a118cec6ecc09c01cd8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:36.113242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-645723ca-a126-4274-b668-3d4b49896b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c18d1c9cec44a118cec6ecc09c01cd8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:36.127371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-645723ca-a126-4274-b668-3d4b49896b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c18d1c9cec44a118cec6ecc09c01cd8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:36.129400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-645723ca-a126-4274-b668-3d4b49896b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c18d1c9cec44a118cec6ecc09c01cd8'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:36.157524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1068/2140] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:35 2022] DELETE /identity/v3/users/7c18d1c9cec44a118cec6ecc09c01cd8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:36.163694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ebb51-55f5-4713-a94f-4225ddf7d9a2 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:36.164226 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ebb51-55f5-4713-a94f-4225ddf7d9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:36.164328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ebb51-55f5-4713-a94f-4225ddf7d9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:36.205029 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-369ebb51-55f5-4713-a94f-4225ddf7d9a2 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:36.217630 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-369ebb51-55f5-4713-a94f-4225ddf7d9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:36.419556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645723ca-a126-4274-b668-3d4b49896b9c admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:36.420336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1073/2141] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:36.424033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-645723ca-a126-4274-b668-3d4b49896b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:36.569696 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645723ca-a126-4274-b668-3d4b49896b9c admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:36.583653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef2c56-12c7-44be-83cd-598e7353a594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:36.585811 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef2c56-12c7-44be-83cd-598e7353a594 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:36.586280 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef2c56-12c7-44be-83cd-598e7353a594 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:36.588017 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef2c56-12c7-44be-83cd-598e7353a594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:36.604723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef2c56-12c7-44be-83cd-598e7353a594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:36.606671 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef2c56-12c7-44be-83cd-598e7353a594 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:36.621025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1069/2142] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:37.328403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ebb51-55f5-4713-a94f-4225ddf7d9a2 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:37.331048 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-369ebb51-55f5-4713-a94f-4225ddf7d9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:37.350757 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ebb51-55f5-4713-a94f-4225ddf7d9a2 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:37.360750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b54cd-37c7-4d65-b739-138e9da14e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:37.361882 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b54cd-37c7-4d65-b739-138e9da14e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:37.362228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b54cd-37c7-4d65-b739-138e9da14e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:37.362457 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b54cd-37c7-4d65-b739-138e9da14e71 admin admin] PATH_INFO: `/v3/projects/be928a480c5843aca5be46d4e257c2ce` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:37.365546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b54cd-37c7-4d65-b739-138e9da14e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be928a480c5843aca5be46d4e257c2ce)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:37.367566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b54cd-37c7-4d65-b739-138e9da14e71 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:37.479016 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d13b54cd-37c7-4d65-b739-138e9da14e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be928a480c5843aca5be46d4e257c2ce', 'request_id': 'req-d13b54cd-37c7-4d65-b739-138e9da14e71'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:37.487673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d13b54cd-37c7-4d65-b739-138e9da14e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be928a480c5843aca5be46d4e257c2ce', 'request_id': 'req-d13b54cd-37c7-4d65-b739-138e9da14e71'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:37.495438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d13b54cd-37c7-4d65-b739-138e9da14e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be928a480c5843aca5be46d4e257c2ce', 'request_id': 'req-d13b54cd-37c7-4d65-b739-138e9da14e71'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:37.518397 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d13b54cd-37c7-4d65-b739-138e9da14e71 admin admin] The token cache is being invalidate because project be928a480c5843aca5be46d4e257c2ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:37.518905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d13b54cd-37c7-4d65-b739-138e9da14e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:37.520792 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d13b54cd-37c7-4d65-b739-138e9da14e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:37.524202 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1074/2143] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:37 2022] DELETE /identity/v3/projects/be928a480c5843aca5be46d4e257c2ce => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:37.528424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef2c56-12c7-44be-83cd-598e7353a594 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:37.544322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef2c56-12c7-44be-83cd-598e7353a594 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:37.666546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1e54d-bb93-45d4-b71b-54c096ef05d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:37.667446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1e54d-bb93-45d4-b71b-54c096ef05d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:37.667733 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1e54d-bb93-45d4-b71b-54c096ef05d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:37.671260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1e54d-bb93-45d4-b71b-54c096ef05d1 admin admin] PATH_INFO: `/v3/users/ac3581767dd046b9ae8fb5c836e0f92f` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:37.673007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1e54d-bb93-45d4-b71b-54c096ef05d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3581767dd046b9ae8fb5c836e0f92f)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:37.677609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1e54d-bb93-45d4-b71b-54c096ef05d1 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:37.769939 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-51a1e54d-bb93-45d4-b71b-54c096ef05d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3581767dd046b9ae8fb5c836e0f92f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:37.770907 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-51a1e54d-bb93-45d4-b71b-54c096ef05d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3581767dd046b9ae8fb5c836e0f92f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:37.780215 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-51a1e54d-bb93-45d4-b71b-54c096ef05d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3581767dd046b9ae8fb5c836e0f92f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:37.791362 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-51a1e54d-bb93-45d4-b71b-54c096ef05d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3581767dd046b9ae8fb5c836e0f92f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:37.793535 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adf5bb-bdf5-43ce-961f-4a287b185824 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:37.793656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adf5bb-bdf5-43ce-961f-4a287b185824 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:37.793923 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adf5bb-bdf5-43ce-961f-4a287b185824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:37.795306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-51a1e54d-bb93-45d4-b71b-54c096ef05d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3581767dd046b9ae8fb5c836e0f92f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:37.822190 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1070/2144] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:37 2022] DELETE /identity/v3/users/ac3581767dd046b9ae8fb5c836e0f92f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:37.834149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-88adf5bb-bdf5-43ce-961f-4a287b185824 None None] MFA Rules not processed for user `fd63ddcbb387417ab4fe5863e6777bde`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:37.835412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-88adf5bb-bdf5-43ce-961f-4a287b185824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:37.905982 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1075/2145] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:37.918183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1e54d-bb93-45d4-b71b-54c096ef05d1 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:37.919521 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-51a1e54d-bb93-45d4-b71b-54c096ef05d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:38.027867 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1e54d-bb93-45d4-b71b-54c096ef05d1 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:38.033398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2100d41-b712-49cf-9d80-855569bac395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:38.034117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2100d41-b712-49cf-9d80-855569bac395 service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:38.034883 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2100d41-b712-49cf-9d80-855569bac395 service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:38.034883 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2100d41-b712-49cf-9d80-855569bac395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:38.038124 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b2100d41-b712-49cf-9d80-855569bac395 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:38.095653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2100d41-b712-49cf-9d80-855569bac395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:38.097233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2100d41-b712-49cf-9d80-855569bac395 service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:38.106738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1071/2146] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:38.169907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adf5bb-bdf5-43ce-961f-4a287b185824 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:38.171525 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-88adf5bb-bdf5-43ce-961f-4a287b185824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:38.271226 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adf5bb-bdf5-43ce-961f-4a287b185824 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:38.278915 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538af2e-1bd4-404b-854d-bcf3087721f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:38.280137 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538af2e-1bd4-404b-854d-bcf3087721f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:38.280481 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538af2e-1bd4-404b-854d-bcf3087721f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:38.280947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538af2e-1bd4-404b-854d-bcf3087721f6 admin admin] PATH_INFO: `/v3/projects/e3227a96a8c94619a9ef6e1d6e9dab82` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:38.282300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538af2e-1bd4-404b-854d-bcf3087721f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3227a96a8c94619a9ef6e1d6e9dab82)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:38.284273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538af2e-1bd4-404b-854d-bcf3087721f6 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:38.344547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c538af2e-1bd4-404b-854d-bcf3087721f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3227a96a8c94619a9ef6e1d6e9dab82', 'request_id': 'req-c538af2e-1bd4-404b-854d-bcf3087721f6'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:38.351752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c538af2e-1bd4-404b-854d-bcf3087721f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3227a96a8c94619a9ef6e1d6e9dab82', 'request_id': 'req-c538af2e-1bd4-404b-854d-bcf3087721f6'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:38.357940 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c538af2e-1bd4-404b-854d-bcf3087721f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3227a96a8c94619a9ef6e1d6e9dab82', 'request_id': 'req-c538af2e-1bd4-404b-854d-bcf3087721f6'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:38.376285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c538af2e-1bd4-404b-854d-bcf3087721f6 admin admin] The token cache is being invalidate because project e3227a96a8c94619a9ef6e1d6e9dab82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:38.376729 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c538af2e-1bd4-404b-854d-bcf3087721f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:38.378147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c538af2e-1bd4-404b-854d-bcf3087721f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:38.380796 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1076/2147] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:38 2022] DELETE /identity/v3/projects/e3227a96a8c94619a9ef6e1d6e9dab82 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:38.385772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22328d6-ad61-4526-92a6-c9060565aa2f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:38.386061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22328d6-ad61-4526-92a6-c9060565aa2f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:38.386786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22328d6-ad61-4526-92a6-c9060565aa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:38.407825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-d22328d6-ad61-4526-92a6-c9060565aa2f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:38.408975 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d22328d6-ad61-4526-92a6-c9060565aa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:38.486211 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1072/2148] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:38.490153 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7607755-00b9-498e-a872-60839b8354ef None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:38.490462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7607755-00b9-498e-a872-60839b8354ef None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:38.490734 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7607755-00b9-498e-a872-60839b8354ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:38.516043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e7607755-00b9-498e-a872-60839b8354ef None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:38.517593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e7607755-00b9-498e-a872-60839b8354ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:38.528428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1077/2149] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:38.532840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22328d6-ad61-4526-92a6-c9060565aa2f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:38.543482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22328d6-ad61-4526-92a6-c9060565aa2f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:38.548170 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04185d13-80c2-4a94-a023-c55d186fda93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:38.548832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04185d13-80c2-4a94-a023-c55d186fda93 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:38.549116 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04185d13-80c2-4a94-a023-c55d186fda93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:38.549390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04185d13-80c2-4a94-a023-c55d186fda93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:38.550344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04185d13-80c2-4a94-a023-c55d186fda93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:43:38.550654 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04185d13-80c2-4a94-a023-c55d186fda93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:38.553093 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04185d13-80c2-4a94-a023-c55d186fda93 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:38.573550 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1073/2150] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:43:38.578024 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7607755-00b9-498e-a872-60839b8354ef None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:38.598694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7607755-00b9-498e-a872-60839b8354ef None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:38.605277 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2feb6a8-4052-4bf7-9cc0-89e09268c6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:38.606266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feb6a8-4052-4bf7-9cc0-89e09268c6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:38.606727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feb6a8-4052-4bf7-9cc0-89e09268c6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:38.607168 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feb6a8-4052-4bf7-9cc0-89e09268c6f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:38.608763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2feb6a8-4052-4bf7-9cc0-89e09268c6f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:38.611474 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2feb6a8-4052-4bf7-9cc0-89e09268c6f9 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:38.675153 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1078/2151] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:38 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:43:38.679408 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04185d13-80c2-4a94-a023-c55d186fda93 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:38.690139 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04185d13-80c2-4a94-a023-c55d186fda93 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:38.768246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70f286-831c-4109-af17-2797230d7012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:38.770990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70f286-831c-4109-af17-2797230d7012 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:38.771464 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70f286-831c-4109-af17-2797230d7012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:38.771885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70f286-831c-4109-af17-2797230d7012 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:38.773158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70f286-831c-4109-af17-2797230d7012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:38.775515 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70f286-831c-4109-af17-2797230d7012 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:38.799469 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1074/2152] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:38 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:38.804197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2feb6a8-4052-4bf7-9cc0-89e09268c6f9 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:38.816398 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2feb6a8-4052-4bf7-9cc0-89e09268c6f9 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:38.823360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a0f63-b645-4c87-854c-49afca0c9dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:38.824164 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a0f63-b645-4c87-854c-49afca0c9dac admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:38.824979 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a0f63-b645-4c87-854c-49afca0c9dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:38.824979 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a0f63-b645-4c87-854c-49afca0c9dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:38.825770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a0f63-b645-4c87-854c-49afca0c9dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:38.827558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a0f63-b645-4c87-854c-49afca0c9dac admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:38.845376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1079/2153] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:38.847097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70f286-831c-4109-af17-2797230d7012 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:38.858908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70f286-831c-4109-af17-2797230d7012 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:38.865119 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b04952-f56f-4f8e-a73b-2d44dca0cff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:38.866035 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b04952-f56f-4f8e-a73b-2d44dca0cff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:38.866530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b04952-f56f-4f8e-a73b-2d44dca0cff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:38.866979 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b04952-f56f-4f8e-a73b-2d44dca0cff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:38.867709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b04952-f56f-4f8e-a73b-2d44dca0cff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:38.869433 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b04952-f56f-4f8e-a73b-2d44dca0cff6 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:38.881775 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1075/2154] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:38.886466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a0f63-b645-4c87-854c-49afca0c9dac admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:38.897852 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a0f63-b645-4c87-854c-49afca0c9dac admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:38.910316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589889b5-ee1b-4c4b-a2d2-0018d2bda2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:38.911778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589889b5-ee1b-4c4b-a2d2-0018d2bda2d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:38.912243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589889b5-ee1b-4c4b-a2d2-0018d2bda2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:38.912646 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589889b5-ee1b-4c4b-a2d2-0018d2bda2d4 admin admin] PATH_INFO: `/v3/projects/adc88884bd9043858507a35aac942c69/users/6bd3ce1235e44680a6d74c9d512e0536/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:38.934510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589889b5-ee1b-4c4b-a2d2-0018d2bda2d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc88884bd9043858507a35aac942c69, user_id=6bd3ce1235e44680a6d74c9d512e0536, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:38.937298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589889b5-ee1b-4c4b-a2d2-0018d2bda2d4 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:38.955648 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1080/2155] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:38 2022] PUT /identity/v3/projects/adc88884bd9043858507a35aac942c69/users/6bd3ce1235e44680a6d74c9d512e0536/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:38.966045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38800c9d-ef26-4644-ba4a-269dae5db518 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:38.966452 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38800c9d-ef26-4644-ba4a-269dae5db518 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:38.966915 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38800c9d-ef26-4644-ba4a-269dae5db518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:38.997594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-38800c9d-ef26-4644-ba4a-269dae5db518 None None] MFA Rules not processed for user `6bd3ce1235e44680a6d74c9d512e0536`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:39.000378 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-38800c9d-ef26-4644-ba4a-269dae5db518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:39.126682 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1076/2156] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:43:39.132165 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589889b5-ee1b-4c4b-a2d2-0018d2bda2d4 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:39.206120 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589889b5-ee1b-4c4b-a2d2-0018d2bda2d4 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:39.212704 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dddc8-57c5-4704-9230-80bc591acebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:39.213270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dddc8-57c5-4704-9230-80bc591acebb admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:39.213654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dddc8-57c5-4704-9230-80bc591acebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:39.215600 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dddc8-57c5-4704-9230-80bc591acebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:39.216450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dddc8-57c5-4704-9230-80bc591acebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:39.218687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dddc8-57c5-4704-9230-80bc591acebb admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:39.260868 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1081/2157] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:39 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:39.264434 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38800c9d-ef26-4644-ba4a-269dae5db518 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:39.278583 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38800c9d-ef26-4644-ba4a-269dae5db518 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:39.379501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d2022-b534-4f9c-96a4-9b4b90beda95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:39.381353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d2022-b534-4f9c-96a4-9b4b90beda95 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:39.381713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d2022-b534-4f9c-96a4-9b4b90beda95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:39.382595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d2022-b534-4f9c-96a4-9b4b90beda95 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:39.383430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d2022-b534-4f9c-96a4-9b4b90beda95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:39.385659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d2022-b534-4f9c-96a4-9b4b90beda95 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:39.424709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1077/2158] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:39 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:39.429174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dddc8-57c5-4704-9230-80bc591acebb admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:39.448001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dddc8-57c5-4704-9230-80bc591acebb admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:39.453480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40806853-d2fd-4477-9c18-37df60d4d333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:39.454277 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40806853-d2fd-4477-9c18-37df60d4d333 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:39.454561 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40806853-d2fd-4477-9c18-37df60d4d333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:39.454833 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40806853-d2fd-4477-9c18-37df60d4d333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:39.455608 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40806853-d2fd-4477-9c18-37df60d4d333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:39.457419 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40806853-d2fd-4477-9c18-37df60d4d333 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:39.487161 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1082/2159] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:39.487391 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d2022-b534-4f9c-96a4-9b4b90beda95 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:39.502784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d2022-b534-4f9c-96a4-9b4b90beda95 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:39.509557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560f323-99b7-4708-8a0a-b3c6169f5cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:39.513485 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560f323-99b7-4708-8a0a-b3c6169f5cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:39.513485 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560f323-99b7-4708-8a0a-b3c6169f5cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:39.513675 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560f323-99b7-4708-8a0a-b3c6169f5cbd admin admin] PATH_INFO: `/v3/projects/9bd7f819d14c43d1a521e9e75657b5d3/users/925172c275b64720a9f8517141930718/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:39.533593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560f323-99b7-4708-8a0a-b3c6169f5cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bd7f819d14c43d1a521e9e75657b5d3, user_id=925172c275b64720a9f8517141930718, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:39.536546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560f323-99b7-4708-8a0a-b3c6169f5cbd admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:39.571922 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40806853-d2fd-4477-9c18-37df60d4d333 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:39.573019 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1078/2160] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:39 2022] PUT /identity/v3/projects/9bd7f819d14c43d1a521e9e75657b5d3/users/925172c275b64720a9f8517141930718/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:39.583474 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40806853-d2fd-4477-9c18-37df60d4d333 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:39.651778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccb80b-5706-40fa-bbd9-bec0969ee4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:39.652592 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccb80b-5706-40fa-bbd9-bec0969ee4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:39.652970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccb80b-5706-40fa-bbd9-bec0969ee4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:39.653338 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccb80b-5706-40fa-bbd9-bec0969ee4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:39.654183 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccb80b-5706-40fa-bbd9-bec0969ee4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:39.655877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccb80b-5706-40fa-bbd9-bec0969ee4b6 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:39.674577 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1083/2161] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:39.678739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560f323-99b7-4708-8a0a-b3c6169f5cbd admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:39.708782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560f323-99b7-4708-8a0a-b3c6169f5cbd admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:39.721466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75856fdf-09a3-4da9-b0d7-ed0aff7792ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:39.723024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75856fdf-09a3-4da9-b0d7-ed0aff7792ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:39.723374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75856fdf-09a3-4da9-b0d7-ed0aff7792ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:39.723722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75856fdf-09a3-4da9-b0d7-ed0aff7792ac admin admin] PATH_INFO: `/v3/projects/9bd7f819d14c43d1a521e9e75657b5d3/users/925172c275b64720a9f8517141930718/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:39.727496 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75856fdf-09a3-4da9-b0d7-ed0aff7792ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bd7f819d14c43d1a521e9e75657b5d3, user_id=925172c275b64720a9f8517141930718, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:39.730039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75856fdf-09a3-4da9-b0d7-ed0aff7792ac admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:39.766839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1079/2162] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:39 2022] PUT /identity/v3/projects/9bd7f819d14c43d1a521e9e75657b5d3/users/925172c275b64720a9f8517141930718/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:39.779421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b8e86-f49e-4162-b17c-2f0fa8fc0adb None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:39.779521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b8e86-f49e-4162-b17c-2f0fa8fc0adb None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:39.779813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b8e86-f49e-4162-b17c-2f0fa8fc0adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:39.838873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-296b8e86-f49e-4162-b17c-2f0fa8fc0adb None None] MFA Rules not processed for user `925172c275b64720a9f8517141930718`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:39.839876 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-296b8e86-f49e-4162-b17c-2f0fa8fc0adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:39.986153 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75856fdf-09a3-4da9-b0d7-ed0aff7792ac admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:39.988117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-75856fdf-09a3-4da9-b0d7-ed0aff7792ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:40.018125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1084/2163] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:40.032082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b8e86-f49e-4162-b17c-2f0fa8fc0adb None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:40.035770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-296b8e86-f49e-4162-b17c-2f0fa8fc0adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:40.154466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75856fdf-09a3-4da9-b0d7-ed0aff7792ac admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:40.177926 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455958c1-ecaa-480c-b0d7-0855fca9271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:40.179186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455958c1-ecaa-480c-b0d7-0855fca9271c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:40.179602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455958c1-ecaa-480c-b0d7-0855fca9271c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:40.180081 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455958c1-ecaa-480c-b0d7-0855fca9271c admin admin] PATH_INFO: `/v3/users/96e49dd610b14cb28ae4bb2a5d8e1966` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:40.181800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455958c1-ecaa-480c-b0d7-0855fca9271c admin admin] RBAC: Authorizing `identity:delete_user(user_id=96e49dd610b14cb28ae4bb2a5d8e1966)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:40.184677 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455958c1-ecaa-480c-b0d7-0855fca9271c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:40.190478 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b8e86-f49e-4162-b17c-2f0fa8fc0adb None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:40.196586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cb08f-56b5-4d10-84e8-d85030b53e57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:40.197535 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cb08f-56b5-4d10-84e8-d85030b53e57 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:40.197942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cb08f-56b5-4d10-84e8-d85030b53e57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:40.198334 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cb08f-56b5-4d10-84e8-d85030b53e57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:40.211684 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cb08f-56b5-4d10-84e8-d85030b53e57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:40.213491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cb08f-56b5-4d10-84e8-d85030b53e57 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:40.239672 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1085/2164] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:43:40.241192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7396b0a-bbb6-452c-abdb-8fdaae41adf2 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:40.241481 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7396b0a-bbb6-452c-abdb-8fdaae41adf2 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:40.241756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7396b0a-bbb6-452c-abdb-8fdaae41adf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:40.271442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d7396b0a-bbb6-452c-abdb-8fdaae41adf2 None None] MFA Rules not processed for user `5953ab291e2844b297285ae3bb92be85`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:40.272956 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d7396b0a-bbb6-452c-abdb-8fdaae41adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:40.283779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-455958c1-ecaa-480c-b0d7-0855fca9271c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96e49dd610b14cb28ae4bb2a5d8e1966'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:40.284752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-455958c1-ecaa-480c-b0d7-0855fca9271c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96e49dd610b14cb28ae4bb2a5d8e1966'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:40.302493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-455958c1-ecaa-480c-b0d7-0855fca9271c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96e49dd610b14cb28ae4bb2a5d8e1966'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:40.324117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-455958c1-ecaa-480c-b0d7-0855fca9271c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96e49dd610b14cb28ae4bb2a5d8e1966'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:40.325103 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-455958c1-ecaa-480c-b0d7-0855fca9271c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96e49dd610b14cb28ae4bb2a5d8e1966'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:40.350265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1080/2165] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:39 2022] DELETE /identity/v3/users/96e49dd610b14cb28ae4bb2a5d8e1966 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:40.355026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfa703-4987-4cff-ba18-c8e216ffaddb None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:40.355673 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfa703-4987-4cff-ba18-c8e216ffaddb None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:40.356266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfa703-4987-4cff-ba18-c8e216ffaddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:40.381263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-7dcfa703-4987-4cff-ba18-c8e216ffaddb None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:40.382917 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7dcfa703-4987-4cff-ba18-c8e216ffaddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:40.399674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1086/2166] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:40.400820 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7396b0a-bbb6-452c-abdb-8fdaae41adf2 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:40.402827 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d7396b0a-bbb6-452c-abdb-8fdaae41adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:40.418086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7396b0a-bbb6-452c-abdb-8fdaae41adf2 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:40.491251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f109a5-bd76-4020-94b8-a277c7e55dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:40.492016 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f109a5-bd76-4020-94b8-a277c7e55dcb service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:40.492535 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f109a5-bd76-4020-94b8-a277c7e55dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:40.493021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f109a5-bd76-4020-94b8-a277c7e55dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:40.495270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-63f109a5-bd76-4020-94b8-a277c7e55dcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:40.545941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1081/2167] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:40.558436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfa703-4987-4cff-ba18-c8e216ffaddb None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:40.560331 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7dcfa703-4987-4cff-ba18-c8e216ffaddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:40.596262 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f109a5-bd76-4020-94b8-a277c7e55dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:40.598156 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f109a5-bd76-4020-94b8-a277c7e55dcb service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:40.614560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1087/2168] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:40.650578 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfa703-4987-4cff-ba18-c8e216ffaddb None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:40.655082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1303b9-970b-4eb2-bb74-3b8aaaecdc08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:40.656202 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1303b9-970b-4eb2-bb74-3b8aaaecdc08 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:40.656802 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1303b9-970b-4eb2-bb74-3b8aaaecdc08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:40.657270 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1303b9-970b-4eb2-bb74-3b8aaaecdc08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:40.669821 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1303b9-970b-4eb2-bb74-3b8aaaecdc08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:40.671661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1303b9-970b-4eb2-bb74-3b8aaaecdc08 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:40.700798 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1082/2169] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:43:41.152509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed0eba-ec98-427a-9f49-326ce606b033 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:41.153162 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed0eba-ec98-427a-9f49-326ce606b033 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:41.153623 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed0eba-ec98-427a-9f49-326ce606b033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:41.179893 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-77ed0eba-ec98-427a-9f49-326ce606b033 None None] MFA Rules not processed for user `d161fa00a7ee48a8a8bb77fe72ad87ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:41.189288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-77ed0eba-ec98-427a-9f49-326ce606b033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:41.228474 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1303b9-970b-4eb2-bb74-3b8aaaecdc08 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:41.230433 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6d1303b9-970b-4eb2-bb74-3b8aaaecdc08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:41.281496 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1303b9-970b-4eb2-bb74-3b8aaaecdc08 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:41.301159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb30078-9661-4327-aa6c-1b04cc536578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:41.304472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb30078-9661-4327-aa6c-1b04cc536578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:41.305158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb30078-9661-4327-aa6c-1b04cc536578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:41.305158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb30078-9661-4327-aa6c-1b04cc536578 admin admin] PATH_INFO: `/v3/users/6bd3ce1235e44680a6d74c9d512e0536` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:41.312583 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb30078-9661-4327-aa6c-1b04cc536578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bd3ce1235e44680a6d74c9d512e0536)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:41.321589 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb30078-9661-4327-aa6c-1b04cc536578 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:41.330896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1088/2170] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:41.439687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7eb30078-9661-4327-aa6c-1b04cc536578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bd3ce1235e44680a6d74c9d512e0536'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:41.446655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7eb30078-9661-4327-aa6c-1b04cc536578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bd3ce1235e44680a6d74c9d512e0536'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:41.456522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7eb30078-9661-4327-aa6c-1b04cc536578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bd3ce1235e44680a6d74c9d512e0536'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:41.471640 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7eb30078-9661-4327-aa6c-1b04cc536578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bd3ce1235e44680a6d74c9d512e0536'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:41.474681 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7eb30078-9661-4327-aa6c-1b04cc536578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bd3ce1235e44680a6d74c9d512e0536'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:41.508602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33da28e-2c8c-4847-ad49-1ee815bb1c78 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:41.509178 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1083/2171] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:41 2022] DELETE /identity/v3/users/6bd3ce1235e44680a6d74c9d512e0536 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:41.509703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33da28e-2c8c-4847-ad49-1ee815bb1c78 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:41.509976 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33da28e-2c8c-4847-ad49-1ee815bb1c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:41.551764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d33da28e-2c8c-4847-ad49-1ee815bb1c78 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:41.555961 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d33da28e-2c8c-4847-ad49-1ee815bb1c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:41.801926 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb30078-9661-4327-aa6c-1b04cc536578 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:41.803476 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7eb30078-9661-4327-aa6c-1b04cc536578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:41.901143 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1089/2172] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:41.948532 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb30078-9661-4327-aa6c-1b04cc536578 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:41.955418 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33da28e-2c8c-4847-ad49-1ee815bb1c78 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:41.955759 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16706943-d017-49d8-b4a3-4e20bfdde75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:41.956908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16706943-d017-49d8-b4a3-4e20bfdde75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:41.957397 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16706943-d017-49d8-b4a3-4e20bfdde75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:41.957858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16706943-d017-49d8-b4a3-4e20bfdde75e admin admin] PATH_INFO: `/v3/projects/36bd656881bb44fab197749e5d69cc9f` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:41.958061 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d33da28e-2c8c-4847-ad49-1ee815bb1c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:41.959716 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16706943-d017-49d8-b4a3-4e20bfdde75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=36bd656881bb44fab197749e5d69cc9f)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:41.966147 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16706943-d017-49d8-b4a3-4e20bfdde75e admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:42.058437 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33da28e-2c8c-4847-ad49-1ee815bb1c78 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:42.068932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4af2c-ae1a-4c09-9e1c-b6eaf09a551d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:42.071345 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4af2c-ae1a-4c09-9e1c-b6eaf09a551d service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:42.071680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4af2c-ae1a-4c09-9e1c-b6eaf09a551d service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:42.071887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4af2c-ae1a-4c09-9e1c-b6eaf09a551d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:42.088613 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4af2c-ae1a-4c09-9e1c-b6eaf09a551d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:42.090598 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4af2c-ae1a-4c09-9e1c-b6eaf09a551d service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:42.112789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1090/2173] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:42.115371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-16706943-d017-49d8-b4a3-4e20bfdde75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36bd656881bb44fab197749e5d69cc9f', 'request_id': 'req-16706943-d017-49d8-b4a3-4e20bfdde75e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:42.121184 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-16706943-d017-49d8-b4a3-4e20bfdde75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36bd656881bb44fab197749e5d69cc9f', 'request_id': 'req-16706943-d017-49d8-b4a3-4e20bfdde75e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:42.130277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-16706943-d017-49d8-b4a3-4e20bfdde75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36bd656881bb44fab197749e5d69cc9f', 'request_id': 'req-16706943-d017-49d8-b4a3-4e20bfdde75e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:42.149407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-16706943-d017-49d8-b4a3-4e20bfdde75e admin admin] The token cache is being invalidate because project 36bd656881bb44fab197749e5d69cc9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:42.149652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-16706943-d017-49d8-b4a3-4e20bfdde75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:42.150639 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-16706943-d017-49d8-b4a3-4e20bfdde75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:42.155902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1084/2174] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:41 2022] DELETE /identity/v3/projects/36bd656881bb44fab197749e5d69cc9f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:42.157947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2a78d-4c50-4058-b2e7-50bc2382c64d None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:42.158545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2a78d-4c50-4058-b2e7-50bc2382c64d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:42.158896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2a78d-4c50-4058-b2e7-50bc2382c64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:42.195913 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4cb2a78d-4c50-4058-b2e7-50bc2382c64d None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:42.198012 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4cb2a78d-4c50-4058-b2e7-50bc2382c64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:42.317585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1091/2175] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:42.325175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46108dce-7788-48f1-bcfa-708384542c2c None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:42.325539 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46108dce-7788-48f1-bcfa-708384542c2c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:42.325911 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46108dce-7788-48f1-bcfa-708384542c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:42.353648 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-46108dce-7788-48f1-bcfa-708384542c2c None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:42.356981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-46108dce-7788-48f1-bcfa-708384542c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:42.381148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1085/2176] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:42.387399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2a78d-4c50-4058-b2e7-50bc2382c64d None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:42.411767 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2a78d-4c50-4058-b2e7-50bc2382c64d None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:42.420318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407b1ea-2420-4010-be74-c27227bd6af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:42.421236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407b1ea-2420-4010-be74-c27227bd6af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:42.421710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407b1ea-2420-4010-be74-c27227bd6af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:42.422190 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407b1ea-2420-4010-be74-c27227bd6af8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:42.424601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407b1ea-2420-4010-be74-c27227bd6af8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:43:42.425154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407b1ea-2420-4010-be74-c27227bd6af8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:42.429876 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407b1ea-2420-4010-be74-c27227bd6af8 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:42.447219 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1092/2177] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:43:42.451424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46108dce-7788-48f1-bcfa-708384542c2c None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:42.462151 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46108dce-7788-48f1-bcfa-708384542c2c None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:42.467559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e734787-22b1-4eb4-9387-a4af78247496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:42.468462 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e734787-22b1-4eb4-9387-a4af78247496 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:42.468750 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e734787-22b1-4eb4-9387-a4af78247496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:42.469024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e734787-22b1-4eb4-9387-a4af78247496 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:42.469726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e734787-22b1-4eb4-9387-a4af78247496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:42.471699 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e734787-22b1-4eb4-9387-a4af78247496 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:42.528317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1086/2178] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:42 2022] POST /identity/v3/projects => generated 355 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:42.532865 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407b1ea-2420-4010-be74-c27227bd6af8 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:42.547623 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407b1ea-2420-4010-be74-c27227bd6af8 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:42.617056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ee9d4-303d-49d4-bcd0-bcd3ae70774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:42.619244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ee9d4-303d-49d4-bcd0-bcd3ae70774b admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:42.619661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ee9d4-303d-49d4-bcd0-bcd3ae70774b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:42.620058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ee9d4-303d-49d4-bcd0-bcd3ae70774b admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:42.620880 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ee9d4-303d-49d4-bcd0-bcd3ae70774b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:42.623409 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ee9d4-303d-49d4-bcd0-bcd3ae70774b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:42.662544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1093/2179] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:42 2022] POST /identity/v3/users => generated 278 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:42.663774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e734787-22b1-4eb4-9387-a4af78247496 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:42.680512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e734787-22b1-4eb4-9387-a4af78247496 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:42.687680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ee9d4-303d-49d4-bcd0-bcd3ae70774b admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:42.689553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b52ee9d4-303d-49d4-bcd0-bcd3ae70774b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:42.696666 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3d3cc-1365-4437-b394-5309a2e4491a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:42.697279 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3d3cc-1365-4437-b394-5309a2e4491a admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:42.697653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3d3cc-1365-4437-b394-5309a2e4491a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:42.698247 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3d3cc-1365-4437-b394-5309a2e4491a admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:42.699077 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3d3cc-1365-4437-b394-5309a2e4491a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:42.704904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3d3cc-1365-4437-b394-5309a2e4491a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:42.712748 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ee9d4-303d-49d4-bcd0-bcd3ae70774b admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:42.721839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318705e-1cab-49dd-959f-093513debccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:42.723028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318705e-1cab-49dd-959f-093513debccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:42.723377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318705e-1cab-49dd-959f-093513debccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:42.724191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1087/2180] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:42.726630 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318705e-1cab-49dd-959f-093513debccd admin admin] PATH_INFO: `/v3/projects/adc88884bd9043858507a35aac942c69` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:42.727915 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3d3cc-1365-4437-b394-5309a2e4491a admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:42.728749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318705e-1cab-49dd-959f-093513debccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc88884bd9043858507a35aac942c69)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:42.731052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318705e-1cab-49dd-959f-093513debccd admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:42.750045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3d3cc-1365-4437-b394-5309a2e4491a admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:42.763586 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04389225-42ba-4c2a-9399-ac8d0133ff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:42.764385 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04389225-42ba-4c2a-9399-ac8d0133ff19 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:42.764705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04389225-42ba-4c2a-9399-ac8d0133ff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:42.765004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04389225-42ba-4c2a-9399-ac8d0133ff19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:42.765759 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04389225-42ba-4c2a-9399-ac8d0133ff19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:42.768225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04389225-42ba-4c2a-9399-ac8d0133ff19 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:42.782230 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1088/2181] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:43:42.784870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04389225-42ba-4c2a-9399-ac8d0133ff19 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:42.807915 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04389225-42ba-4c2a-9399-ac8d0133ff19 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:42.817410 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2318705e-1cab-49dd-959f-093513debccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc88884bd9043858507a35aac942c69', 'request_id': 'req-2318705e-1cab-49dd-959f-093513debccd'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:42.825095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2318705e-1cab-49dd-959f-093513debccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc88884bd9043858507a35aac942c69', 'request_id': 'req-2318705e-1cab-49dd-959f-093513debccd'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:42.833931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2318705e-1cab-49dd-959f-093513debccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc88884bd9043858507a35aac942c69', 'request_id': 'req-2318705e-1cab-49dd-959f-093513debccd'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:42.869845 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2318705e-1cab-49dd-959f-093513debccd admin admin] The token cache is being invalidate because project adc88884bd9043858507a35aac942c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:42.870201 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2318705e-1cab-49dd-959f-093513debccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:42.870884 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2318705e-1cab-49dd-959f-093513debccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:42.876185 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1094/2182] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:42 2022] DELETE /identity/v3/projects/adc88884bd9043858507a35aac942c69 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:42.877168 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318705e-1cab-49dd-959f-093513debccd admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:42.878652 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-2318705e-1cab-49dd-959f-093513debccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:42.883703 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b96bc-da36-4dc0-a269-45e9613b44d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:42.884602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b96bc-da36-4dc0-a269-45e9613b44d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:42.884881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b96bc-da36-4dc0-a269-45e9613b44d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:42.885153 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b96bc-da36-4dc0-a269-45e9613b44d6 admin admin] PATH_INFO: `/v3/projects/432fbe36e2fa40e298180a9da6426fcc/users/ad9dae6d16f1412092e0b3db310e6fda/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:42.892849 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318705e-1cab-49dd-959f-093513debccd admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:42.902331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a8fc5-1ce5-4bd0-9c79-0a612b679dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:42.902331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a8fc5-1ce5-4bd0-9c79-0a612b679dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:42.902331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a8fc5-1ce5-4bd0-9c79-0a612b679dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:42.902331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a8fc5-1ce5-4bd0-9c79-0a612b679dec admin admin] PATH_INFO: `/v3/users/925172c275b64720a9f8517141930718` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:42.904933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a8fc5-1ce5-4bd0-9c79-0a612b679dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=925172c275b64720a9f8517141930718)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:42.905274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b96bc-da36-4dc0-a269-45e9613b44d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432fbe36e2fa40e298180a9da6426fcc, user_id=ad9dae6d16f1412092e0b3db310e6fda, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:42.907775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a8fc5-1ce5-4bd0-9c79-0a612b679dec admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:42.908707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b96bc-da36-4dc0-a269-45e9613b44d6 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:42.939130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1089/2183] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:42 2022] PUT /identity/v3/projects/432fbe36e2fa40e298180a9da6426fcc/users/ad9dae6d16f1412092e0b3db310e6fda/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:42.950406 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183de81f-d4cd-488a-a86d-cfba44a357cb None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:42.950783 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183de81f-d4cd-488a-a86d-cfba44a357cb None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:42.951289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183de81f-d4cd-488a-a86d-cfba44a357cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:42.985376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b76a8fc5-1ce5-4bd0-9c79-0a612b679dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '925172c275b64720a9f8517141930718'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:42.987424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-183de81f-d4cd-488a-a86d-cfba44a357cb None None] MFA Rules not processed for user `ad9dae6d16f1412092e0b3db310e6fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:42.989903 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-183de81f-d4cd-488a-a86d-cfba44a357cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:43.007887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b76a8fc5-1ce5-4bd0-9c79-0a612b679dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '925172c275b64720a9f8517141930718'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:43.008942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b76a8fc5-1ce5-4bd0-9c79-0a612b679dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '925172c275b64720a9f8517141930718'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:43.010804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b76a8fc5-1ce5-4bd0-9c79-0a612b679dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '925172c275b64720a9f8517141930718'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:43.040590 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b76a8fc5-1ce5-4bd0-9c79-0a612b679dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '925172c275b64720a9f8517141930718'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:43.065087 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1095/2184] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:42 2022] DELETE /identity/v3/users/925172c275b64720a9f8517141930718 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:43.107614 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a8fc5-1ce5-4bd0-9c79-0a612b679dec admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:43.109362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b76a8fc5-1ce5-4bd0-9c79-0a612b679dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:43.117260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1090/2185] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:42 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:43.233561 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a8fc5-1ce5-4bd0-9c79-0a612b679dec admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:43.244606 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52106ecd-e05e-4e1d-a8fb-01c2963eb538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:43.246789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52106ecd-e05e-4e1d-a8fb-01c2963eb538 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:43.249487 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52106ecd-e05e-4e1d-a8fb-01c2963eb538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:43.249894 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52106ecd-e05e-4e1d-a8fb-01c2963eb538 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:43.250933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52106ecd-e05e-4e1d-a8fb-01c2963eb538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:43.257565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52106ecd-e05e-4e1d-a8fb-01c2963eb538 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:43.302972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1096/2186] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:43 2022] POST /identity/v3/projects => generated 357 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:43.304323 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183de81f-d4cd-488a-a86d-cfba44a357cb None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:43.435576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183de81f-d4cd-488a-a86d-cfba44a357cb None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:43.523738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acca91-f5d0-4b44-871e-2228ce4bb2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:43.524480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acca91-f5d0-4b44-871e-2228ce4bb2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:43.524743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acca91-f5d0-4b44-871e-2228ce4bb2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:43.525017 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acca91-f5d0-4b44-871e-2228ce4bb2c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:43.525708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acca91-f5d0-4b44-871e-2228ce4bb2c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:43.527654 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acca91-f5d0-4b44-871e-2228ce4bb2c4 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:43.539342 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52106ecd-e05e-4e1d-a8fb-01c2963eb538 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:43.541358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-52106ecd-e05e-4e1d-a8fb-01c2963eb538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:43.553690 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1091/2187] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:43 2022] POST /identity/v3/users => generated 285 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:43.555346 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52106ecd-e05e-4e1d-a8fb-01c2963eb538 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:43.557576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acca91-f5d0-4b44-871e-2228ce4bb2c4 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:43.560321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f0142-9a46-4c61-9d40-a0e383fc1a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:43.561350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f0142-9a46-4c61-9d40-a0e383fc1a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:43.561791 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f0142-9a46-4c61-9d40-a0e383fc1a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:43.562243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f0142-9a46-4c61-9d40-a0e383fc1a97 admin admin] PATH_INFO: `/v3/projects/9bd7f819d14c43d1a521e9e75657b5d3` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:43.563803 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f0142-9a46-4c61-9d40-a0e383fc1a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bd7f819d14c43d1a521e9e75657b5d3)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:43.565955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f0142-9a46-4c61-9d40-a0e383fc1a97 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:43.568189 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acca91-f5d0-4b44-871e-2228ce4bb2c4 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:43.574823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf482408-9b0b-4a5a-afa1-ee4bbba4e928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:43.576240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf482408-9b0b-4a5a-afa1-ee4bbba4e928 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:43.576523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf482408-9b0b-4a5a-afa1-ee4bbba4e928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:43.576801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf482408-9b0b-4a5a-afa1-ee4bbba4e928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:43.577543 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf482408-9b0b-4a5a-afa1-ee4bbba4e928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:43.579800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf482408-9b0b-4a5a-afa1-ee4bbba4e928 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:43.593352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1092/2188] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:43.607211 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf482408-9b0b-4a5a-afa1-ee4bbba4e928 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:43.628423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf482408-9b0b-4a5a-afa1-ee4bbba4e928 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:43.646729 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-564f0142-9a46-4c61-9d40-a0e383fc1a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bd7f819d14c43d1a521e9e75657b5d3', 'request_id': 'req-564f0142-9a46-4c61-9d40-a0e383fc1a97'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:43.652199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-564f0142-9a46-4c61-9d40-a0e383fc1a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bd7f819d14c43d1a521e9e75657b5d3', 'request_id': 'req-564f0142-9a46-4c61-9d40-a0e383fc1a97'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:43.660376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-564f0142-9a46-4c61-9d40-a0e383fc1a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bd7f819d14c43d1a521e9e75657b5d3', 'request_id': 'req-564f0142-9a46-4c61-9d40-a0e383fc1a97'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:43.683669 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-564f0142-9a46-4c61-9d40-a0e383fc1a97 admin admin] The token cache is being invalidate because project 9bd7f819d14c43d1a521e9e75657b5d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:43.684209 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-564f0142-9a46-4c61-9d40-a0e383fc1a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:43.684892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-564f0142-9a46-4c61-9d40-a0e383fc1a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:43.686938 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1097/2189] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:43 2022] DELETE /identity/v3/projects/9bd7f819d14c43d1a521e9e75657b5d3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:43.691910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15ef4b-8c37-4d3d-9ce8-10a9d0624fb6 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:43.692193 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15ef4b-8c37-4d3d-9ce8-10a9d0624fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:43.692466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15ef4b-8c37-4d3d-9ce8-10a9d0624fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:43.693014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06703b1f-1d74-4d01-abfb-25672bbff722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:43.694072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06703b1f-1d74-4d01-abfb-25672bbff722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:43.695270 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06703b1f-1d74-4d01-abfb-25672bbff722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:43.695846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06703b1f-1d74-4d01-abfb-25672bbff722 admin admin] PATH_INFO: `/v3/projects/46c9f3b82c9b43138dff8378ec5ceb56/users/af47a1b4580546299d023f18f9b9b368/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:43.712590 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-5e15ef4b-8c37-4d3d-9ce8-10a9d0624fb6 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:43.713839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06703b1f-1d74-4d01-abfb-25672bbff722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c9f3b82c9b43138dff8378ec5ceb56, user_id=af47a1b4580546299d023f18f9b9b368, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:43.714031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5e15ef4b-8c37-4d3d-9ce8-10a9d0624fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:43.716928 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06703b1f-1d74-4d01-abfb-25672bbff722 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:43.726279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1098/2190] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:43.733973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19350d-1b60-4c38-900b-74cdce5477ed None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:43.734376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19350d-1b60-4c38-900b-74cdce5477ed None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:43.734752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19350d-1b60-4c38-900b-74cdce5477ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:43.735933 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1093/2191] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:43 2022] PUT /identity/v3/projects/46c9f3b82c9b43138dff8378ec5ceb56/users/af47a1b4580546299d023f18f9b9b368/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:43.739938 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06703b1f-1d74-4d01-abfb-25672bbff722 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:43.741615 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-06703b1f-1d74-4d01-abfb-25672bbff722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:43.754216 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-da19350d-1b60-4c38-900b-74cdce5477ed None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:43.756385 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-da19350d-1b60-4c38-900b-74cdce5477ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:43.823274 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06703b1f-1d74-4d01-abfb-25672bbff722 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:43.828269 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbfd72-f313-49e9-be13-fde2ffa5bd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:43.828963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbfd72-f313-49e9-be13-fde2ffa5bd34 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:43.829258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbfd72-f313-49e9-be13-fde2ffa5bd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:43.829532 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbfd72-f313-49e9-be13-fde2ffa5bd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:43.830317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbfd72-f313-49e9-be13-fde2ffa5bd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:43.832184 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbfd72-f313-49e9-be13-fde2ffa5bd34 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:43.833915 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1099/2192] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:43:43.839749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19350d-1b60-4c38-900b-74cdce5477ed None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:43.846934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1094/2193] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:43:43.848456 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbfd72-f313-49e9-be13-fde2ffa5bd34 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:43.856375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19350d-1b60-4c38-900b-74cdce5477ed None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:43.858421 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbfd72-f313-49e9-be13-fde2ffa5bd34 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:43.861065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc0344-3617-4025-9132-32328e1bd994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:43.861716 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0344-3617-4025-9132-32328e1bd994 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:43.861994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0344-3617-4025-9132-32328e1bd994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:43.862301 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0344-3617-4025-9132-32328e1bd994 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:43.863743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc0344-3617-4025-9132-32328e1bd994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:43:43.863887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17179616-667e-4907-b364-15622b9eeae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:43.864004 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc0344-3617-4025-9132-32328e1bd994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:43.864474 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17179616-667e-4907-b364-15622b9eeae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:43.864752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17179616-667e-4907-b364-15622b9eeae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:43.865164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17179616-667e-4907-b364-15622b9eeae5 admin admin] PATH_INFO: `/v3/projects/46c9f3b82c9b43138dff8378ec5ceb56/users/af47a1b4580546299d023f18f9b9b368/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:43.865522 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc0344-3617-4025-9132-32328e1bd994 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:43.867163 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17179616-667e-4907-b364-15622b9eeae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c9f3b82c9b43138dff8378ec5ceb56, user_id=af47a1b4580546299d023f18f9b9b368, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:43.869768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17179616-667e-4907-b364-15622b9eeae5 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:43.878752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1100/2194] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:43:43.879755 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1095/2195] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:43 2022] PUT /identity/v3/projects/46c9f3b82c9b43138dff8378ec5ceb56/users/af47a1b4580546299d023f18f9b9b368/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:43.882104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc0344-3617-4025-9132-32328e1bd994 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:43.890733 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bc5ef-1032-45d3-86ed-77c1eced7b41 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:43.891150 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bc5ef-1032-45d3-86ed-77c1eced7b41 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:43.891501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bc5ef-1032-45d3-86ed-77c1eced7b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:43.892658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc0344-3617-4025-9132-32328e1bd994 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:43.917967 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-309bc5ef-1032-45d3-86ed-77c1eced7b41 None None] MFA Rules not processed for user `af47a1b4580546299d023f18f9b9b368`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:43.919212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-309bc5ef-1032-45d3-86ed-77c1eced7b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:43.951403 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fda9a8-e172-4200-ab43-75ed66e2ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:43.952080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fda9a8-e172-4200-ab43-75ed66e2ff6e admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:43.952362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fda9a8-e172-4200-ab43-75ed66e2ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:43.952640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fda9a8-e172-4200-ab43-75ed66e2ff6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:43.953357 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fda9a8-e172-4200-ab43-75ed66e2ff6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:43.955462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fda9a8-e172-4200-ab43-75ed66e2ff6e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:43.990880 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1101/2196] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:43 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:43:43.991904 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fda9a8-e172-4200-ab43-75ed66e2ff6e admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:43.992616 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1096/2197] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:43 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:43:44.003777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bc5ef-1032-45d3-86ed-77c1eced7b41 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:44.005437 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-309bc5ef-1032-45d3-86ed-77c1eced7b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:44.060674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fda9a8-e172-4200-ab43-75ed66e2ff6e admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:44.067297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546388c6-a83b-4e7a-b976-c60af6929b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:44.067905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546388c6-a83b-4e7a-b976-c60af6929b41 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:44.068198 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546388c6-a83b-4e7a-b976-c60af6929b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:44.068472 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546388c6-a83b-4e7a-b976-c60af6929b41 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:44.069288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546388c6-a83b-4e7a-b976-c60af6929b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:44.071280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546388c6-a83b-4e7a-b976-c60af6929b41 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:44.071402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bc5ef-1032-45d3-86ed-77c1eced7b41 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:44.093654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1102/2198] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:43 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:44.098113 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546388c6-a83b-4e7a-b976-c60af6929b41 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:44.107876 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546388c6-a83b-4e7a-b976-c60af6929b41 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:44.112502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3a042-044c-433f-893a-2ff3090ae165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:44.113186 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3a042-044c-433f-893a-2ff3090ae165 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:44.113462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3a042-044c-433f-893a-2ff3090ae165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:44.113770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3a042-044c-433f-893a-2ff3090ae165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:44.115049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3a042-044c-433f-893a-2ff3090ae165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:44.116745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3a042-044c-433f-893a-2ff3090ae165 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:44.127307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1103/2199] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:43:44.131953 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3a042-044c-433f-893a-2ff3090ae165 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:44.132837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f21176-5183-44ad-9d7c-e665c6131c6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:44.133497 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f21176-5183-44ad-9d7c-e665c6131c6b service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:44.133774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f21176-5183-44ad-9d7c-e665c6131c6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:44.134306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f21176-5183-44ad-9d7c-e665c6131c6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:44.142218 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3a042-044c-433f-893a-2ff3090ae165 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:44.147374 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58693ca-22d2-4827-93fd-805462de5e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:44.148037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58693ca-22d2-4827-93fd-805462de5e5f admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:44.148313 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58693ca-22d2-4827-93fd-805462de5e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:44.148584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58693ca-22d2-4827-93fd-805462de5e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:44.149289 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58693ca-22d2-4827-93fd-805462de5e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:44.150906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58693ca-22d2-4827-93fd-805462de5e5f admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:44.162394 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1104/2200] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:43:44.166189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58693ca-22d2-4827-93fd-805462de5e5f admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:44.176839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58693ca-22d2-4827-93fd-805462de5e5f admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:44.182146 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482f535-25ad-4bda-9f41-6c96a96f9629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:44.183085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482f535-25ad-4bda-9f41-6c96a96f9629 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:44.183367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482f535-25ad-4bda-9f41-6c96a96f9629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:44.183641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482f535-25ad-4bda-9f41-6c96a96f9629 admin admin] PATH_INFO: `/v3/projects/2714f3100d66414990990a9592fc4683/users/4c5498196ab241e2b0e071bdd4d4574b/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:44.199170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482f535-25ad-4bda-9f41-6c96a96f9629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2714f3100d66414990990a9592fc4683, user_id=4c5498196ab241e2b0e071bdd4d4574b, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:44.201796 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482f535-25ad-4bda-9f41-6c96a96f9629 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:44.202133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f21176-5183-44ad-9d7c-e665c6131c6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:44.203591 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f21176-5183-44ad-9d7c-e665c6131c6b service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:44.213283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1097/2201] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:44 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:43:44.215701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1105/2202] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:44 2022] PUT /identity/v3/projects/2714f3100d66414990990a9592fc4683/users/4c5498196ab241e2b0e071bdd4d4574b/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:44.226320 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f25bf-1422-435b-86dc-b7048c713a82 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:44.226617 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f25bf-1422-435b-86dc-b7048c713a82 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:44.226909 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f25bf-1422-435b-86dc-b7048c713a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:44.256620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-349f25bf-1422-435b-86dc-b7048c713a82 None None] MFA Rules not processed for user `4c5498196ab241e2b0e071bdd4d4574b`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:44.258203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-349f25bf-1422-435b-86dc-b7048c713a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:44.291951 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482f535-25ad-4bda-9f41-6c96a96f9629 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:44.329220 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1098/2203] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:44.340272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f25bf-1422-435b-86dc-b7048c713a82 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:44.341649 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-349f25bf-1422-435b-86dc-b7048c713a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:44.346748 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482f535-25ad-4bda-9f41-6c96a96f9629 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:44.351451 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f9e44-5c6b-4d64-a150-035bcd0b7d90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:44.352197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f9e44-5c6b-4d64-a150-035bcd0b7d90 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:44.352537 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f9e44-5c6b-4d64-a150-035bcd0b7d90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:44.352875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f9e44-5c6b-4d64-a150-035bcd0b7d90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:44.355080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-046f9e44-5c6b-4d64-a150-035bcd0b7d90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:44.400101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f25bf-1422-435b-86dc-b7048c713a82 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:44.403627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f22ea-a144-46da-b7b2-5c98c28fe7f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab6c13dc02ba49d0be523fa9a73fdf5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:44.404268 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f22ea-a144-46da-b7b2-5c98c28fe7f5 service glance] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:44.404547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f22ea-a144-46da-b7b2-5c98c28fe7f5 service glance] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:44.404941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f22ea-a144-46da-b7b2-5c98c28fe7f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:44.415640 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f22ea-a144-46da-b7b2-5c98c28fe7f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:44.416928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f9e44-5c6b-4d64-a150-035bcd0b7d90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:44.417078 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f22ea-a144-46da-b7b2-5c98c28fe7f5 service glance] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:44.418395 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f9e44-5c6b-4d64-a150-035bcd0b7d90 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:44.428359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1099/2205] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:43:44.428526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1106/2205] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:44 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:43:55.357280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f9e44-5c6b-4d64-a150-035bcd0b7d90 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:55.358815 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-046f9e44-5c6b-4d64-a150-035bcd0b7d90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:55.428714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f9e44-5c6b-4d64-a150-035bcd0b7d90 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:55.435414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abebb2-98d7-4994-9f8c-1721f2f93d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:55.436296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abebb2-98d7-4994-9f8c-1721f2f93d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:55.436580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abebb2-98d7-4994-9f8c-1721f2f93d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:55.436993 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abebb2-98d7-4994-9f8c-1721f2f93d90 admin admin] PATH_INFO: `/v3/users/d32fc495a1d842268a93c9285f9ef298` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:55.438285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abebb2-98d7-4994-9f8c-1721f2f93d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32fc495a1d842268a93c9285f9ef298)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:55.440216 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abebb2-98d7-4994-9f8c-1721f2f93d90 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:55.487882 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-11abebb2-98d7-4994-9f8c-1721f2f93d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32fc495a1d842268a93c9285f9ef298'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:55.495579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-11abebb2-98d7-4994-9f8c-1721f2f93d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32fc495a1d842268a93c9285f9ef298'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:55.496518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-11abebb2-98d7-4994-9f8c-1721f2f93d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32fc495a1d842268a93c9285f9ef298'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:55.496917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-11abebb2-98d7-4994-9f8c-1721f2f93d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32fc495a1d842268a93c9285f9ef298'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:55.510753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-11abebb2-98d7-4994-9f8c-1721f2f93d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32fc495a1d842268a93c9285f9ef298'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:55.526774 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1107/2206] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:55 2022] DELETE /identity/v3/users/d32fc495a1d842268a93c9285f9ef298 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:55.531374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8ef0-ea6d-4849-8300-3ee0f9484f9b None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:55.531914 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8ef0-ea6d-4849-8300-3ee0f9484f9b None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:55.531914 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8ef0-ea6d-4849-8300-3ee0f9484f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:55.549778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-4b8d8ef0-ea6d-4849-8300-3ee0f9484f9b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:55.551005 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4b8d8ef0-ea6d-4849-8300-3ee0f9484f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:55.612424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1100/2207] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:55.622091 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abebb2-98d7-4994-9f8c-1721f2f93d90 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:55.623529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-11abebb2-98d7-4994-9f8c-1721f2f93d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:55.682596 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abebb2-98d7-4994-9f8c-1721f2f93d90 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:55.686455 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea94a70-b8dc-43a3-8ce3-4e79df58d105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:55.687113 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea94a70-b8dc-43a3-8ce3-4e79df58d105 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:55.687397 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea94a70-b8dc-43a3-8ce3-4e79df58d105 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:55.687673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea94a70-b8dc-43a3-8ce3-4e79df58d105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:55.697427 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea94a70-b8dc-43a3-8ce3-4e79df58d105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:55.698955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea94a70-b8dc-43a3-8ce3-4e79df58d105 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:55.708673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1108/2208] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:43:55.984635 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8ef0-ea6d-4849-8300-3ee0f9484f9b None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:55.986355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4b8d8ef0-ea6d-4849-8300-3ee0f9484f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:56.014931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8ef0-ea6d-4849-8300-3ee0f9484f9b None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:56.020719 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43549f52-002c-4067-bb8e-ee71e251dbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:56.023098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43549f52-002c-4067-bb8e-ee71e251dbf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:56.023516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43549f52-002c-4067-bb8e-ee71e251dbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:56.023908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43549f52-002c-4067-bb8e-ee71e251dbf5 admin admin] PATH_INFO: `/v3/projects/69717ed1fabf49769bbba77a8046ebcf` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:56.025356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43549f52-002c-4067-bb8e-ee71e251dbf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69717ed1fabf49769bbba77a8046ebcf)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:56.027548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43549f52-002c-4067-bb8e-ee71e251dbf5 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:56.078091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-43549f52-002c-4067-bb8e-ee71e251dbf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69717ed1fabf49769bbba77a8046ebcf', 'request_id': 'req-43549f52-002c-4067-bb8e-ee71e251dbf5'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:56.085123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-43549f52-002c-4067-bb8e-ee71e251dbf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69717ed1fabf49769bbba77a8046ebcf', 'request_id': 'req-43549f52-002c-4067-bb8e-ee71e251dbf5'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:56.092748 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-43549f52-002c-4067-bb8e-ee71e251dbf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69717ed1fabf49769bbba77a8046ebcf', 'request_id': 'req-43549f52-002c-4067-bb8e-ee71e251dbf5'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:56.106228 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-43549f52-002c-4067-bb8e-ee71e251dbf5 admin admin] The token cache is being invalidate because project 69717ed1fabf49769bbba77a8046ebcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:56.106522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-43549f52-002c-4067-bb8e-ee71e251dbf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:56.107146 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-43549f52-002c-4067-bb8e-ee71e251dbf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:56.108912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1101/2209] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:55 2022] DELETE /identity/v3/projects/69717ed1fabf49769bbba77a8046ebcf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:56.112717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea94a70-b8dc-43a3-8ce3-4e79df58d105 service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:56.123794 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea94a70-b8dc-43a3-8ce3-4e79df58d105 service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:56.213116 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaea322-fc08-4536-b261-11e919b91bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:56.214134 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaea322-fc08-4536-b261-11e919b91bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:56.214538 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaea322-fc08-4536-b261-11e919b91bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:56.214889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaea322-fc08-4536-b261-11e919b91bc0 admin admin] PATH_INFO: `/v3/users/3ed8a7dc592742c9aa2e0b9a6ccb852d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:56.218374 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaea322-fc08-4536-b261-11e919b91bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed8a7dc592742c9aa2e0b9a6ccb852d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:56.218773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaea322-fc08-4536-b261-11e919b91bc0 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:56.288912 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-6eaea322-fc08-4536-b261-11e919b91bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed8a7dc592742c9aa2e0b9a6ccb852d'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:56.295894 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-6eaea322-fc08-4536-b261-11e919b91bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed8a7dc592742c9aa2e0b9a6ccb852d'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:56.296572 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-6eaea322-fc08-4536-b261-11e919b91bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed8a7dc592742c9aa2e0b9a6ccb852d'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:56.297188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-6eaea322-fc08-4536-b261-11e919b91bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed8a7dc592742c9aa2e0b9a6ccb852d'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:56.316551 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-6eaea322-fc08-4536-b261-11e919b91bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed8a7dc592742c9aa2e0b9a6ccb852d'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:56.331249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1109/2210] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:56 2022] DELETE /identity/v3/users/3ed8a7dc592742c9aa2e0b9a6ccb852d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:56.691062 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43549f52-002c-4067-bb8e-ee71e251dbf5 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:56.692963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-43549f52-002c-4067-bb8e-ee71e251dbf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:56.706645 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43549f52-002c-4067-bb8e-ee71e251dbf5 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:56.770440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63246e73-8647-4e17-86ed-759dca73edeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:56.772044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246e73-8647-4e17-86ed-759dca73edeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:56.772319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246e73-8647-4e17-86ed-759dca73edeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:56.772590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246e73-8647-4e17-86ed-759dca73edeb admin admin] PATH_INFO: `/v3/projects/5f0274d39a2c414a8f9951c7b963c093` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:56.773781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63246e73-8647-4e17-86ed-759dca73edeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0274d39a2c414a8f9951c7b963c093)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:56.775977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63246e73-8647-4e17-86ed-759dca73edeb admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:56.825097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-63246e73-8647-4e17-86ed-759dca73edeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0274d39a2c414a8f9951c7b963c093', 'request_id': 'req-63246e73-8647-4e17-86ed-759dca73edeb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:56.834149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-63246e73-8647-4e17-86ed-759dca73edeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0274d39a2c414a8f9951c7b963c093', 'request_id': 'req-63246e73-8647-4e17-86ed-759dca73edeb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:56.840974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-63246e73-8647-4e17-86ed-759dca73edeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0274d39a2c414a8f9951c7b963c093', 'request_id': 'req-63246e73-8647-4e17-86ed-759dca73edeb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:56.855453 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-63246e73-8647-4e17-86ed-759dca73edeb admin admin] The token cache is being invalidate because project 5f0274d39a2c414a8f9951c7b963c093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:56.855744 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-63246e73-8647-4e17-86ed-759dca73edeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:56.856363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-63246e73-8647-4e17-86ed-759dca73edeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:56.858068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1102/2211] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:56 2022] DELETE /identity/v3/projects/5f0274d39a2c414a8f9951c7b963c093 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:56.864037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1f8d6-0be4-428e-b7bc-2c7db3a3fbad None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:56.865138 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1f8d6-0be4-428e-b7bc-2c7db3a3fbad None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:56.865364 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1f8d6-0be4-428e-b7bc-2c7db3a3fbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:56.884422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-69d1f8d6-0be4-428e-b7bc-2c7db3a3fbad None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:56.885641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-69d1f8d6-0be4-428e-b7bc-2c7db3a3fbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:56.946955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1110/2212] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:56.954956 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1375a-93d3-4037-8123-43964b6bf9f0 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:56.955248 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1375a-93d3-4037-8123-43964b6bf9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:56.955527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1375a-93d3-4037-8123-43964b6bf9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:56.975795 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-fde1375a-93d3-4037-8123-43964b6bf9f0 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:56.977091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-fde1375a-93d3-4037-8123-43964b6bf9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:56.985100 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1103/2213] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:56.990086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1f8d6-0be4-428e-b7bc-2c7db3a3fbad None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:57.000010 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1f8d6-0be4-428e-b7bc-2c7db3a3fbad None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:57.004625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e929f3-eefa-4368-8d4d-86df9bb08d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:57.005488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e929f3-eefa-4368-8d4d-86df9bb08d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:57.005843 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e929f3-eefa-4368-8d4d-86df9bb08d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:57.006129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e929f3-eefa-4368-8d4d-86df9bb08d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:57.006892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e929f3-eefa-4368-8d4d-86df9bb08d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:43:57.007201 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e929f3-eefa-4368-8d4d-86df9bb08d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:57.008784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e929f3-eefa-4368-8d4d-86df9bb08d1e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:57.020703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1111/2214] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:43:57.025185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1375a-93d3-4037-8123-43964b6bf9f0 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:57.035130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1375a-93d3-4037-8123-43964b6bf9f0 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:57.040710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76fdaa-ef22-4870-aeae-7931fd4c2922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:57.041394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76fdaa-ef22-4870-aeae-7931fd4c2922 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:57.041673 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76fdaa-ef22-4870-aeae-7931fd4c2922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:57.041943 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76fdaa-ef22-4870-aeae-7931fd4c2922 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:57.042659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76fdaa-ef22-4870-aeae-7931fd4c2922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:57.044550 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76fdaa-ef22-4870-aeae-7931fd4c2922 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:57.070604 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1104/2215] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:57 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:57.076428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e929f3-eefa-4368-8d4d-86df9bb08d1e admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:57.087638 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e929f3-eefa-4368-8d4d-86df9bb08d1e admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:57.141221 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654bee5-8afd-4679-848b-205a538ef2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:57.141896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654bee5-8afd-4679-848b-205a538ef2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:57.142363 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654bee5-8afd-4679-848b-205a538ef2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:57.142641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654bee5-8afd-4679-848b-205a538ef2f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:57.143346 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654bee5-8afd-4679-848b-205a538ef2f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:57.145296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654bee5-8afd-4679-848b-205a538ef2f7 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:57.167112 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1112/2216] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:57 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:57.171453 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76fdaa-ef22-4870-aeae-7931fd4c2922 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:57.182000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76fdaa-ef22-4870-aeae-7931fd4c2922 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:57.186816 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54176fcd-a0b7-4543-addb-1f8e26eeae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:57.187483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54176fcd-a0b7-4543-addb-1f8e26eeae92 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:57.187763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54176fcd-a0b7-4543-addb-1f8e26eeae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:57.188039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54176fcd-a0b7-4543-addb-1f8e26eeae92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:57.188752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54176fcd-a0b7-4543-addb-1f8e26eeae92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:57.190374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54176fcd-a0b7-4543-addb-1f8e26eeae92 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:57.200859 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1105/2217] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:57.204598 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654bee5-8afd-4679-848b-205a538ef2f7 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:57.215603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654bee5-8afd-4679-848b-205a538ef2f7 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:57.220537 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5f19a-2447-4e29-bfc6-4a3beb75d8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:57.221191 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5f19a-2447-4e29-bfc6-4a3beb75d8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:57.221475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5f19a-2447-4e29-bfc6-4a3beb75d8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:57.221751 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5f19a-2447-4e29-bfc6-4a3beb75d8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:57.222506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5f19a-2447-4e29-bfc6-4a3beb75d8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:57.224951 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5f19a-2447-4e29-bfc6-4a3beb75d8aa admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:57.235423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1113/2218] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:57.240005 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54176fcd-a0b7-4543-addb-1f8e26eeae92 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:57.254287 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54176fcd-a0b7-4543-addb-1f8e26eeae92 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:57.261707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17135279-6d44-4505-9a6e-8d3de9449408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:57.261707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17135279-6d44-4505-9a6e-8d3de9449408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:57.261707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17135279-6d44-4505-9a6e-8d3de9449408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:57.261707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17135279-6d44-4505-9a6e-8d3de9449408 admin admin] PATH_INFO: `/v3/projects/79b9daf79f9a4547a882fa9e32807457/users/f383905f371544b2a57c622dba52194f/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:57.277903 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17135279-6d44-4505-9a6e-8d3de9449408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79b9daf79f9a4547a882fa9e32807457, user_id=f383905f371544b2a57c622dba52194f, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:57.280699 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17135279-6d44-4505-9a6e-8d3de9449408 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:57.293940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1106/2219] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:57 2022] PUT /identity/v3/projects/79b9daf79f9a4547a882fa9e32807457/users/f383905f371544b2a57c622dba52194f/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:57.305208 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd5801-8fa0-49aa-920f-c6c04eeeb0aa None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:57.305654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd5801-8fa0-49aa-920f-c6c04eeeb0aa None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:57.306092 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd5801-8fa0-49aa-920f-c6c04eeeb0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:57.338472 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-5bfd5801-8fa0-49aa-920f-c6c04eeeb0aa None None] MFA Rules not processed for user `f383905f371544b2a57c622dba52194f`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:57.339921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5bfd5801-8fa0-49aa-920f-c6c04eeeb0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:57.407967 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1114/2220] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:57.413155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17135279-6d44-4505-9a6e-8d3de9449408 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:57.477201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17135279-6d44-4505-9a6e-8d3de9449408 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:57.482037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5a109-4640-48db-8dd2-ac844800cb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:57.482733 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5a109-4640-48db-8dd2-ac844800cb16 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:57.483018 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5a109-4640-48db-8dd2-ac844800cb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:57.483294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5a109-4640-48db-8dd2-ac844800cb16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:57.484117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5a109-4640-48db-8dd2-ac844800cb16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:57.486083 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5a109-4640-48db-8dd2-ac844800cb16 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:57.512777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1107/2221] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:43:57 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:57.517849 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd5801-8fa0-49aa-920f-c6c04eeeb0aa None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:57.542461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd5801-8fa0-49aa-920f-c6c04eeeb0aa None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:57.634869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e5ee2-4e73-4c96-92d4-77632191077e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:57.636692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e5ee2-4e73-4c96-92d4-77632191077e admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:57.636692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e5ee2-4e73-4c96-92d4-77632191077e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:57.636692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e5ee2-4e73-4c96-92d4-77632191077e admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:57.637175 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e5ee2-4e73-4c96-92d4-77632191077e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:57.639512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e5ee2-4e73-4c96-92d4-77632191077e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:57.666389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1115/2222] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:43:57 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:43:57.671290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5a109-4640-48db-8dd2-ac844800cb16 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:57.689294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5a109-4640-48db-8dd2-ac844800cb16 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:57.698061 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94cdd0-54e8-4160-99a8-d4d19ee7d3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:57.698985 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94cdd0-54e8-4160-99a8-d4d19ee7d3ac admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:57.699438 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94cdd0-54e8-4160-99a8-d4d19ee7d3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:57.699753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94cdd0-54e8-4160-99a8-d4d19ee7d3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:57.700613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94cdd0-54e8-4160-99a8-d4d19ee7d3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:57.702842 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94cdd0-54e8-4160-99a8-d4d19ee7d3ac admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:57.715463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1108/2223] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:43:57.721917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e5ee2-4e73-4c96-92d4-77632191077e admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:57.737305 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e5ee2-4e73-4c96-92d4-77632191077e admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:57.743740 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dcfc7-9bc0-4d5a-90b7-855cafc551cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:57.744960 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dcfc7-9bc0-4d5a-90b7-855cafc551cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:57.745303 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dcfc7-9bc0-4d5a-90b7-855cafc551cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:57.745666 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dcfc7-9bc0-4d5a-90b7-855cafc551cb admin admin] PATH_INFO: `/v3/projects/7e7e4e3cb2924f4caac380b1898493ea/users/2a8a3adb0a3247e5b8714feffe8c5f0c/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:57.768558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647dcfc7-9bc0-4d5a-90b7-855cafc551cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e7e4e3cb2924f4caac380b1898493ea, user_id=2a8a3adb0a3247e5b8714feffe8c5f0c, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:57.772921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647dcfc7-9bc0-4d5a-90b7-855cafc551cb admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:57.789747 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1116/2224] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:57 2022] PUT /identity/v3/projects/7e7e4e3cb2924f4caac380b1898493ea/users/2a8a3adb0a3247e5b8714feffe8c5f0c/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:57.793784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94cdd0-54e8-4160-99a8-d4d19ee7d3ac admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:57.804779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94cdd0-54e8-4160-99a8-d4d19ee7d3ac admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:57.859782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd1cff-f689-435d-be65-70024b82fc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:57.860445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd1cff-f689-435d-be65-70024b82fc04 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:57.860731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd1cff-f689-435d-be65-70024b82fc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:57.861007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd1cff-f689-435d-be65-70024b82fc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:57.861732 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd1cff-f689-435d-be65-70024b82fc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:57.863364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd1cff-f689-435d-be65-70024b82fc04 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:57.874310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1109/2225] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:43:57.878460 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dcfc7-9bc0-4d5a-90b7-855cafc551cb admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:57.889065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dcfc7-9bc0-4d5a-90b7-855cafc551cb admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:57.893715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a22311-c77c-45e7-8275-57f8b33ebcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:57.894638 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a22311-c77c-45e7-8275-57f8b33ebcdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:57.894952 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a22311-c77c-45e7-8275-57f8b33ebcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:57.895239 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a22311-c77c-45e7-8275-57f8b33ebcdd admin admin] PATH_INFO: `/v3/projects/7e7e4e3cb2924f4caac380b1898493ea/users/2a8a3adb0a3247e5b8714feffe8c5f0c/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:57.901616 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a22311-c77c-45e7-8275-57f8b33ebcdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e7e4e3cb2924f4caac380b1898493ea, user_id=2a8a3adb0a3247e5b8714feffe8c5f0c, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:57.904410 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a22311-c77c-45e7-8275-57f8b33ebcdd admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:57.915163 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1117/2226] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:43:57 2022] PUT /identity/v3/projects/7e7e4e3cb2924f4caac380b1898493ea/users/2a8a3adb0a3247e5b8714feffe8c5f0c/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:57.925495 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b1459-7bad-4ebf-a993-6ffc958deb26 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:57.925809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b1459-7bad-4ebf-a993-6ffc958deb26 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:57.926113 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b1459-7bad-4ebf-a993-6ffc958deb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:57.953507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-291b1459-7bad-4ebf-a993-6ffc958deb26 None None] MFA Rules not processed for user `2a8a3adb0a3247e5b8714feffe8c5f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:57.955223 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-291b1459-7bad-4ebf-a993-6ffc958deb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:58.033054 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1110/2227] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:43:58.045932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a22311-c77c-45e7-8275-57f8b33ebcdd admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:58.047871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a3a22311-c77c-45e7-8275-57f8b33ebcdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:58.107391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a22311-c77c-45e7-8275-57f8b33ebcdd admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:58.111502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb16c4a-ff62-43fd-b520-d691d6884027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:58.112241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb16c4a-ff62-43fd-b520-d691d6884027 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:58.112527 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb16c4a-ff62-43fd-b520-d691d6884027 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:58.112802 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb16c4a-ff62-43fd-b520-d691d6884027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:58.122603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb16c4a-ff62-43fd-b520-d691d6884027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:58.124034 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb16c4a-ff62-43fd-b520-d691d6884027 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:58.133657 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1118/2228] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:58.601075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b1459-7bad-4ebf-a993-6ffc958deb26 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:58.681063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b1459-7bad-4ebf-a993-6ffc958deb26 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:58.685558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bca35-0e31-4df0-85ce-88f7d5fa535c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:58.686458 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bca35-0e31-4df0-85ce-88f7d5fa535c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:58.686746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bca35-0e31-4df0-85ce-88f7d5fa535c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:58.687020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bca35-0e31-4df0-85ce-88f7d5fa535c admin admin] PATH_INFO: `/v3/users/f383905f371544b2a57c622dba52194f` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:58.688203 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bca35-0e31-4df0-85ce-88f7d5fa535c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f383905f371544b2a57c622dba52194f)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:58.690086 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bca35-0e31-4df0-85ce-88f7d5fa535c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:58.735111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-956bca35-0e31-4df0-85ce-88f7d5fa535c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f383905f371544b2a57c622dba52194f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:58.735757 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-956bca35-0e31-4df0-85ce-88f7d5fa535c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f383905f371544b2a57c622dba52194f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:58.744342 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-956bca35-0e31-4df0-85ce-88f7d5fa535c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f383905f371544b2a57c622dba52194f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:58.751242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-956bca35-0e31-4df0-85ce-88f7d5fa535c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f383905f371544b2a57c622dba52194f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:58.751911 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-956bca35-0e31-4df0-85ce-88f7d5fa535c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f383905f371544b2a57c622dba52194f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:58.769097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1111/2229] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:58 2022] DELETE /identity/v3/users/f383905f371544b2a57c622dba52194f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:58.774328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce978b49-0c44-4964-828c-18d05255f4d1 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:58.774621 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce978b49-0c44-4964-828c-18d05255f4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:58.774902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce978b49-0c44-4964-828c-18d05255f4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:58.794649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ce978b49-0c44-4964-828c-18d05255f4d1 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:43:58.796139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ce978b49-0c44-4964-828c-18d05255f4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:58.862855 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1119/2230] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:43:58.874801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bca35-0e31-4df0-85ce-88f7d5fa535c admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:58.877376 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-956bca35-0e31-4df0-85ce-88f7d5fa535c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:58.943611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bca35-0e31-4df0-85ce-88f7d5fa535c admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:58.947370 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca67ee-7a50-4b04-af84-3995f221f777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:58.948271 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca67ee-7a50-4b04-af84-3995f221f777 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:58.948444 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca67ee-7a50-4b04-af84-3995f221f777 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:58.948987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca67ee-7a50-4b04-af84-3995f221f777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:58.963557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca67ee-7a50-4b04-af84-3995f221f777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:58.966219 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca67ee-7a50-4b04-af84-3995f221f777 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:58.978757 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1112/2231] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:43:59.304753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce978b49-0c44-4964-828c-18d05255f4d1 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:59.306669 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ce978b49-0c44-4964-828c-18d05255f4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:59.322972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce978b49-0c44-4964-828c-18d05255f4d1 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:59.327955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:59.330246 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:59.330401 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:59.330711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b admin admin] PATH_INFO: `/v3/projects/79b9daf79f9a4547a882fa9e32807457` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:59.332728 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b admin admin] RBAC: Authorizing `identity:delete_project(project_id=79b9daf79f9a4547a882fa9e32807457)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:59.335176 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:59.412116 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79b9daf79f9a4547a882fa9e32807457', 'request_id': 'req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:59.417205 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79b9daf79f9a4547a882fa9e32807457', 'request_id': 'req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:59.423168 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79b9daf79f9a4547a882fa9e32807457', 'request_id': 'req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:59.435414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b admin admin] The token cache is being invalidate because project 79b9daf79f9a4547a882fa9e32807457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:43:59.435697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:59.436310 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:59.437826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1120/2232] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:59 2022] DELETE /identity/v3/projects/79b9daf79f9a4547a882fa9e32807457 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:43:59.441859 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca67ee-7a50-4b04-af84-3995f221f777 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:59.452739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca67ee-7a50-4b04-af84-3995f221f777 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:59.512692 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7377aa1-0ba6-49bf-ba4c-62c2a2e56c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:59.513573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7377aa1-0ba6-49bf-ba4c-62c2a2e56c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:59.513855 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7377aa1-0ba6-49bf-ba4c-62c2a2e56c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:59.514155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7377aa1-0ba6-49bf-ba4c-62c2a2e56c66 admin admin] PATH_INFO: `/v3/users/2a8a3adb0a3247e5b8714feffe8c5f0c` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:59.515384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7377aa1-0ba6-49bf-ba4c-62c2a2e56c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a8a3adb0a3247e5b8714feffe8c5f0c)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:59.517556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7377aa1-0ba6-49bf-ba4c-62c2a2e56c66 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:43:59.565043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-a7377aa1-0ba6-49bf-ba4c-62c2a2e56c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a8a3adb0a3247e5b8714feffe8c5f0c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:59.565734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-a7377aa1-0ba6-49bf-ba4c-62c2a2e56c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a8a3adb0a3247e5b8714feffe8c5f0c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:59.574926 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-a7377aa1-0ba6-49bf-ba4c-62c2a2e56c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a8a3adb0a3247e5b8714feffe8c5f0c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:59.584670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-a7377aa1-0ba6-49bf-ba4c-62c2a2e56c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a8a3adb0a3247e5b8714feffe8c5f0c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:59.585396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-a7377aa1-0ba6-49bf-ba4c-62c2a2e56c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a8a3adb0a3247e5b8714feffe8c5f0c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:43:59.604089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1113/2233] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:43:59 2022] DELETE /identity/v3/users/2a8a3adb0a3247e5b8714feffe8c5f0c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:43:59.887702 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:43:59.889136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:43:59.905641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab8e64-86e4-4e40-aab3-3fad5a52e56b admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:43:59.969309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eac8b1-802e-4970-bbe6-07047851016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:43:59.970548 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eac8b1-802e-4970-bbe6-07047851016b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:43:59.970914 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eac8b1-802e-4970-bbe6-07047851016b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:43:59.971149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eac8b1-802e-4970-bbe6-07047851016b admin admin] PATH_INFO: `/v3/projects/7e7e4e3cb2924f4caac380b1898493ea` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:43:59.972300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eac8b1-802e-4970-bbe6-07047851016b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e7e4e3cb2924f4caac380b1898493ea)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:43:59.974362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eac8b1-802e-4970-bbe6-07047851016b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:00.032901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f1eac8b1-802e-4970-bbe6-07047851016b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e7e4e3cb2924f4caac380b1898493ea', 'request_id': 'req-f1eac8b1-802e-4970-bbe6-07047851016b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:00.039256 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f1eac8b1-802e-4970-bbe6-07047851016b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e7e4e3cb2924f4caac380b1898493ea', 'request_id': 'req-f1eac8b1-802e-4970-bbe6-07047851016b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:00.046850 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f1eac8b1-802e-4970-bbe6-07047851016b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e7e4e3cb2924f4caac380b1898493ea', 'request_id': 'req-f1eac8b1-802e-4970-bbe6-07047851016b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:00.063582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f1eac8b1-802e-4970-bbe6-07047851016b admin admin] The token cache is being invalidate because project 7e7e4e3cb2924f4caac380b1898493ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:44:00.063931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f1eac8b1-802e-4970-bbe6-07047851016b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:00.064581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f1eac8b1-802e-4970-bbe6-07047851016b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:00.066539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1121/2234] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:43:59 2022] DELETE /identity/v3/projects/7e7e4e3cb2924f4caac380b1898493ea => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:00.072041 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e13a5c-ffe6-4b5c-8c95-0c9bdd5da607 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:00.072489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e13a5c-ffe6-4b5c-8c95-0c9bdd5da607 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:00.072648 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e13a5c-ffe6-4b5c-8c95-0c9bdd5da607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:00.091607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-61e13a5c-ffe6-4b5c-8c95-0c9bdd5da607 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:00.093233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-61e13a5c-ffe6-4b5c-8c95-0c9bdd5da607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:00.159421 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1114/2235] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:00.169021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd7f90-c43a-4e3f-829e-26257c244d85 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:00.169305 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd7f90-c43a-4e3f-829e-26257c244d85 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:00.169578 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd7f90-c43a-4e3f-829e-26257c244d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:00.197823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-dacd7f90-c43a-4e3f-829e-26257c244d85 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:00.199053 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-dacd7f90-c43a-4e3f-829e-26257c244d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:00.207231 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1122/2236] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:00.212881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e13a5c-ffe6-4b5c-8c95-0c9bdd5da607 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:00.222756 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e13a5c-ffe6-4b5c-8c95-0c9bdd5da607 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:00.228303 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c67c60-c201-47f6-bfd4-d13065368ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:00.228961 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c67c60-c201-47f6-bfd4-d13065368ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:00.229238 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c67c60-c201-47f6-bfd4-d13065368ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:00.229524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c67c60-c201-47f6-bfd4-d13065368ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:00.230250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c67c60-c201-47f6-bfd4-d13065368ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:44:00.230555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c67c60-c201-47f6-bfd4-d13065368ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:00.232133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c67c60-c201-47f6-bfd4-d13065368ab7 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:00.245003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1115/2237] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:44:00.249360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd7f90-c43a-4e3f-829e-26257c244d85 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:00.259190 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd7f90-c43a-4e3f-829e-26257c244d85 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:00.264427 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68ba46-1cad-4dc9-a14e-f9969e2e6c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:00.265257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68ba46-1cad-4dc9-a14e-f9969e2e6c77 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:00.265606 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68ba46-1cad-4dc9-a14e-f9969e2e6c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:00.266115 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68ba46-1cad-4dc9-a14e-f9969e2e6c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:00.267165 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68ba46-1cad-4dc9-a14e-f9969e2e6c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:00.269526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68ba46-1cad-4dc9-a14e-f9969e2e6c77 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:00.300094 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1123/2238] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:44:00 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:00.304129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c67c60-c201-47f6-bfd4-d13065368ab7 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:00.314855 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c67c60-c201-47f6-bfd4-d13065368ab7 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:00.378909 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d5a04-b868-4e05-9b3e-7a277cd135b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:00.379587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d5a04-b868-4e05-9b3e-7a277cd135b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:00.379899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d5a04-b868-4e05-9b3e-7a277cd135b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:00.380178 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d5a04-b868-4e05-9b3e-7a277cd135b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:00.380870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d5a04-b868-4e05-9b3e-7a277cd135b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:00.382817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d5a04-b868-4e05-9b3e-7a277cd135b4 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:00.408996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1116/2239] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:44:00 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:00.410572 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68ba46-1cad-4dc9-a14e-f9969e2e6c77 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:00.421908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68ba46-1cad-4dc9-a14e-f9969e2e6c77 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:00.428986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6fd54-29fb-4f80-ba81-453a8a4c2442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:00.429734 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6fd54-29fb-4f80-ba81-453a8a4c2442 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:00.430016 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6fd54-29fb-4f80-ba81-453a8a4c2442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:00.430320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6fd54-29fb-4f80-ba81-453a8a4c2442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:00.431041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6fd54-29fb-4f80-ba81-453a8a4c2442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:00.432701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6fd54-29fb-4f80-ba81-453a8a4c2442 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:00.444251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1124/2240] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:44:00.450930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d5a04-b868-4e05-9b3e-7a277cd135b4 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:00.461722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d5a04-b868-4e05-9b3e-7a277cd135b4 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:00.467046 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712e03d-905b-4172-b88b-2a2ca229c4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:00.467718 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712e03d-905b-4172-b88b-2a2ca229c4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:00.468028 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712e03d-905b-4172-b88b-2a2ca229c4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:00.468270 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712e03d-905b-4172-b88b-2a2ca229c4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:00.468997 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712e03d-905b-4172-b88b-2a2ca229c4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:00.470848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712e03d-905b-4172-b88b-2a2ca229c4f1 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:00.482458 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1117/2241] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:00.486549 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6fd54-29fb-4f80-ba81-453a8a4c2442 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:00.496475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6fd54-29fb-4f80-ba81-453a8a4c2442 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:00.501346 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b1964-923e-4614-abe0-de5e90f57e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:00.502266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b1964-923e-4614-abe0-de5e90f57e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:00.502575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b1964-923e-4614-abe0-de5e90f57e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:00.502851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b1964-923e-4614-abe0-de5e90f57e19 admin admin] PATH_INFO: `/v3/projects/70a38fd1cdcd44f1b9d2fb832027c40b/users/4b161aa0d704420baaedf64d635f85ca/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:00.519102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b1964-923e-4614-abe0-de5e90f57e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a38fd1cdcd44f1b9d2fb832027c40b, user_id=4b161aa0d704420baaedf64d635f85ca, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:00.522476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b1964-923e-4614-abe0-de5e90f57e19 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:00.535108 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1125/2242] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:00 2022] PUT /identity/v3/projects/70a38fd1cdcd44f1b9d2fb832027c40b/users/4b161aa0d704420baaedf64d635f85ca/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:44:00.541109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072452f0-3fd0-4276-b8ee-d8ee63074e63 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:00.541497 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072452f0-3fd0-4276-b8ee-d8ee63074e63 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:00.541851 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072452f0-3fd0-4276-b8ee-d8ee63074e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:00.563703 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-072452f0-3fd0-4276-b8ee-d8ee63074e63 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:00.565158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-072452f0-3fd0-4276-b8ee-d8ee63074e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:00.624461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1118/2243] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:44:00.634716 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b1964-923e-4614-abe0-de5e90f57e19 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:00.636476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-544b1964-923e-4614-abe0-de5e90f57e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:00.695201 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b1964-923e-4614-abe0-de5e90f57e19 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:00.698892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d6ee9-c17f-438f-9ddc-1da62808a754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:00.699544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d6ee9-c17f-438f-9ddc-1da62808a754 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:00.699823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d6ee9-c17f-438f-9ddc-1da62808a754 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:00.700095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d6ee9-c17f-438f-9ddc-1da62808a754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:00.711484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d6ee9-c17f-438f-9ddc-1da62808a754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:00.713026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d6ee9-c17f-438f-9ddc-1da62808a754 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:00.726536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1126/2244] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:03.314630 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072452f0-3fd0-4276-b8ee-d8ee63074e63 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:03.316878 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-072452f0-3fd0-4276-b8ee-d8ee63074e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:03.342675 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072452f0-3fd0-4276-b8ee-d8ee63074e63 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:03.350261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77125942-cc68-4575-98ed-0e1fc68c55a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:03.351402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77125942-cc68-4575-98ed-0e1fc68c55a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:03.351786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77125942-cc68-4575-98ed-0e1fc68c55a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:03.352275 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77125942-cc68-4575-98ed-0e1fc68c55a6 admin admin] PATH_INFO: `/v3/users/ad9dae6d16f1412092e0b3db310e6fda` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:03.354454 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77125942-cc68-4575-98ed-0e1fc68c55a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9dae6d16f1412092e0b3db310e6fda)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:03.356610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77125942-cc68-4575-98ed-0e1fc68c55a6 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:03.430242 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-77125942-cc68-4575-98ed-0e1fc68c55a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9dae6d16f1412092e0b3db310e6fda'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:03.430922 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-77125942-cc68-4575-98ed-0e1fc68c55a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9dae6d16f1412092e0b3db310e6fda'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:03.441767 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-77125942-cc68-4575-98ed-0e1fc68c55a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9dae6d16f1412092e0b3db310e6fda'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:03.453730 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-77125942-cc68-4575-98ed-0e1fc68c55a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9dae6d16f1412092e0b3db310e6fda'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:03.454961 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-77125942-cc68-4575-98ed-0e1fc68c55a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9dae6d16f1412092e0b3db310e6fda'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:03.479032 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1119/2245] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:44:03 2022] DELETE /identity/v3/users/ad9dae6d16f1412092e0b3db310e6fda => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:03.484703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263b09a-e9f3-4a17-89e4-338eb97c6fe0 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:03.485184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263b09a-e9f3-4a17-89e4-338eb97c6fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:03.485269 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263b09a-e9f3-4a17-89e4-338eb97c6fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:03.521574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-6263b09a-e9f3-4a17-89e4-338eb97c6fe0 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:03.523013 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6263b09a-e9f3-4a17-89e4-338eb97c6fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:03.601687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1127/2246] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:03.612976 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77125942-cc68-4575-98ed-0e1fc68c55a6 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:03.614537 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-77125942-cc68-4575-98ed-0e1fc68c55a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:03.687607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77125942-cc68-4575-98ed-0e1fc68c55a6 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:03.694455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b84ab9-2e43-4369-89c8-5b9af548fc1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:03.695895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b84ab9-2e43-4369-89c8-5b9af548fc1c service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:03.696334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b84ab9-2e43-4369-89c8-5b9af548fc1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:03.696846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b84ab9-2e43-4369-89c8-5b9af548fc1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:03.710998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b84ab9-2e43-4369-89c8-5b9af548fc1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:03.713511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b84ab9-2e43-4369-89c8-5b9af548fc1c service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:03.725767 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1120/2247] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:04.251180 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263b09a-e9f3-4a17-89e4-338eb97c6fe0 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:04.253948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6263b09a-e9f3-4a17-89e4-338eb97c6fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:04.278873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263b09a-e9f3-4a17-89e4-338eb97c6fe0 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:04.287327 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b581e-c72f-43c0-9184-5433a45a7577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:04.288923 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b581e-c72f-43c0-9184-5433a45a7577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:04.289629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b581e-c72f-43c0-9184-5433a45a7577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:04.290570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b581e-c72f-43c0-9184-5433a45a7577 admin admin] PATH_INFO: `/v3/projects/432fbe36e2fa40e298180a9da6426fcc` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:04.292281 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b581e-c72f-43c0-9184-5433a45a7577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432fbe36e2fa40e298180a9da6426fcc)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:04.294756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b581e-c72f-43c0-9184-5433a45a7577 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:04.369692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b46b581e-c72f-43c0-9184-5433a45a7577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432fbe36e2fa40e298180a9da6426fcc', 'request_id': 'req-b46b581e-c72f-43c0-9184-5433a45a7577'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:04.379800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b46b581e-c72f-43c0-9184-5433a45a7577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432fbe36e2fa40e298180a9da6426fcc', 'request_id': 'req-b46b581e-c72f-43c0-9184-5433a45a7577'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:04.393144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b46b581e-c72f-43c0-9184-5433a45a7577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432fbe36e2fa40e298180a9da6426fcc', 'request_id': 'req-b46b581e-c72f-43c0-9184-5433a45a7577'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:04.414079 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b46b581e-c72f-43c0-9184-5433a45a7577 admin admin] The token cache is being invalidate because project 432fbe36e2fa40e298180a9da6426fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:44:04.414803 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b46b581e-c72f-43c0-9184-5433a45a7577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:04.415550 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b46b581e-c72f-43c0-9184-5433a45a7577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:04.420600 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1128/2248] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:44:04 2022] DELETE /identity/v3/projects/432fbe36e2fa40e298180a9da6426fcc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:04.421847 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b84ab9-2e43-4369-89c8-5b9af548fc1c service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:04.433676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b84ab9-2e43-4369-89c8-5b9af548fc1c service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:04.531591 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd6981-33d3-46e4-9c24-253fa9e2cdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:04.537170 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd6981-33d3-46e4-9c24-253fa9e2cdf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:04.537686 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd6981-33d3-46e4-9c24-253fa9e2cdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:04.538217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd6981-33d3-46e4-9c24-253fa9e2cdf7 admin admin] PATH_INFO: `/v3/users/af47a1b4580546299d023f18f9b9b368` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:04.541850 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd6981-33d3-46e4-9c24-253fa9e2cdf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af47a1b4580546299d023f18f9b9b368)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:04.548457 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd6981-33d3-46e4-9c24-253fa9e2cdf7 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:04.642118 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d6fd6981-33d3-46e4-9c24-253fa9e2cdf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af47a1b4580546299d023f18f9b9b368'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:04.642841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d6fd6981-33d3-46e4-9c24-253fa9e2cdf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af47a1b4580546299d023f18f9b9b368'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:04.652263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d6fd6981-33d3-46e4-9c24-253fa9e2cdf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af47a1b4580546299d023f18f9b9b368'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:04.666308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d6fd6981-33d3-46e4-9c24-253fa9e2cdf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af47a1b4580546299d023f18f9b9b368'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:04.666995 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d6fd6981-33d3-46e4-9c24-253fa9e2cdf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af47a1b4580546299d023f18f9b9b368'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:04.689735 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1121/2249] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:44:04 2022] DELETE /identity/v3/users/af47a1b4580546299d023f18f9b9b368 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:04.993250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b581e-c72f-43c0-9184-5433a45a7577 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:04.995380 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b46b581e-c72f-43c0-9184-5433a45a7577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:05.011392 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b581e-c72f-43c0-9184-5433a45a7577 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:05.111286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fb8af-2ba9-475e-b0c1-c29c461881b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:05.112611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fb8af-2ba9-475e-b0c1-c29c461881b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:05.113102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fb8af-2ba9-475e-b0c1-c29c461881b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:05.113474 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fb8af-2ba9-475e-b0c1-c29c461881b8 admin admin] PATH_INFO: `/v3/projects/46c9f3b82c9b43138dff8378ec5ceb56` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:05.118016 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fb8af-2ba9-475e-b0c1-c29c461881b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c9f3b82c9b43138dff8378ec5ceb56)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:05.120584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fb8af-2ba9-475e-b0c1-c29c461881b8 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:05.233253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f26fb8af-2ba9-475e-b0c1-c29c461881b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c9f3b82c9b43138dff8378ec5ceb56', 'request_id': 'req-f26fb8af-2ba9-475e-b0c1-c29c461881b8'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:05.242381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f26fb8af-2ba9-475e-b0c1-c29c461881b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c9f3b82c9b43138dff8378ec5ceb56', 'request_id': 'req-f26fb8af-2ba9-475e-b0c1-c29c461881b8'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:05.249640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f26fb8af-2ba9-475e-b0c1-c29c461881b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c9f3b82c9b43138dff8378ec5ceb56', 'request_id': 'req-f26fb8af-2ba9-475e-b0c1-c29c461881b8'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:05.280666 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f26fb8af-2ba9-475e-b0c1-c29c461881b8 admin admin] The token cache is being invalidate because project 46c9f3b82c9b43138dff8378ec5ceb56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:44:05.281199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f26fb8af-2ba9-475e-b0c1-c29c461881b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:05.282150 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f26fb8af-2ba9-475e-b0c1-c29c461881b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:05.287870 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1129/2250] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:44:04 2022] DELETE /identity/v3/projects/46c9f3b82c9b43138dff8378ec5ceb56 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:05.294626 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2fac4-8685-4f56-826f-e80583076e37 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:05.295101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2fac4-8685-4f56-826f-e80583076e37 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:05.295486 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2fac4-8685-4f56-826f-e80583076e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:05.338603 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-77d2fac4-8685-4f56-826f-e80583076e37 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:05.344759 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-77d2fac4-8685-4f56-826f-e80583076e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:05.430059 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1122/2251] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:44:05.438035 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4036b9-5d19-4ab0-8afe-75c1094af74b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:05.438369 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4036b9-5d19-4ab0-8afe-75c1094af74b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:05.438653 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4036b9-5d19-4ab0-8afe-75c1094af74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:05.461210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ac4036b9-5d19-4ab0-8afe-75c1094af74b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:05.462929 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ac4036b9-5d19-4ab0-8afe-75c1094af74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:05.473163 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1130/2252] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:05.479980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2fac4-8685-4f56-826f-e80583076e37 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:05.492625 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2fac4-8685-4f56-826f-e80583076e37 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:05.498784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77485fa-2bfb-4d91-af12-d2f952e15ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:05.499878 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77485fa-2bfb-4d91-af12-d2f952e15ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:05.500167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77485fa-2bfb-4d91-af12-d2f952e15ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:05.500444 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77485fa-2bfb-4d91-af12-d2f952e15ab3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:05.501184 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77485fa-2bfb-4d91-af12-d2f952e15ab3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:44:05.501666 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77485fa-2bfb-4d91-af12-d2f952e15ab3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:05.503380 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77485fa-2bfb-4d91-af12-d2f952e15ab3 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:05.524100 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4036b9-5d19-4ab0-8afe-75c1094af74b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:05.529870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1123/2253] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:44:05.535596 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4036b9-5d19-4ab0-8afe-75c1094af74b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:05.545318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cf113-4e11-4304-8e48-7eb33037fe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:05.559756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cf113-4e11-4304-8e48-7eb33037fe08 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:05.559756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cf113-4e11-4304-8e48-7eb33037fe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:05.559756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cf113-4e11-4304-8e48-7eb33037fe08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:05.560564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cf113-4e11-4304-8e48-7eb33037fe08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:05.569348 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cf113-4e11-4304-8e48-7eb33037fe08 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:05.637210 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1131/2254] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:44:05 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:05.641688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77485fa-2bfb-4d91-af12-d2f952e15ab3 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:05.653546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77485fa-2bfb-4d91-af12-d2f952e15ab3 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:05.733674 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761bc7d-497c-4671-9dc9-16c9b8ddeb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:05.734522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761bc7d-497c-4671-9dc9-16c9b8ddeb90 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:05.734867 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761bc7d-497c-4671-9dc9-16c9b8ddeb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:05.735295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761bc7d-497c-4671-9dc9-16c9b8ddeb90 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:05.736053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761bc7d-497c-4671-9dc9-16c9b8ddeb90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:05.738108 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761bc7d-497c-4671-9dc9-16c9b8ddeb90 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:05.766495 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1124/2255] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:44:05 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:44:05.781082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cf113-4e11-4304-8e48-7eb33037fe08 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:05.800477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cf113-4e11-4304-8e48-7eb33037fe08 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:05.812440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae61e2-2950-44b8-9bcf-720a6cd71176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:05.812859 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae61e2-2950-44b8-9bcf-720a6cd71176 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:05.813253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae61e2-2950-44b8-9bcf-720a6cd71176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:05.813634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae61e2-2950-44b8-9bcf-720a6cd71176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:05.814509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae61e2-2950-44b8-9bcf-720a6cd71176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:05.816418 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae61e2-2950-44b8-9bcf-720a6cd71176 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:05.857750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1132/2256] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:05.861628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761bc7d-497c-4671-9dc9-16c9b8ddeb90 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:05.879595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761bc7d-497c-4671-9dc9-16c9b8ddeb90 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:05.891535 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c597a-305e-4f5e-837f-4433c8286210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:05.892305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c597a-305e-4f5e-837f-4433c8286210 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:05.892518 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c597a-305e-4f5e-837f-4433c8286210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:05.892794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c597a-305e-4f5e-837f-4433c8286210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:05.893575 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c597a-305e-4f5e-837f-4433c8286210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:05.895476 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c597a-305e-4f5e-837f-4433c8286210 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:05.933585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae61e2-2950-44b8-9bcf-720a6cd71176 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:05.934007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1125/2257] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:05.958787 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae61e2-2950-44b8-9bcf-720a6cd71176 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:05.969267 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153652d-9494-4d8e-86cd-e83fb1663b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:05.971388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153652d-9494-4d8e-86cd-e83fb1663b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:05.972160 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153652d-9494-4d8e-86cd-e83fb1663b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:05.972932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153652d-9494-4d8e-86cd-e83fb1663b76 admin admin] PATH_INFO: `/v3/projects/5ebf1325b4e94b18ad0f7a794bd0fe60/users/145cb2d151ed47e9b49894297a1800ba/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:06.001416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153652d-9494-4d8e-86cd-e83fb1663b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ebf1325b4e94b18ad0f7a794bd0fe60, user_id=145cb2d151ed47e9b49894297a1800ba, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:06.004274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153652d-9494-4d8e-86cd-e83fb1663b76 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:06.034972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1133/2258] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:05 2022] PUT /identity/v3/projects/5ebf1325b4e94b18ad0f7a794bd0fe60/users/145cb2d151ed47e9b49894297a1800ba/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:44:06.040497 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f42641-8a9e-4630-b017-c6d52884278c None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:06.040785 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f42641-8a9e-4630-b017-c6d52884278c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:06.041060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f42641-8a9e-4630-b017-c6d52884278c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:06.088850 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-96f42641-8a9e-4630-b017-c6d52884278c None None] MFA Rules not processed for user `145cb2d151ed47e9b49894297a1800ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:06.089439 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-96f42641-8a9e-4630-b017-c6d52884278c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:06.215292 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1126/2259] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:06.221148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153652d-9494-4d8e-86cd-e83fb1663b76 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:06.322216 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153652d-9494-4d8e-86cd-e83fb1663b76 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:06.328143 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af503b37-e941-462f-914c-e2188453bfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:06.328942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af503b37-e941-462f-914c-e2188453bfb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:06.329617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af503b37-e941-462f-914c-e2188453bfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:06.329617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af503b37-e941-462f-914c-e2188453bfb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:06.330647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af503b37-e941-462f-914c-e2188453bfb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:06.333250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af503b37-e941-462f-914c-e2188453bfb1 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:06.378536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1134/2260] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:44:06 2022] POST /identity/v3/projects => generated 363 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:44:06.380554 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f42641-8a9e-4630-b017-c6d52884278c None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:06.393161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f42641-8a9e-4630-b017-c6d52884278c None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:06.490082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f3794-54e1-4905-9515-9b357be0f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:06.491001 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f3794-54e1-4905-9515-9b357be0f62c admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:06.491352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f3794-54e1-4905-9515-9b357be0f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:06.491697 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f3794-54e1-4905-9515-9b357be0f62c admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:06.492479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f3794-54e1-4905-9515-9b357be0f62c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:06.494964 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f3794-54e1-4905-9515-9b357be0f62c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:06.539780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1127/2261] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:44:06 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:06.546949 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af503b37-e941-462f-914c-e2188453bfb1 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:06.560669 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af503b37-e941-462f-914c-e2188453bfb1 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:06.567300 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffe5f3-e5b3-4cdd-9e05-b2386a68a6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:06.568150 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffe5f3-e5b3-4cdd-9e05-b2386a68a6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:06.568437 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffe5f3-e5b3-4cdd-9e05-b2386a68a6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:06.568743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffe5f3-e5b3-4cdd-9e05-b2386a68a6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:06.569489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffe5f3-e5b3-4cdd-9e05-b2386a68a6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:06.571171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffe5f3-e5b3-4cdd-9e05-b2386a68a6e4 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:06.590817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f3794-54e1-4905-9515-9b357be0f62c admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:06.601591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1135/2262] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:06.602827 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f3794-54e1-4905-9515-9b357be0f62c admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:06.609037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887a29e-5657-4425-9989-c3bacf84d924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:06.609940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887a29e-5657-4425-9989-c3bacf84d924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:06.610303 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887a29e-5657-4425-9989-c3bacf84d924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:06.610517 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887a29e-5657-4425-9989-c3bacf84d924 admin admin] PATH_INFO: `/v3/projects/6c1780558c8347a191409674b4ca26b3/users/618b8df5127b4759ba68bfb4ae77a180/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:06.627587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887a29e-5657-4425-9989-c3bacf84d924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1780558c8347a191409674b4ca26b3, user_id=618b8df5127b4759ba68bfb4ae77a180, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:06.630998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887a29e-5657-4425-9989-c3bacf84d924 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:06.644833 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1128/2263] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:06 2022] PUT /identity/v3/projects/6c1780558c8347a191409674b4ca26b3/users/618b8df5127b4759ba68bfb4ae77a180/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:44:06.649850 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffe5f3-e5b3-4cdd-9e05-b2386a68a6e4 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:06.661867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffe5f3-e5b3-4cdd-9e05-b2386a68a6e4 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:06.757570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c50fa-c4b3-4615-814a-501c3b3ab35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:06.758428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c50fa-c4b3-4615-814a-501c3b3ab35e admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:06.758885 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c50fa-c4b3-4615-814a-501c3b3ab35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:06.759279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c50fa-c4b3-4615-814a-501c3b3ab35e admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:06.760105 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c50fa-c4b3-4615-814a-501c3b3ab35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:06.761863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c50fa-c4b3-4615-814a-501c3b3ab35e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:06.777460 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1136/2264] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:06.778736 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887a29e-5657-4425-9989-c3bacf84d924 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:06.795271 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887a29e-5657-4425-9989-c3bacf84d924 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:06.800143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d5e62-f970-495e-bc20-0f5d0465ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:06.801025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d5e62-f970-495e-bc20-0f5d0465ffce admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:06.801845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d5e62-f970-495e-bc20-0f5d0465ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:06.802132 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d5e62-f970-495e-bc20-0f5d0465ffce admin admin] PATH_INFO: `/v3/projects/6c1780558c8347a191409674b4ca26b3/users/618b8df5127b4759ba68bfb4ae77a180/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:06.804483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d5e62-f970-495e-bc20-0f5d0465ffce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1780558c8347a191409674b4ca26b3, user_id=618b8df5127b4759ba68bfb4ae77a180, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:06.806398 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb97d1-3a00-475e-9a96-d922206adb99 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:06.807192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb97d1-3a00-475e-9a96-d922206adb99 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:06.807305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d5e62-f970-495e-bc20-0f5d0465ffce admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:06.807650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb97d1-3a00-475e-9a96-d922206adb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:06.822461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1129/2265] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:06 2022] PUT /identity/v3/projects/6c1780558c8347a191409674b4ca26b3/users/618b8df5127b4759ba68bfb4ae77a180/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:06.835363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3020b-417f-4a90-b230-9c4990e0e9bf None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:06.835662 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3020b-417f-4a90-b230-9c4990e0e9bf None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:06.835945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3020b-417f-4a90-b230-9c4990e0e9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:06.851655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-89eb97d1-3a00-475e-9a96-d922206adb99 None None] MFA Rules not processed for user `4b161aa0d704420baaedf64d635f85ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:06.853169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-89eb97d1-3a00-475e-9a96-d922206adb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:06.889223 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-e5f3020b-417f-4a90-b230-9c4990e0e9bf None None] MFA Rules not processed for user `618b8df5127b4759ba68bfb4ae77a180`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:06.890618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e5f3020b-417f-4a90-b230-9c4990e0e9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:06.950220 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1137/2266] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:06.954410 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb97d1-3a00-475e-9a96-d922206adb99 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:06.956751 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-89eb97d1-3a00-475e-9a96-d922206adb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:06.978757 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1130/2267] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:06 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:06.986727 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3020b-417f-4a90-b230-9c4990e0e9bf None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:06.988370 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e5f3020b-417f-4a90-b230-9c4990e0e9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:07.056304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb97d1-3a00-475e-9a96-d922206adb99 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:07.063944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ee123-ac15-4e8e-a85d-53b130193ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:07.064618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ee123-ac15-4e8e-a85d-53b130193ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:07.064900 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ee123-ac15-4e8e-a85d-53b130193ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:07.065178 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ee123-ac15-4e8e-a85d-53b130193ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:07.065875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ee123-ac15-4e8e-a85d-53b130193ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:07.068992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ee123-ac15-4e8e-a85d-53b130193ec9 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:07.078622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3020b-417f-4a90-b230-9c4990e0e9bf None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:07.088394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92651b7d-a967-4975-8c9a-3bb591e0da45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:07.089267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92651b7d-a967-4975-8c9a-3bb591e0da45 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:07.089512 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92651b7d-a967-4975-8c9a-3bb591e0da45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:07.089945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92651b7d-a967-4975-8c9a-3bb591e0da45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:07.102619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1138/2268] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:44:06 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:07.106676 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ee123-ac15-4e8e-a85d-53b130193ec9 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:07.117109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92651b7d-a967-4975-8c9a-3bb591e0da45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:07.118798 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92651b7d-a967-4975-8c9a-3bb591e0da45 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:07.132273 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1131/2269] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:06 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:44:07.183518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ee123-ac15-4e8e-a85d-53b130193ec9 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:07.188924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e0517-1c91-4f1e-b9cd-0c54e8df49cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:07.189679 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e0517-1c91-4f1e-b9cd-0c54e8df49cc admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:07.190023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e0517-1c91-4f1e-b9cd-0c54e8df49cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:07.190411 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e0517-1c91-4f1e-b9cd-0c54e8df49cc admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:07.191175 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e0517-1c91-4f1e-b9cd-0c54e8df49cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:07.194052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e0517-1c91-4f1e-b9cd-0c54e8df49cc admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:07.228892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1139/2270] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:44:07 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:44:07.232778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92651b7d-a967-4975-8c9a-3bb591e0da45 service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:07.241244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e0517-1c91-4f1e-b9cd-0c54e8df49cc admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:07.245879 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92651b7d-a967-4975-8c9a-3bb591e0da45 service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:07.251167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e2dc8-817f-4aa0-8382-209505a8b345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:07.252168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e2dc8-817f-4aa0-8382-209505a8b345 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:07.252716 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e2dc8-817f-4aa0-8382-209505a8b345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:07.253014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e2dc8-817f-4aa0-8382-209505a8b345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:07.253736 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e2dc8-817f-4aa0-8382-209505a8b345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:07.266702 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e2dc8-817f-4aa0-8382-209505a8b345 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:07.298509 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1132/2271] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:07.309037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e2dc8-817f-4aa0-8382-209505a8b345 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:07.321690 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e2dc8-817f-4aa0-8382-209505a8b345 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:07.324318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e0517-1c91-4f1e-b9cd-0c54e8df49cc admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:07.326641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b54bd-89e7-4a7e-8d34-a47dee4a6717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:07.327522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b54bd-89e7-4a7e-8d34-a47dee4a6717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:07.327803 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b54bd-89e7-4a7e-8d34-a47dee4a6717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:07.328075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b54bd-89e7-4a7e-8d34-a47dee4a6717 admin admin] PATH_INFO: `/v3/projects/ccf5b4a8a2794f059837b86b4cd827b2/users/a9549e8e629a4e9380966228d6adb284/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:07.328448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d335b-03fa-4d47-bb3c-a8abcbbc51ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:07.329262 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d335b-03fa-4d47-bb3c-a8abcbbc51ec service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:07.329536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d335b-03fa-4d47-bb3c-a8abcbbc51ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:07.329810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d335b-03fa-4d47-bb3c-a8abcbbc51ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:07.343742 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b54bd-89e7-4a7e-8d34-a47dee4a6717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf5b4a8a2794f059837b86b4cd827b2, user_id=a9549e8e629a4e9380966228d6adb284, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:07.346444 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b54bd-89e7-4a7e-8d34-a47dee4a6717 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:07.366160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1133/2272] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:07 2022] PUT /identity/v3/projects/ccf5b4a8a2794f059837b86b4cd827b2/users/a9549e8e629a4e9380966228d6adb284/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:07.370524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b54bd-89e7-4a7e-8d34-a47dee4a6717 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:07.395892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d335b-03fa-4d47-bb3c-a8abcbbc51ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:07.397489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d335b-03fa-4d47-bb3c-a8abcbbc51ec service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:07.408135 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1140/2273] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:07.445913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b54bd-89e7-4a7e-8d34-a47dee4a6717 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:07.453212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff23cc-957e-491e-8218-a47f08ee984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:07.453965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff23cc-957e-491e-8218-a47f08ee984c admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:07.454487 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff23cc-957e-491e-8218-a47f08ee984c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:07.454879 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff23cc-957e-491e-8218-a47f08ee984c admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:07.455592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff23cc-957e-491e-8218-a47f08ee984c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:07.458521 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff23cc-957e-491e-8218-a47f08ee984c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:07.471473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1134/2274] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:44:07.476667 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d335b-03fa-4d47-bb3c-a8abcbbc51ec service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:07.487930 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d335b-03fa-4d47-bb3c-a8abcbbc51ec service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:07.493871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd904c-a30f-43c4-8375-f32263c8e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:07.494807 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd904c-a30f-43c4-8375-f32263c8e5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:07.495088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd904c-a30f-43c4-8375-f32263c8e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:07.495400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd904c-a30f-43c4-8375-f32263c8e5e2 admin admin] PATH_INFO: `/v3/projects/ccf5b4a8a2794f059837b86b4cd827b2/users/a9549e8e629a4e9380966228d6adb284/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:07.497534 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd904c-a30f-43c4-8375-f32263c8e5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf5b4a8a2794f059837b86b4cd827b2, user_id=a9549e8e629a4e9380966228d6adb284, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:07.500252 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd904c-a30f-43c4-8375-f32263c8e5e2 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:07.527927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1141/2275] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:07 2022] PUT /identity/v3/projects/ccf5b4a8a2794f059837b86b4cd827b2/users/a9549e8e629a4e9380966228d6adb284/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:10.546130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff23cc-957e-491e-8218-a47f08ee984c admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:10.559591 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff23cc-957e-491e-8218-a47f08ee984c admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:10.772711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0b7b7-8dc3-4fa8-8d67-de7626593ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:10.774071 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0b7b7-8dc3-4fa8-8d67-de7626593ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:10.783590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0b7b7-8dc3-4fa8-8d67-de7626593ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:10.784378 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0b7b7-8dc3-4fa8-8d67-de7626593ff4 admin admin] PATH_INFO: `/v3/users/145cb2d151ed47e9b49894297a1800ba` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:10.792050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0b7b7-8dc3-4fa8-8d67-de7626593ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=145cb2d151ed47e9b49894297a1800ba)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:10.795095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0b7b7-8dc3-4fa8-8d67-de7626593ff4 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:10.884959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-eaa0b7b7-8dc3-4fa8-8d67-de7626593ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145cb2d151ed47e9b49894297a1800ba'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:10.886801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-eaa0b7b7-8dc3-4fa8-8d67-de7626593ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145cb2d151ed47e9b49894297a1800ba'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:10.909099 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-eaa0b7b7-8dc3-4fa8-8d67-de7626593ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145cb2d151ed47e9b49894297a1800ba'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:10.919183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-eaa0b7b7-8dc3-4fa8-8d67-de7626593ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145cb2d151ed47e9b49894297a1800ba'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:10.920015 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-eaa0b7b7-8dc3-4fa8-8d67-de7626593ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145cb2d151ed47e9b49894297a1800ba'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:10.966769 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1135/2276] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:44:10 2022] DELETE /identity/v3/users/145cb2d151ed47e9b49894297a1800ba => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:10.970967 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877720-0539-48d3-b3c2-eaf4de222c52 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:10.971520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877720-0539-48d3-b3c2-eaf4de222c52 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:10.971623 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877720-0539-48d3-b3c2-eaf4de222c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:11.039394 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-95877720-0539-48d3-b3c2-eaf4de222c52 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:11.040611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-95877720-0539-48d3-b3c2-eaf4de222c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:11.176615 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1142/2277] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:11.187918 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0b7b7-8dc3-4fa8-8d67-de7626593ff4 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:11.195461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-eaa0b7b7-8dc3-4fa8-8d67-de7626593ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:11.326343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0b7b7-8dc3-4fa8-8d67-de7626593ff4 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:11.346323 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cd32c-5026-43df-994a-045c25bc87ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:11.347014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cd32c-5026-43df-994a-045c25bc87ce service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:11.347300 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cd32c-5026-43df-994a-045c25bc87ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:11.347585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cd32c-5026-43df-994a-045c25bc87ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:11.360273 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cd32c-5026-43df-994a-045c25bc87ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:11.362338 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cd32c-5026-43df-994a-045c25bc87ce service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:11.377721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1136/2278] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:12.536443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95877720-0539-48d3-b3c2-eaf4de222c52 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:12.548978 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-95877720-0539-48d3-b3c2-eaf4de222c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:12.579470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95877720-0539-48d3-b3c2-eaf4de222c52 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:12.593986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d5a7d-f53f-4186-9486-5db91dc7a675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:12.595368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d5a7d-f53f-4186-9486-5db91dc7a675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:12.595799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d5a7d-f53f-4186-9486-5db91dc7a675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:12.596223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d5a7d-f53f-4186-9486-5db91dc7a675 admin admin] PATH_INFO: `/v3/projects/5ebf1325b4e94b18ad0f7a794bd0fe60` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:12.597784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d5a7d-f53f-4186-9486-5db91dc7a675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ebf1325b4e94b18ad0f7a794bd0fe60)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:12.600750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d5a7d-f53f-4186-9486-5db91dc7a675 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:12.730758 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-623d5a7d-f53f-4186-9486-5db91dc7a675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ebf1325b4e94b18ad0f7a794bd0fe60', 'request_id': 'req-623d5a7d-f53f-4186-9486-5db91dc7a675'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:12.740983 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-623d5a7d-f53f-4186-9486-5db91dc7a675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ebf1325b4e94b18ad0f7a794bd0fe60', 'request_id': 'req-623d5a7d-f53f-4186-9486-5db91dc7a675'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:12.756728 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-623d5a7d-f53f-4186-9486-5db91dc7a675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ebf1325b4e94b18ad0f7a794bd0fe60', 'request_id': 'req-623d5a7d-f53f-4186-9486-5db91dc7a675'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:12.787345 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-623d5a7d-f53f-4186-9486-5db91dc7a675 admin admin] The token cache is being invalidate because project 5ebf1325b4e94b18ad0f7a794bd0fe60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:44:12.787737 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-623d5a7d-f53f-4186-9486-5db91dc7a675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:12.788895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-623d5a7d-f53f-4186-9486-5db91dc7a675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:12.791590 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1143/2279] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:44:12 2022] DELETE /identity/v3/projects/5ebf1325b4e94b18ad0f7a794bd0fe60 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:12.795416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cd32c-5026-43df-994a-045c25bc87ce service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:12.807112 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cd32c-5026-43df-994a-045c25bc87ce service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:12.909044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6042e-fc0c-4634-9e93-22a8f7edf957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:12.909931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6042e-fc0c-4634-9e93-22a8f7edf957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:12.910298 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6042e-fc0c-4634-9e93-22a8f7edf957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:12.911281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6042e-fc0c-4634-9e93-22a8f7edf957 admin admin] PATH_INFO: `/v3/users/618b8df5127b4759ba68bfb4ae77a180` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:12.913711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6042e-fc0c-4634-9e93-22a8f7edf957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=618b8df5127b4759ba68bfb4ae77a180)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:12.918792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6042e-fc0c-4634-9e93-22a8f7edf957 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:13.042507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-39c6042e-fc0c-4634-9e93-22a8f7edf957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '618b8df5127b4759ba68bfb4ae77a180'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:13.043858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-39c6042e-fc0c-4634-9e93-22a8f7edf957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '618b8df5127b4759ba68bfb4ae77a180'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:13.056887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-39c6042e-fc0c-4634-9e93-22a8f7edf957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '618b8df5127b4759ba68bfb4ae77a180'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:13.068558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-39c6042e-fc0c-4634-9e93-22a8f7edf957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '618b8df5127b4759ba68bfb4ae77a180'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:13.070328 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-39c6042e-fc0c-4634-9e93-22a8f7edf957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '618b8df5127b4759ba68bfb4ae77a180'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:13.156307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1137/2280] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:44:12 2022] DELETE /identity/v3/users/618b8df5127b4759ba68bfb4ae77a180 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:13.775392 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d5a7d-f53f-4186-9486-5db91dc7a675 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:13.783020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-623d5a7d-f53f-4186-9486-5db91dc7a675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:13.830344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d5a7d-f53f-4186-9486-5db91dc7a675 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:14.043965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5e09f-7b39-46ec-98dd-479bb294f92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:14.046481 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5e09f-7b39-46ec-98dd-479bb294f92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:14.046996 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5e09f-7b39-46ec-98dd-479bb294f92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:14.051394 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5e09f-7b39-46ec-98dd-479bb294f92b admin admin] PATH_INFO: `/v3/users/4c5498196ab241e2b0e071bdd4d4574b` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:14.053777 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5e09f-7b39-46ec-98dd-479bb294f92b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5498196ab241e2b0e071bdd4d4574b)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:14.056684 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5e09f-7b39-46ec-98dd-479bb294f92b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:14.184035 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-06e5e09f-7b39-46ec-98dd-479bb294f92b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5498196ab241e2b0e071bdd4d4574b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:14.195366 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-06e5e09f-7b39-46ec-98dd-479bb294f92b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5498196ab241e2b0e071bdd4d4574b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:14.196367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-06e5e09f-7b39-46ec-98dd-479bb294f92b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5498196ab241e2b0e071bdd4d4574b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:14.197516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-06e5e09f-7b39-46ec-98dd-479bb294f92b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5498196ab241e2b0e071bdd4d4574b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:14.215415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-06e5e09f-7b39-46ec-98dd-479bb294f92b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5498196ab241e2b0e071bdd4d4574b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:14.256734 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1144/2281] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:44:13 2022] DELETE /identity/v3/users/4c5498196ab241e2b0e071bdd4d4574b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:14.261332 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb624e-0699-4106-8eaf-8608eeb12d2a None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:14.261781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb624e-0699-4106-8eaf-8608eeb12d2a None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:14.261871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb624e-0699-4106-8eaf-8608eeb12d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:14.319384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-38bb624e-0699-4106-8eaf-8608eeb12d2a None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:14.320621 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-38bb624e-0699-4106-8eaf-8608eeb12d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:14.454299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5e09f-7b39-46ec-98dd-479bb294f92b admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:14.467654 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-06e5e09f-7b39-46ec-98dd-479bb294f92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:14.540270 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1138/2282] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:14.553762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb624e-0699-4106-8eaf-8608eeb12d2a None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:14.559450 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-38bb624e-0699-4106-8eaf-8608eeb12d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:14.681947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5e09f-7b39-46ec-98dd-479bb294f92b admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:14.692039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb624e-0699-4106-8eaf-8608eeb12d2a None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:14.696483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d464159-31d9-4803-977a-2002913fd70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:14.697206 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d464159-31d9-4803-977a-2002913fd70f service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:14.697657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d464159-31d9-4803-977a-2002913fd70f service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:14.698076 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d464159-31d9-4803-977a-2002913fd70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:14.700306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66554932-22dc-4bef-bafe-5dfa970ac15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:14.702088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66554932-22dc-4bef-bafe-5dfa970ac15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:14.702936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66554932-22dc-4bef-bafe-5dfa970ac15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:14.703331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66554932-22dc-4bef-bafe-5dfa970ac15a admin admin] PATH_INFO: `/v3/projects/6c1780558c8347a191409674b4ca26b3` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:14.705513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66554932-22dc-4bef-bafe-5dfa970ac15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c1780558c8347a191409674b4ca26b3)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:14.713370 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d464159-31d9-4803-977a-2002913fd70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:14.714896 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d464159-31d9-4803-977a-2002913fd70f service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:14.725924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66554932-22dc-4bef-bafe-5dfa970ac15a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:14.751077 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1139/2283] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:14.833625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-66554932-22dc-4bef-bafe-5dfa970ac15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c1780558c8347a191409674b4ca26b3', 'request_id': 'req-66554932-22dc-4bef-bafe-5dfa970ac15a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:14.844100 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-66554932-22dc-4bef-bafe-5dfa970ac15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c1780558c8347a191409674b4ca26b3', 'request_id': 'req-66554932-22dc-4bef-bafe-5dfa970ac15a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:14.852102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-66554932-22dc-4bef-bafe-5dfa970ac15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c1780558c8347a191409674b4ca26b3', 'request_id': 'req-66554932-22dc-4bef-bafe-5dfa970ac15a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:14.873624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-66554932-22dc-4bef-bafe-5dfa970ac15a admin admin] The token cache is being invalidate because project 6c1780558c8347a191409674b4ca26b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:44:14.875219 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-66554932-22dc-4bef-bafe-5dfa970ac15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:14.878647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-66554932-22dc-4bef-bafe-5dfa970ac15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:14.882355 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1145/2284] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:44:14 2022] DELETE /identity/v3/projects/6c1780558c8347a191409674b4ca26b3 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:14.887587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e346cd-5f59-4f7e-aa27-3534c2d5c959 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:14.888749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e346cd-5f59-4f7e-aa27-3534c2d5c959 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:14.889047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e346cd-5f59-4f7e-aa27-3534c2d5c959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:14.915953 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-38e346cd-5f59-4f7e-aa27-3534c2d5c959 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:14.919497 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-38e346cd-5f59-4f7e-aa27-3534c2d5c959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:15.115201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1140/2285] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:44:15.116506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a888e94-9f12-4237-9d3a-f00390dafdf8 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:15.116881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a888e94-9f12-4237-9d3a-f00390dafdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:15.117840 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a888e94-9f12-4237-9d3a-f00390dafdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:15.147447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-9a888e94-9f12-4237-9d3a-f00390dafdf8 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:15.149752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9a888e94-9f12-4237-9d3a-f00390dafdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:15.165402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1146/2286] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:15.170846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e346cd-5f59-4f7e-aa27-3534c2d5c959 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:15.190155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e346cd-5f59-4f7e-aa27-3534c2d5c959 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:15.196607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291becd-a5b7-484f-bf83-869ccf0c3245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:15.197561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291becd-a5b7-484f-bf83-869ccf0c3245 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:15.198052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291becd-a5b7-484f-bf83-869ccf0c3245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:15.198618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291becd-a5b7-484f-bf83-869ccf0c3245 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:15.199558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291becd-a5b7-484f-bf83-869ccf0c3245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:44:15.200066 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291becd-a5b7-484f-bf83-869ccf0c3245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:15.201964 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291becd-a5b7-484f-bf83-869ccf0c3245 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:15.221150 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a888e94-9f12-4237-9d3a-f00390dafdf8 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:15.222977 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9a888e94-9f12-4237-9d3a-f00390dafdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:15.228600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1141/2287] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:44:15.229624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291becd-a5b7-484f-bf83-869ccf0c3245 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:15.247153 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a888e94-9f12-4237-9d3a-f00390dafdf8 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:15.250931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291becd-a5b7-484f-bf83-869ccf0c3245 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:15.254984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e8c5d-55c6-41bf-975c-19bff654e390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:15.256104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e8c5d-55c6-41bf-975c-19bff654e390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:15.256567 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e8c5d-55c6-41bf-975c-19bff654e390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:15.256698 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988d8e8-1ef0-4f6c-9bc8-dc034410ef32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:15.257168 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e8c5d-55c6-41bf-975c-19bff654e390 admin admin] PATH_INFO: `/v3/projects/2714f3100d66414990990a9592fc4683` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:15.257281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988d8e8-1ef0-4f6c-9bc8-dc034410ef32 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:15.257523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988d8e8-1ef0-4f6c-9bc8-dc034410ef32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:15.257799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988d8e8-1ef0-4f6c-9bc8-dc034410ef32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:15.258522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988d8e8-1ef0-4f6c-9bc8-dc034410ef32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:15.260724 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988d8e8-1ef0-4f6c-9bc8-dc034410ef32 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:15.263492 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e8c5d-55c6-41bf-975c-19bff654e390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2714f3100d66414990990a9592fc4683)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:15.265624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e8c5d-55c6-41bf-975c-19bff654e390 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:15.323643 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1142/2288] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:44:15 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:15.330024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988d8e8-1ef0-4f6c-9bc8-dc034410ef32 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:15.362882 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-697e8c5d-55c6-41bf-975c-19bff654e390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2714f3100d66414990990a9592fc4683', 'request_id': 'req-697e8c5d-55c6-41bf-975c-19bff654e390'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:15.372135 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-697e8c5d-55c6-41bf-975c-19bff654e390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2714f3100d66414990990a9592fc4683', 'request_id': 'req-697e8c5d-55c6-41bf-975c-19bff654e390'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:15.385181 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-697e8c5d-55c6-41bf-975c-19bff654e390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2714f3100d66414990990a9592fc4683', 'request_id': 'req-697e8c5d-55c6-41bf-975c-19bff654e390'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:15.406342 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-697e8c5d-55c6-41bf-975c-19bff654e390 admin admin] The token cache is being invalidate because project 2714f3100d66414990990a9592fc4683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:44:15.407428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-697e8c5d-55c6-41bf-975c-19bff654e390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:15.408445 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-697e8c5d-55c6-41bf-975c-19bff654e390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:15.412835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1147/2289] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:44:15 2022] DELETE /identity/v3/projects/2714f3100d66414990990a9592fc4683 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:15.417615 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da58b1c-f8de-4c44-b782-d237d91e392e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:15.419064 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da58b1c-f8de-4c44-b782-d237d91e392e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:15.419246 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da58b1c-f8de-4c44-b782-d237d91e392e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:15.434874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988d8e8-1ef0-4f6c-9bc8-dc034410ef32 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:15.446407 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-0da58b1c-f8de-4c44-b782-d237d91e392e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:15.447819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0da58b1c-f8de-4c44-b782-d237d91e392e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:15.556027 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379783d-8fdc-4cc3-9392-a16306252e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:15.556878 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379783d-8fdc-4cc3-9392-a16306252e37 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:15.557689 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379783d-8fdc-4cc3-9392-a16306252e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:15.557979 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379783d-8fdc-4cc3-9392-a16306252e37 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:15.558754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379783d-8fdc-4cc3-9392-a16306252e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:15.560984 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379783d-8fdc-4cc3-9392-a16306252e37 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:15.596429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1148/2290] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:15.605580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f65fb-2f57-4a86-8a0d-effaa787cfc1 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:15.605961 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f65fb-2f57-4a86-8a0d-effaa787cfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:15.606333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f65fb-2f57-4a86-8a0d-effaa787cfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:15.618532 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1143/2291] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:44:15 2022] POST /identity/v3/users => generated 284 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:15.621826 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379783d-8fdc-4cc3-9392-a16306252e37 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:15.623849 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-0379783d-8fdc-4cc3-9392-a16306252e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:15.635458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-1f7f65fb-2f57-4a86-8a0d-effaa787cfc1 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:15.636707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-1f7f65fb-2f57-4a86-8a0d-effaa787cfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:15.640344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379783d-8fdc-4cc3-9392-a16306252e37 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:15.655334 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1149/2292] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:15.659187 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f65fb-2f57-4a86-8a0d-effaa787cfc1 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:15.664053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760c569-3956-4cbd-bd0d-c56e9e5f820c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:15.664991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760c569-3956-4cbd-bd0d-c56e9e5f820c admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:15.665622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760c569-3956-4cbd-bd0d-c56e9e5f820c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:15.667104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760c569-3956-4cbd-bd0d-c56e9e5f820c admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:15.667863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760c569-3956-4cbd-bd0d-c56e9e5f820c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:15.669491 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760c569-3956-4cbd-bd0d-c56e9e5f820c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:15.676126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f65fb-2f57-4a86-8a0d-effaa787cfc1 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:15.681141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781018e-d9b1-4bc0-ab98-bb4f11ff61e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:15.682034 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781018e-d9b1-4bc0-ab98-bb4f11ff61e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:15.682157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1144/2293] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:15.685016 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781018e-d9b1-4bc0-ab98-bb4f11ff61e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:15.685422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781018e-d9b1-4bc0-ab98-bb4f11ff61e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:15.686294 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781018e-d9b1-4bc0-ab98-bb4f11ff61e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:44:15.686655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781018e-d9b1-4bc0-ab98-bb4f11ff61e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:15.687183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760c569-3956-4cbd-bd0d-c56e9e5f820c admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:15.689021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781018e-d9b1-4bc0-ab98-bb4f11ff61e7 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:15.701473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760c569-3956-4cbd-bd0d-c56e9e5f820c admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:15.710265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1150/2294] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:44:15.711566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781018e-d9b1-4bc0-ab98-bb4f11ff61e7 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:15.711779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7360101-87db-4293-b174-b5941c729ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:15.712745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7360101-87db-4293-b174-b5941c729ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:15.713276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7360101-87db-4293-b174-b5941c729ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:15.713702 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7360101-87db-4293-b174-b5941c729ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:15.714629 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7360101-87db-4293-b174-b5941c729ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:15.716846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7360101-87db-4293-b174-b5941c729ddf admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:15.724689 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781018e-d9b1-4bc0-ab98-bb4f11ff61e7 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:15.731206 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1145/2295] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:15.732465 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857a3ce-08bb-4aab-ae9e-e90a65864e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:15.733282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857a3ce-08bb-4aab-ae9e-e90a65864e61 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:15.733560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857a3ce-08bb-4aab-ae9e-e90a65864e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:15.734088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857a3ce-08bb-4aab-ae9e-e90a65864e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:15.734873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857a3ce-08bb-4aab-ae9e-e90a65864e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:15.735312 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7360101-87db-4293-b174-b5941c729ddf admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:15.737413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857a3ce-08bb-4aab-ae9e-e90a65864e61 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:15.746667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7360101-87db-4293-b174-b5941c729ddf admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:15.755931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107ebc9-2e4a-44fc-b758-50722e6a1539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:15.757771 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107ebc9-2e4a-44fc-b758-50722e6a1539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:15.758159 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107ebc9-2e4a-44fc-b758-50722e6a1539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:15.758693 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107ebc9-2e4a-44fc-b758-50722e6a1539 admin admin] PATH_INFO: `/v3/projects/7e14e29d0aeb47fa9bb065bd569f79e9/users/aec88ffa0bd544689a84571ebb6af7b4/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:15.779200 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1151/2296] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:44:15 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:15.787149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857a3ce-08bb-4aab-ae9e-e90a65864e61 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:15.792541 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107ebc9-2e4a-44fc-b758-50722e6a1539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e14e29d0aeb47fa9bb065bd569f79e9, user_id=aec88ffa0bd544689a84571ebb6af7b4, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:15.796388 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107ebc9-2e4a-44fc-b758-50722e6a1539 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:15.851188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1146/2297] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:15 2022] PUT /identity/v3/projects/7e14e29d0aeb47fa9bb065bd569f79e9/users/aec88ffa0bd544689a84571ebb6af7b4/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:15.854213 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19e04f-7774-40c9-9044-501f4a30fbe6 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:15.855095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19e04f-7774-40c9-9044-501f4a30fbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:15.856183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19e04f-7774-40c9-9044-501f4a30fbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:15.891992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857a3ce-08bb-4aab-ae9e-e90a65864e61 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:15.915140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-4d19e04f-7774-40c9-9044-501f4a30fbe6 None None] MFA Rules not processed for user `a9549e8e629a4e9380966228d6adb284`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:15.916634 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4d19e04f-7774-40c9-9044-501f4a30fbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:15.994601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18f463-237c-4283-8e87-ef7debf47d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:15.995290 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f463-237c-4283-8e87-ef7debf47d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:15.995811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f463-237c-4283-8e87-ef7debf47d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:15.996273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f463-237c-4283-8e87-ef7debf47d45 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:15.997273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18f463-237c-4283-8e87-ef7debf47d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:16.000080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18f463-237c-4283-8e87-ef7debf47d45 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:16.036028 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1147/2298] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:16.038301 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d26ce-c030-4133-9acc-95193e49401a None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:16.039224 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d26ce-c030-4133-9acc-95193e49401a None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:16.039562 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d26ce-c030-4133-9acc-95193e49401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:16.060680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1152/2299] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:44:15 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:16.064202 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18f463-237c-4283-8e87-ef7debf47d45 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:16.068893 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9a18f463-237c-4283-8e87-ef7debf47d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:16.082813 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-e09d26ce-c030-4133-9acc-95193e49401a None None] MFA Rules not processed for user `aec88ffa0bd544689a84571ebb6af7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:16.084235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e09d26ce-c030-4133-9acc-95193e49401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:16.183150 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1148/2300] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:16.193264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d26ce-c030-4133-9acc-95193e49401a None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:16.204390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d26ce-c030-4133-9acc-95193e49401a None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:16.213742 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf9408-1ae4-4d71-8710-38df9533f09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:16.214569 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf9408-1ae4-4d71-8710-38df9533f09c admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:16.214853 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf9408-1ae4-4d71-8710-38df9533f09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:16.215219 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf9408-1ae4-4d71-8710-38df9533f09c admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:16.215337 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18f463-237c-4283-8e87-ef7debf47d45 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:16.215959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf9408-1ae4-4d71-8710-38df9533f09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:16.217993 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf9408-1ae4-4d71-8710-38df9533f09c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:16.222264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbe835-bfe5-4f75-a5e8-c175c8023df4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:16.223636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbe835-bfe5-4f75-a5e8-c175c8023df4 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:16.224760 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbe835-bfe5-4f75-a5e8-c175c8023df4 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:16.225058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbe835-bfe5-4f75-a5e8-c175c8023df4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:16.227755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5cdbe835-bfe5-4f75-a5e8-c175c8023df4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:16.234807 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1149/2301] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:16.234807 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf9408-1ae4-4d71-8710-38df9533f09c admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:16.248363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf9408-1ae4-4d71-8710-38df9533f09c admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:16.255603 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c3653-97dd-4db1-94cd-cab6c466b458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:16.256281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c3653-97dd-4db1-94cd-cab6c466b458 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:16.256574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c3653-97dd-4db1-94cd-cab6c466b458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:16.256855 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c3653-97dd-4db1-94cd-cab6c466b458 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:16.257557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c3653-97dd-4db1-94cd-cab6c466b458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:16.260025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c3653-97dd-4db1-94cd-cab6c466b458 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:16.303109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1150/2302] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:44:16 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:16.303109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c3653-97dd-4db1-94cd-cab6c466b458 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:16.316036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbe835-bfe5-4f75-a5e8-c175c8023df4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:16.318524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbe835-bfe5-4f75-a5e8-c175c8023df4 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:16.329861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1153/2303] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:16.330519 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbe835-bfe5-4f75-a5e8-c175c8023df4 service nova] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:16.342784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbe835-bfe5-4f75-a5e8-c175c8023df4 service nova] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:16.420096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c3653-97dd-4db1-94cd-cab6c466b458 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:16.426876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027b9c3-2eee-4d67-8f17-7dd2154d6893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:16.427697 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027b9c3-2eee-4d67-8f17-7dd2154d6893 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:16.428069 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027b9c3-2eee-4d67-8f17-7dd2154d6893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:16.428414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027b9c3-2eee-4d67-8f17-7dd2154d6893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:16.429273 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027b9c3-2eee-4d67-8f17-7dd2154d6893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:16.432096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027b9c3-2eee-4d67-8f17-7dd2154d6893 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:16.445292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86ccee-62ea-4f4a-936c-d6856f067d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:16.446147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86ccee-62ea-4f4a-936c-d6856f067d15 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:16.446485 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86ccee-62ea-4f4a-936c-d6856f067d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:16.446764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86ccee-62ea-4f4a-936c-d6856f067d15 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:16.447460 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86ccee-62ea-4f4a-936c-d6856f067d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:16.450404 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1151/2304] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:16.452242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86ccee-62ea-4f4a-936c-d6856f067d15 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:16.476109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027b9c3-2eee-4d67-8f17-7dd2154d6893 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:16.501950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027b9c3-2eee-4d67-8f17-7dd2154d6893 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:16.508749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1154/2305] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:44:16 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:16.513539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d9286-c00b-4f0e-97c9-cb409b3fccbd None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:16.513827 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d9286-c00b-4f0e-97c9-cb409b3fccbd None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:16.514103 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d9286-c00b-4f0e-97c9-cb409b3fccbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:16.524903 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1241d3-bf05-4281-8a2b-c3ac8e7478bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:16.525974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1241d3-bf05-4281-8a2b-c3ac8e7478bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:16.526302 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1241d3-bf05-4281-8a2b-c3ac8e7478bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:16.526631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1241d3-bf05-4281-8a2b-c3ac8e7478bd admin admin] PATH_INFO: `/v3/projects/b4fd80b7aab340c58cc35c2fd0c6928d/users/ea62366d13ca4431b6ef1649cac874ec/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:16.546312 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1241d3-bf05-4281-8a2b-c3ac8e7478bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4fd80b7aab340c58cc35c2fd0c6928d, user_id=ea62366d13ca4431b6ef1649cac874ec, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:16.550060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1241d3-bf05-4281-8a2b-c3ac8e7478bd admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:16.554694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-706d9286-c00b-4f0e-97c9-cb409b3fccbd None None] MFA Rules not processed for user `e2e0f15742ea49bba055538ae4e99303`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:16.555995 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-706d9286-c00b-4f0e-97c9-cb409b3fccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:16.587790 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1152/2306] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:16 2022] PUT /identity/v3/projects/b4fd80b7aab340c58cc35c2fd0c6928d/users/ea62366d13ca4431b6ef1649cac874ec/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:16.588954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1241d3-bf05-4281-8a2b-c3ac8e7478bd admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:16.678373 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1155/2307] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:16.680065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f7c44-9b2e-4eee-9b97-73efd93e8c5f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:16.680378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f7c44-9b2e-4eee-9b97-73efd93e8c5f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:16.680692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f7c44-9b2e-4eee-9b97-73efd93e8c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:16.744289 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f30f7c44-9b2e-4eee-9b97-73efd93e8c5f None None] MFA Rules not processed for user `ea62366d13ca4431b6ef1649cac874ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:16.749057 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f30f7c44-9b2e-4eee-9b97-73efd93e8c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:16.765409 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1241d3-bf05-4281-8a2b-c3ac8e7478bd admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:16.776631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b9ecd-9536-4b34-b2ca-d16d9776f5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:16.778641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b9ecd-9536-4b34-b2ca-d16d9776f5ac admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:16.779817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b9ecd-9536-4b34-b2ca-d16d9776f5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:16.780269 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b9ecd-9536-4b34-b2ca-d16d9776f5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:16.781931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b9ecd-9536-4b34-b2ca-d16d9776f5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:16.787932 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b9ecd-9536-4b34-b2ca-d16d9776f5ac admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:16.818998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1153/2308] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:16.820252 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b9ecd-9536-4b34-b2ca-d16d9776f5ac admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:16.835255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b9ecd-9536-4b34-b2ca-d16d9776f5ac admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:16.841546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f877963-3093-44a7-b04d-e20d0e0f4a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:16.842739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f877963-3093-44a7-b04d-e20d0e0f4a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:16.843492 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f877963-3093-44a7-b04d-e20d0e0f4a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:16.844970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f877963-3093-44a7-b04d-e20d0e0f4a58 admin admin] PATH_INFO: `/v3/projects/a14ec90a25254f97a9dd297d8e6f4433/users/802d95bf17c6428db7c96474eff65fe9/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:16.868340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1156/2309] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:16.872989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f7c44-9b2e-4eee-9b97-73efd93e8c5f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:16.897235 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f7c44-9b2e-4eee-9b97-73efd93e8c5f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:16.903462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a646e-8ace-49be-ad0d-d7a3e167d85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:16.903462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a646e-8ace-49be-ad0d-d7a3e167d85e admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:16.903915 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a646e-8ace-49be-ad0d-d7a3e167d85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:16.904445 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a646e-8ace-49be-ad0d-d7a3e167d85e admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:16.905316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a646e-8ace-49be-ad0d-d7a3e167d85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:16.908620 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a646e-8ace-49be-ad0d-d7a3e167d85e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:16.919097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f877963-3093-44a7-b04d-e20d0e0f4a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14ec90a25254f97a9dd297d8e6f4433, user_id=802d95bf17c6428db7c96474eff65fe9, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:16.922050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f877963-3093-44a7-b04d-e20d0e0f4a58 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:16.956120 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1154/2310] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:16 2022] PUT /identity/v3/projects/a14ec90a25254f97a9dd297d8e6f4433/users/802d95bf17c6428db7c96474eff65fe9/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:16.957790 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1157/2311] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:44:16 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:16.961690 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f877963-3093-44a7-b04d-e20d0e0f4a58 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:16.961871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a646e-8ace-49be-ad0d-d7a3e167d85e admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:17.099102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a646e-8ace-49be-ad0d-d7a3e167d85e admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:17.118077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d6820-e585-448f-8d67-018fae484a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:17.118950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d6820-e585-448f-8d67-018fae484a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:17.119233 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d6820-e585-448f-8d67-018fae484a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:17.119509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d6820-e585-448f-8d67-018fae484a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:17.120306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d6820-e585-448f-8d67-018fae484a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:17.122839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d6820-e585-448f-8d67-018fae484a1f admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:17.155706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1158/2312] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:17.156907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d6820-e585-448f-8d67-018fae484a1f admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:17.177579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f877963-3093-44a7-b04d-e20d0e0f4a58 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:17.178608 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d6820-e585-448f-8d67-018fae484a1f admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:17.188221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e738a-2b8e-491d-917e-e7e3452c9b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:17.189286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e738a-2b8e-491d-917e-e7e3452c9b71 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:17.189771 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e738a-2b8e-491d-917e-e7e3452c9b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:17.190269 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e738a-2b8e-491d-917e-e7e3452c9b71 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:17.191204 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e738a-2b8e-491d-917e-e7e3452c9b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:17.192921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c347346-a96e-48ea-967b-dec15b22b8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:17.193836 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c347346-a96e-48ea-967b-dec15b22b8fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:17.194612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c347346-a96e-48ea-967b-dec15b22b8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:17.195197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e738a-2b8e-491d-917e-e7e3452c9b71 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:17.196566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c347346-a96e-48ea-967b-dec15b22b8fa admin admin] PATH_INFO: `/v3/projects/a14ec90a25254f97a9dd297d8e6f4433/users/802d95bf17c6428db7c96474eff65fe9/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:17.200957 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c347346-a96e-48ea-967b-dec15b22b8fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14ec90a25254f97a9dd297d8e6f4433, user_id=802d95bf17c6428db7c96474eff65fe9, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:17.210649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c347346-a96e-48ea-967b-dec15b22b8fa admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:17.225995 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1155/2313] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:44:16 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:17.231026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e738a-2b8e-491d-917e-e7e3452c9b71 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:17.246958 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e738a-2b8e-491d-917e-e7e3452c9b71 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:17.250298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1159/2314] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:17 2022] PUT /identity/v3/projects/a14ec90a25254f97a9dd297d8e6f4433/users/802d95bf17c6428db7c96474eff65fe9/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:17.259134 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72454d-3fa1-42fe-984c-7faea567c2d9 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:17.259460 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72454d-3fa1-42fe-984c-7faea567c2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:17.259714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72454d-3fa1-42fe-984c-7faea567c2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:17.331250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-7d72454d-3fa1-42fe-984c-7faea567c2d9 None None] MFA Rules not processed for user `802d95bf17c6428db7c96474eff65fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:17.333170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7d72454d-3fa1-42fe-984c-7faea567c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:17.384963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b75d4d-04a2-46c0-94a3-1c9b021c51d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:17.386541 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75d4d-04a2-46c0-94a3-1c9b021c51d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:17.387495 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75d4d-04a2-46c0-94a3-1c9b021c51d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:17.387944 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75d4d-04a2-46c0-94a3-1c9b021c51d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:17.397562 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b75d4d-04a2-46c0-94a3-1c9b021c51d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:17.402262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b75d4d-04a2-46c0-94a3-1c9b021c51d5 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:17.422557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1156/2315] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:44:17.427207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b75d4d-04a2-46c0-94a3-1c9b021c51d5 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:17.450148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b75d4d-04a2-46c0-94a3-1c9b021c51d5 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:17.470330 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4297291-074d-48c4-96ae-397124d65a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:17.477143 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1160/2316] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:17 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:17.478322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4297291-074d-48c4-96ae-397124d65a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:17.479257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4297291-074d-48c4-96ae-397124d65a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:17.479707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4297291-074d-48c4-96ae-397124d65a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:17.480559 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72454d-3fa1-42fe-984c-7faea567c2d9 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:17.482550 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4297291-074d-48c4-96ae-397124d65a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:17.483546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7d72454d-3fa1-42fe-984c-7faea567c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:17.488745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4297291-074d-48c4-96ae-397124d65a19 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:17.515157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1157/2317] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:17.516302 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4297291-074d-48c4-96ae-397124d65a19 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:17.542240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4297291-074d-48c4-96ae-397124d65a19 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:17.554466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033042cd-cf3d-4ca1-a157-e9bf1bc789ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:17.557585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033042cd-cf3d-4ca1-a157-e9bf1bc789ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:17.558115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033042cd-cf3d-4ca1-a157-e9bf1bc789ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:17.558653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033042cd-cf3d-4ca1-a157-e9bf1bc789ed admin admin] PATH_INFO: `/v3/projects/3c77a8e9d30f48f886520880333bb642/users/fd5695dab31b4e0590ff154bb3f03919/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:17.595092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033042cd-cf3d-4ca1-a157-e9bf1bc789ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c77a8e9d30f48f886520880333bb642, user_id=fd5695dab31b4e0590ff154bb3f03919, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:17.603646 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033042cd-cf3d-4ca1-a157-e9bf1bc789ed admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:17.633957 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72454d-3fa1-42fe-984c-7faea567c2d9 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:17.643604 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1158/2318] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:17 2022] PUT /identity/v3/projects/3c77a8e9d30f48f886520880333bb642/users/fd5695dab31b4e0590ff154bb3f03919/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:17.656371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278fa08-2531-456b-ba70-3b99c2e3c146 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:17.656984 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278fa08-2531-456b-ba70-3b99c2e3c146 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:17.657488 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278fa08-2531-456b-ba70-3b99c2e3c146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:17.729562 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-8278fa08-2531-456b-ba70-3b99c2e3c146 None None] MFA Rules not processed for user `fd5695dab31b4e0590ff154bb3f03919`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:17.731000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8278fa08-2531-456b-ba70-3b99c2e3c146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:17.799462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335af0b-1abd-46ea-8ba3-590dc37f2291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:17.801473 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335af0b-1abd-46ea-8ba3-590dc37f2291 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:17.802442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335af0b-1abd-46ea-8ba3-590dc37f2291 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:17.802931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335af0b-1abd-46ea-8ba3-590dc37f2291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:17.929508 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1159/2319] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:17.933264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278fa08-2531-456b-ba70-3b99c2e3c146 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:18.009953 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335af0b-1abd-46ea-8ba3-590dc37f2291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:18.013457 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335af0b-1abd-46ea-8ba3-590dc37f2291 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:18.047360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1161/2320] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:17 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:18.086016 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278fa08-2531-456b-ba70-3b99c2e3c146 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:18.097296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a440f27-0edf-43cc-8722-5a50ce6cb9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:18.098644 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a440f27-0edf-43cc-8722-5a50ce6cb9bb admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:18.099018 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a440f27-0edf-43cc-8722-5a50ce6cb9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:18.099392 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a440f27-0edf-43cc-8722-5a50ce6cb9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:18.099922 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a440f27-0edf-43cc-8722-5a50ce6cb9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:18.101858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a440f27-0edf-43cc-8722-5a50ce6cb9bb admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:18.167646 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1160/2321] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:44:17 2022] POST /identity/v3/projects => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:18.168950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335af0b-1abd-46ea-8ba3-590dc37f2291 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:18.187126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335af0b-1abd-46ea-8ba3-590dc37f2291 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:18.262865 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a440f27-0edf-43cc-8722-5a50ce6cb9bb admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:18.321505 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129e0e8-bcbe-4bb5-bca6-f3a54a714a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:18.322634 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129e0e8-bcbe-4bb5-bca6-f3a54a714a1c admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:18.323012 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129e0e8-bcbe-4bb5-bca6-f3a54a714a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:18.323379 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129e0e8-bcbe-4bb5-bca6-f3a54a714a1c admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:18.324305 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129e0e8-bcbe-4bb5-bca6-f3a54a714a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:18.326395 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129e0e8-bcbe-4bb5-bca6-f3a54a714a1c admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:18.359279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1162/2322] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:44:18 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:18.360875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129e0e8-bcbe-4bb5-bca6-f3a54a714a1c admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:18.377376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129e0e8-bcbe-4bb5-bca6-f3a54a714a1c admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:18.383721 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb8498-8038-41a7-a335-80f707d97af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:18.384769 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb8498-8038-41a7-a335-80f707d97af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:18.385407 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb8498-8038-41a7-a335-80f707d97af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:18.385778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb8498-8038-41a7-a335-80f707d97af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:18.386890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb8498-8038-41a7-a335-80f707d97af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:18.388920 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb8498-8038-41a7-a335-80f707d97af7 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:18.404635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1163/2323] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:18.425884 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb8498-8038-41a7-a335-80f707d97af7 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:18.465189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb8498-8038-41a7-a335-80f707d97af7 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:18.476252 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a440f27-0edf-43cc-8722-5a50ce6cb9bb admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:18.477569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41b2ff-b799-464f-bf07-f5f4be7ea2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:18.478557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b2ff-b799-464f-bf07-f5f4be7ea2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:18.479000 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b2ff-b799-464f-bf07-f5f4be7ea2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:18.479770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b2ff-b799-464f-bf07-f5f4be7ea2f4 admin admin] PATH_INFO: `/v3/projects/ef591a056354488ca588fa6efb63951d/users/2ee66790ffb841fa884905aeb52fc3eb/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:18.489218 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ea972-a732-4842-9a91-f05c6c2a1854 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:18.490300 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ea972-a732-4842-9a91-f05c6c2a1854 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:18.492186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ea972-a732-4842-9a91-f05c6c2a1854 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:18.493470 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ea972-a732-4842-9a91-f05c6c2a1854 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:18.503497 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41b2ff-b799-464f-bf07-f5f4be7ea2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef591a056354488ca588fa6efb63951d, user_id=2ee66790ffb841fa884905aeb52fc3eb, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:18.520112 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41b2ff-b799-464f-bf07-f5f4be7ea2f4 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:18.551488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1164/2324] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:18 2022] PUT /identity/v3/projects/ef591a056354488ca588fa6efb63951d/users/2ee66790ffb841fa884905aeb52fc3eb/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:18.553547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41b2ff-b799-464f-bf07-f5f4be7ea2f4 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:18.653982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ea972-a732-4842-9a91-f05c6c2a1854 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:18.659197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ea972-a732-4842-9a91-f05c6c2a1854 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:18.685777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1161/2325] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:18.732125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41b2ff-b799-464f-bf07-f5f4be7ea2f4 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:18.750204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3b4f9-6645-44e2-924c-cc1224bc26a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:18.750204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3b4f9-6645-44e2-924c-cc1224bc26a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:18.750204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3b4f9-6645-44e2-924c-cc1224bc26a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:18.750204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3b4f9-6645-44e2-924c-cc1224bc26a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:18.750697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3b4f9-6645-44e2-924c-cc1224bc26a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:18.750697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3b4f9-6645-44e2-924c-cc1224bc26a7 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:18.776628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1165/2326] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:18.781114 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ea972-a732-4842-9a91-f05c6c2a1854 service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:18.799673 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ea972-a732-4842-9a91-f05c6c2a1854 service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:18.808921 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab1c8a-ec3b-42fc-9cbe-6f01c5f9736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:18.809927 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab1c8a-ec3b-42fc-9cbe-6f01c5f9736c admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:18.810344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab1c8a-ec3b-42fc-9cbe-6f01c5f9736c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:18.810750 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab1c8a-ec3b-42fc-9cbe-6f01c5f9736c admin admin] PATH_INFO: `/v3/projects/ef591a056354488ca588fa6efb63951d/users/2ee66790ffb841fa884905aeb52fc3eb/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:18.821793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab1c8a-ec3b-42fc-9cbe-6f01c5f9736c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef591a056354488ca588fa6efb63951d, user_id=2ee66790ffb841fa884905aeb52fc3eb, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:18.828446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab1c8a-ec3b-42fc-9cbe-6f01c5f9736c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:18.854389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1162/2327] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:18 2022] PUT /identity/v3/projects/ef591a056354488ca588fa6efb63951d/users/2ee66790ffb841fa884905aeb52fc3eb/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:18.865136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d539b8b-3b65-43b6-9a96-e3bda28af061 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:18.865770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d539b8b-3b65-43b6-9a96-e3bda28af061 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:18.866406 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d539b8b-3b65-43b6-9a96-e3bda28af061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:18.970847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-5d539b8b-3b65-43b6-9a96-e3bda28af061 None None] MFA Rules not processed for user `2ee66790ffb841fa884905aeb52fc3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:18.975995 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5d539b8b-3b65-43b6-9a96-e3bda28af061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:19.151633 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1166/2328] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:19.199331 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab1c8a-ec3b-42fc-9cbe-6f01c5f9736c admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:19.203229 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b2ab1c8a-ec3b-42fc-9cbe-6f01c5f9736c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:19.361285 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab1c8a-ec3b-42fc-9cbe-6f01c5f9736c admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:19.369023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f379c-7a13-4298-80ac-443957e78db0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:19.370884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f379c-7a13-4298-80ac-443957e78db0 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:19.371170 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f379c-7a13-4298-80ac-443957e78db0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:19.371448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f379c-7a13-4298-80ac-443957e78db0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:19.547824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f379c-7a13-4298-80ac-443957e78db0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:19.552012 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f379c-7a13-4298-80ac-443957e78db0 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:19.565587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1163/2329] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:22.098756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d539b8b-3b65-43b6-9a96-e3bda28af061 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:22.137707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d539b8b-3b65-43b6-9a96-e3bda28af061 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:22.142743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb81ecb-0658-40e0-9322-97a11e0d3721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:22.143617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb81ecb-0658-40e0-9322-97a11e0d3721 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:22.144052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb81ecb-0658-40e0-9322-97a11e0d3721 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:22.145338 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb81ecb-0658-40e0-9322-97a11e0d3721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:22.252351 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb81ecb-0658-40e0-9322-97a11e0d3721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:22.253880 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb81ecb-0658-40e0-9322-97a11e0d3721 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:22.263760 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1167/2330] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:22.681864 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f379c-7a13-4298-80ac-443957e78db0 service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:22.811555 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f379c-7a13-4298-80ac-443957e78db0 service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:22.817781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f9f99-8bdf-4386-bd22-47bc51e8d1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:22.818695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f9f99-8bdf-4386-bd22-47bc51e8d1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:22.818971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f9f99-8bdf-4386-bd22-47bc51e8d1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:22.819272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f9f99-8bdf-4386-bd22-47bc51e8d1c0 admin admin] PATH_INFO: `/v3/users/aec88ffa0bd544689a84571ebb6af7b4` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:22.820471 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f9f99-8bdf-4386-bd22-47bc51e8d1c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec88ffa0bd544689a84571ebb6af7b4)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:22.822406 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f9f99-8bdf-4386-bd22-47bc51e8d1c0 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:22.872210 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b82f9f99-8bdf-4386-bd22-47bc51e8d1c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec88ffa0bd544689a84571ebb6af7b4'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:22.872866 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b82f9f99-8bdf-4386-bd22-47bc51e8d1c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec88ffa0bd544689a84571ebb6af7b4'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:22.881581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b82f9f99-8bdf-4386-bd22-47bc51e8d1c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec88ffa0bd544689a84571ebb6af7b4'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:22.888990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b82f9f99-8bdf-4386-bd22-47bc51e8d1c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec88ffa0bd544689a84571ebb6af7b4'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:22.889665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b82f9f99-8bdf-4386-bd22-47bc51e8d1c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec88ffa0bd544689a84571ebb6af7b4'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:22.909540 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1164/2331] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:44:22 2022] DELETE /identity/v3/users/aec88ffa0bd544689a84571ebb6af7b4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:22.914291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096811e8-102b-4fc1-a036-0b5b434e962c None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:22.914565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096811e8-102b-4fc1-a036-0b5b434e962c None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:22.914845 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096811e8-102b-4fc1-a036-0b5b434e962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:22.964220 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-096811e8-102b-4fc1-a036-0b5b434e962c None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:22.965511 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-096811e8-102b-4fc1-a036-0b5b434e962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:22.987419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f9f99-8bdf-4386-bd22-47bc51e8d1c0 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:22.989614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b82f9f99-8bdf-4386-bd22-47bc51e8d1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:23.066581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1168/2332] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:23.075264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096811e8-102b-4fc1-a036-0b5b434e962c None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:23.077299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-096811e8-102b-4fc1-a036-0b5b434e962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:23.078628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f9f99-8bdf-4386-bd22-47bc51e8d1c0 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:23.091547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec6e52-d761-4b59-9b76-2cbc38aad94f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:23.092214 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec6e52-d761-4b59-9b76-2cbc38aad94f service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:23.092500 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec6e52-d761-4b59-9b76-2cbc38aad94f service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:23.092778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec6e52-d761-4b59-9b76-2cbc38aad94f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:23.095863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-64ec6e52-d761-4b59-9b76-2cbc38aad94f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:23.183013 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096811e8-102b-4fc1-a036-0b5b434e962c None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:23.187239 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dec2c-e02a-498e-9acb-0d505d5ab0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:23.187571 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec6e52-d761-4b59-9b76-2cbc38aad94f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:23.188010 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dec2c-e02a-498e-9acb-0d505d5ab0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:23.188358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dec2c-e02a-498e-9acb-0d505d5ab0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:23.188699 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dec2c-e02a-498e-9acb-0d505d5ab0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:23.189017 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec6e52-d761-4b59-9b76-2cbc38aad94f service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:23.199494 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dec2c-e02a-498e-9acb-0d505d5ab0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:23.201171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dec2c-e02a-498e-9acb-0d505d5ab0b3 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:23.202308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1165/2333] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:44:23.215524 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1169/2334] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:44:23.510260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec6e52-d761-4b59-9b76-2cbc38aad94f service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:23.510260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-64ec6e52-d761-4b59-9b76-2cbc38aad94f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:23.526415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec6e52-d761-4b59-9b76-2cbc38aad94f service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:23.531776 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584cd69-16a3-456c-916c-e4d5d301ac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:23.532710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584cd69-16a3-456c-916c-e4d5d301ac29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:23.532899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584cd69-16a3-456c-916c-e4d5d301ac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:23.533179 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584cd69-16a3-456c-916c-e4d5d301ac29 admin admin] PATH_INFO: `/v3/projects/7e14e29d0aeb47fa9bb065bd569f79e9` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:23.534384 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584cd69-16a3-456c-916c-e4d5d301ac29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e14e29d0aeb47fa9bb065bd569f79e9)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:23.536813 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584cd69-16a3-456c-916c-e4d5d301ac29 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:23.584855 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e584cd69-16a3-456c-916c-e4d5d301ac29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e14e29d0aeb47fa9bb065bd569f79e9', 'request_id': 'req-e584cd69-16a3-456c-916c-e4d5d301ac29'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:23.590480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e584cd69-16a3-456c-916c-e4d5d301ac29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e14e29d0aeb47fa9bb065bd569f79e9', 'request_id': 'req-e584cd69-16a3-456c-916c-e4d5d301ac29'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:23.596834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e584cd69-16a3-456c-916c-e4d5d301ac29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e14e29d0aeb47fa9bb065bd569f79e9', 'request_id': 'req-e584cd69-16a3-456c-916c-e4d5d301ac29'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:23.608708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e584cd69-16a3-456c-916c-e4d5d301ac29 admin admin] The token cache is being invalidate because project 7e14e29d0aeb47fa9bb065bd569f79e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:44:23.608993 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e584cd69-16a3-456c-916c-e4d5d301ac29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:23.609607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e584cd69-16a3-456c-916c-e4d5d301ac29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:23.611181 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1166/2335] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:44:23 2022] DELETE /identity/v3/projects/7e14e29d0aeb47fa9bb065bd569f79e9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:23.615170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dec2c-e02a-498e-9acb-0d505d5ab0b3 service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:23.624479 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dec2c-e02a-498e-9acb-0d505d5ab0b3 service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:23.684271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053bd85-0815-4c6c-8f27-2c954aecd5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:23.685143 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053bd85-0815-4c6c-8f27-2c954aecd5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:23.685422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053bd85-0815-4c6c-8f27-2c954aecd5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:23.685695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053bd85-0815-4c6c-8f27-2c954aecd5bd admin admin] PATH_INFO: `/v3/users/802d95bf17c6428db7c96474eff65fe9` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:23.686998 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053bd85-0815-4c6c-8f27-2c954aecd5bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=802d95bf17c6428db7c96474eff65fe9)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:23.688887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053bd85-0815-4c6c-8f27-2c954aecd5bd admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:23.734945 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-9053bd85-0815-4c6c-8f27-2c954aecd5bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '802d95bf17c6428db7c96474eff65fe9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:23.741591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-9053bd85-0815-4c6c-8f27-2c954aecd5bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '802d95bf17c6428db7c96474eff65fe9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:23.742283 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-9053bd85-0815-4c6c-8f27-2c954aecd5bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '802d95bf17c6428db7c96474eff65fe9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:23.742892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-9053bd85-0815-4c6c-8f27-2c954aecd5bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '802d95bf17c6428db7c96474eff65fe9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:23.754813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-9053bd85-0815-4c6c-8f27-2c954aecd5bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '802d95bf17c6428db7c96474eff65fe9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:23.767655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1170/2336] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:44:23 2022] DELETE /identity/v3/users/802d95bf17c6428db7c96474eff65fe9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:24.035599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584cd69-16a3-456c-916c-e4d5d301ac29 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:24.037328 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e584cd69-16a3-456c-916c-e4d5d301ac29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:24.052882 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584cd69-16a3-456c-916c-e4d5d301ac29 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:24.116737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5431a-6fec-4762-ad70-a1a267712e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:24.117595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5431a-6fec-4762-ad70-a1a267712e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:24.117941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5431a-6fec-4762-ad70-a1a267712e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:24.118133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5431a-6fec-4762-ad70-a1a267712e99 admin admin] PATH_INFO: `/v3/projects/a14ec90a25254f97a9dd297d8e6f4433` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:24.119962 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5431a-6fec-4762-ad70-a1a267712e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14ec90a25254f97a9dd297d8e6f4433)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:24.121860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5431a-6fec-4762-ad70-a1a267712e99 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:24.169022 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-97a5431a-6fec-4762-ad70-a1a267712e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14ec90a25254f97a9dd297d8e6f4433', 'request_id': 'req-97a5431a-6fec-4762-ad70-a1a267712e99'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:24.174349 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-97a5431a-6fec-4762-ad70-a1a267712e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14ec90a25254f97a9dd297d8e6f4433', 'request_id': 'req-97a5431a-6fec-4762-ad70-a1a267712e99'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:24.180827 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-97a5431a-6fec-4762-ad70-a1a267712e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14ec90a25254f97a9dd297d8e6f4433', 'request_id': 'req-97a5431a-6fec-4762-ad70-a1a267712e99'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:24.195107 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-97a5431a-6fec-4762-ad70-a1a267712e99 admin admin] The token cache is being invalidate because project a14ec90a25254f97a9dd297d8e6f4433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:44:24.195390 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-97a5431a-6fec-4762-ad70-a1a267712e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:24.196035 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-97a5431a-6fec-4762-ad70-a1a267712e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:24.197638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1167/2337] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:44:24 2022] DELETE /identity/v3/projects/a14ec90a25254f97a9dd297d8e6f4433 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:24.202989 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323be842-f6d6-4c81-9315-fc3da18b4c7e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:24.203464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323be842-f6d6-4c81-9315-fc3da18b4c7e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:24.203565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323be842-f6d6-4c81-9315-fc3da18b4c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:24.243329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-323be842-f6d6-4c81-9315-fc3da18b4c7e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:24.244514 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-323be842-f6d6-4c81-9315-fc3da18b4c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:24.312273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1171/2338] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:44:24.320385 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c19742-693a-4371-8d01-a35252296696 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:24.320774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c19742-693a-4371-8d01-a35252296696 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:24.321049 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c19742-693a-4371-8d01-a35252296696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:24.346774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-d2c19742-693a-4371-8d01-a35252296696 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:24.348816 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d2c19742-693a-4371-8d01-a35252296696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:24.358231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1168/2339] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:24.362294 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323be842-f6d6-4c81-9315-fc3da18b4c7e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:24.372562 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323be842-f6d6-4c81-9315-fc3da18b4c7e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:24.377138 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f76a4e-ddaa-4768-8afc-bf2ebbd86b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:24.377792 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f76a4e-ddaa-4768-8afc-bf2ebbd86b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:24.378068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f76a4e-ddaa-4768-8afc-bf2ebbd86b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:24.378516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f76a4e-ddaa-4768-8afc-bf2ebbd86b59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:24.379315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f76a4e-ddaa-4768-8afc-bf2ebbd86b59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:44:24.379591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f76a4e-ddaa-4768-8afc-bf2ebbd86b59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:24.381166 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f76a4e-ddaa-4768-8afc-bf2ebbd86b59 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:24.396593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1172/2340] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:44:24.401053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c19742-693a-4371-8d01-a35252296696 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:24.410894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c19742-693a-4371-8d01-a35252296696 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:24.415706 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be778d-5cf1-43cb-92ea-783175a1a2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:24.418397 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be778d-5cf1-43cb-92ea-783175a1a2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:24.418397 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be778d-5cf1-43cb-92ea-783175a1a2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:24.418397 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be778d-5cf1-43cb-92ea-783175a1a2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:24.418397 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be778d-5cf1-43cb-92ea-783175a1a2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:24.419580 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be778d-5cf1-43cb-92ea-783175a1a2e3 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:24.450374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1169/2341] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:44:24 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:24.451504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f76a4e-ddaa-4768-8afc-bf2ebbd86b59 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:24.462113 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f76a4e-ddaa-4768-8afc-bf2ebbd86b59 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:24.518883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a3c64-ede0-4559-834a-b720d3d30d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:24.520230 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a3c64-ede0-4559-834a-b720d3d30d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:24.520515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a3c64-ede0-4559-834a-b720d3d30d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:24.520784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a3c64-ede0-4559-834a-b720d3d30d36 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:24.521482 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a3c64-ede0-4559-834a-b720d3d30d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:24.523441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a3c64-ede0-4559-834a-b720d3d30d36 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:24.543764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1173/2342] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:44:24 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:44:24.553402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be778d-5cf1-43cb-92ea-783175a1a2e3 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:24.564128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be778d-5cf1-43cb-92ea-783175a1a2e3 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:24.570753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87edd78-999e-46a7-9aae-4869e9d950a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:24.571430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87edd78-999e-46a7-9aae-4869e9d950a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:24.571716 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87edd78-999e-46a7-9aae-4869e9d950a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:24.571992 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87edd78-999e-46a7-9aae-4869e9d950a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:24.572907 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87edd78-999e-46a7-9aae-4869e9d950a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:24.575239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87edd78-999e-46a7-9aae-4869e9d950a7 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:24.598445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1170/2343] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:24.602590 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a3c64-ede0-4559-834a-b720d3d30d36 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:24.612632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a3c64-ede0-4559-834a-b720d3d30d36 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:24.617315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68511dc4-86c0-4d8b-98ac-a62c7476e3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:24.617984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68511dc4-86c0-4d8b-98ac-a62c7476e3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:24.618312 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68511dc4-86c0-4d8b-98ac-a62c7476e3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:24.618593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68511dc4-86c0-4d8b-98ac-a62c7476e3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:24.619314 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68511dc4-86c0-4d8b-98ac-a62c7476e3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:24.620906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68511dc4-86c0-4d8b-98ac-a62c7476e3f3 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:24.631652 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1174/2344] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:24.635863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87edd78-999e-46a7-9aae-4869e9d950a7 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:24.646504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87edd78-999e-46a7-9aae-4869e9d950a7 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:24.651017 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2012992-e363-4d4c-9e3c-ab85edca77e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:24.651883 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2012992-e363-4d4c-9e3c-ab85edca77e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:24.652164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2012992-e363-4d4c-9e3c-ab85edca77e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:24.652430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2012992-e363-4d4c-9e3c-ab85edca77e0 admin admin] PATH_INFO: `/v3/projects/a731bffe41ae4c5782b82f14b1f43940/users/9ca666acf18846a18cdb19362ff4351d/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:24.668226 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2012992-e363-4d4c-9e3c-ab85edca77e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a731bffe41ae4c5782b82f14b1f43940, user_id=9ca666acf18846a18cdb19362ff4351d, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:24.670943 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2012992-e363-4d4c-9e3c-ab85edca77e0 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:24.703374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1171/2345] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:24 2022] PUT /identity/v3/projects/a731bffe41ae4c5782b82f14b1f43940/users/9ca666acf18846a18cdb19362ff4351d/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:24.716903 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b5fbf-6675-459a-930e-f8f6f580fa06 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:24.716903 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b5fbf-6675-459a-930e-f8f6f580fa06 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:24.716903 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b5fbf-6675-459a-930e-f8f6f580fa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:24.751754 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a15b5fbf-6675-459a-930e-f8f6f580fa06 None None] MFA Rules not processed for user `9ca666acf18846a18cdb19362ff4351d`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:24.753122 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a15b5fbf-6675-459a-930e-f8f6f580fa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:24.819287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1175/2346] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:44:24.823822 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2012992-e363-4d4c-9e3c-ab85edca77e0 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:24.886094 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2012992-e363-4d4c-9e3c-ab85edca77e0 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:24.890838 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae6eb4-521b-47fe-90be-900bec9535b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:24.891493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae6eb4-521b-47fe-90be-900bec9535b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:24.891772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae6eb4-521b-47fe-90be-900bec9535b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:24.892047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae6eb4-521b-47fe-90be-900bec9535b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:24.892738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae6eb4-521b-47fe-90be-900bec9535b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:24.894728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae6eb4-521b-47fe-90be-900bec9535b9 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:24.921268 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1172/2347] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:44:24 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:24.926400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b5fbf-6675-459a-930e-f8f6f580fa06 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:24.936709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b5fbf-6675-459a-930e-f8f6f580fa06 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:24.994220 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38505be1-d49e-41b6-9c4b-dab0b807b046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:24.994896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38505be1-d49e-41b6-9c4b-dab0b807b046 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:24.995201 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38505be1-d49e-41b6-9c4b-dab0b807b046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:24.995477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38505be1-d49e-41b6-9c4b-dab0b807b046 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:24.996177 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38505be1-d49e-41b6-9c4b-dab0b807b046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:24.998091 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38505be1-d49e-41b6-9c4b-dab0b807b046 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:25.023205 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1176/2348] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:44:24 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:25.024671 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae6eb4-521b-47fe-90be-900bec9535b9 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:25.035351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae6eb4-521b-47fe-90be-900bec9535b9 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:25.040221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88908df5-1ad6-4266-a2d1-9f27c1374a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:25.040967 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88908df5-1ad6-4266-a2d1-9f27c1374a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:25.041317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88908df5-1ad6-4266-a2d1-9f27c1374a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:25.041659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88908df5-1ad6-4266-a2d1-9f27c1374a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:25.042499 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88908df5-1ad6-4266-a2d1-9f27c1374a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:25.044169 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88908df5-1ad6-4266-a2d1-9f27c1374a93 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:25.055343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1173/2349] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:25.059577 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38505be1-d49e-41b6-9c4b-dab0b807b046 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:25.080330 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38505be1-d49e-41b6-9c4b-dab0b807b046 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:25.087138 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0eb9-790d-4d39-b654-58a3231d3d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:25.090138 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0eb9-790d-4d39-b654-58a3231d3d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:25.090532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0eb9-790d-4d39-b654-58a3231d3d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:25.090886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0eb9-790d-4d39-b654-58a3231d3d47 admin admin] PATH_INFO: `/v3/projects/1e3f6487c73c4b4390d8a18999326015/users/93b7ce7da7e14e708e34281e1ea43538/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:25.131484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0eb9-790d-4d39-b654-58a3231d3d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3f6487c73c4b4390d8a18999326015, user_id=93b7ce7da7e14e708e34281e1ea43538, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:25.135074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0eb9-790d-4d39-b654-58a3231d3d47 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:25.180716 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1177/2350] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:25 2022] PUT /identity/v3/projects/1e3f6487c73c4b4390d8a18999326015/users/93b7ce7da7e14e708e34281e1ea43538/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:25.185548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88908df5-1ad6-4266-a2d1-9f27c1374a93 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:25.209887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88908df5-1ad6-4266-a2d1-9f27c1374a93 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:25.324491 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a63ab9-84c1-47db-a497-48feb88d0fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:25.325351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a63ab9-84c1-47db-a497-48feb88d0fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:25.325743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a63ab9-84c1-47db-a497-48feb88d0fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:25.325973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a63ab9-84c1-47db-a497-48feb88d0fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:25.326903 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a63ab9-84c1-47db-a497-48feb88d0fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:25.328750 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a63ab9-84c1-47db-a497-48feb88d0fd3 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:25.340309 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1174/2351] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:25.344440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0eb9-790d-4d39-b654-58a3231d3d47 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:25.356807 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0eb9-790d-4d39-b654-58a3231d3d47 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:25.362556 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ca445-173b-4b31-a943-adb99e57ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:25.364448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ca445-173b-4b31-a943-adb99e57ebfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:25.364801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ca445-173b-4b31-a943-adb99e57ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:25.365142 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ca445-173b-4b31-a943-adb99e57ebfa admin admin] PATH_INFO: `/v3/projects/1e3f6487c73c4b4390d8a18999326015/users/93b7ce7da7e14e708e34281e1ea43538/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:25.368170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ca445-173b-4b31-a943-adb99e57ebfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3f6487c73c4b4390d8a18999326015, user_id=93b7ce7da7e14e708e34281e1ea43538, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:25.371785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ca445-173b-4b31-a943-adb99e57ebfa admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:25.383812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1178/2352] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:25 2022] PUT /identity/v3/projects/1e3f6487c73c4b4390d8a18999326015/users/93b7ce7da7e14e708e34281e1ea43538/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:25.395563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a311bc6-e6eb-4acc-8547-25c500922fd6 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:25.396046 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a311bc6-e6eb-4acc-8547-25c500922fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:25.396494 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a311bc6-e6eb-4acc-8547-25c500922fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:25.473634 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-6a311bc6-e6eb-4acc-8547-25c500922fd6 None None] MFA Rules not processed for user `93b7ce7da7e14e708e34281e1ea43538`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:25.475531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6a311bc6-e6eb-4acc-8547-25c500922fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:25.649045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1175/2353] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:25.662320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ca445-173b-4b31-a943-adb99e57ebfa admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:25.664415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f43ca445-173b-4b31-a943-adb99e57ebfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:25.802799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ca445-173b-4b31-a943-adb99e57ebfa admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:25.822786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040e9ed-7b46-45ba-9d5c-ccc24a4e1814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:25.823601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040e9ed-7b46-45ba-9d5c-ccc24a4e1814 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:25.823965 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040e9ed-7b46-45ba-9d5c-ccc24a4e1814 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:25.824964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040e9ed-7b46-45ba-9d5c-ccc24a4e1814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:25.929117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea796-9673-489e-967d-2f5a5b956bd7 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:25.930618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea796-9673-489e-967d-2f5a5b956bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:25.931053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea796-9673-489e-967d-2f5a5b956bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:25.953246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-899ea796-9673-489e-967d-2f5a5b956bd7 None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:25.954811 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-899ea796-9673-489e-967d-2f5a5b956bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:25.983603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040e9ed-7b46-45ba-9d5c-ccc24a4e1814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:25.983603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040e9ed-7b46-45ba-9d5c-ccc24a4e1814 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:26.010736 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1179/2354] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:44:26.053662 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1176/2355] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 5 15:44:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:44:26.131641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040e9ed-7b46-45ba-9d5c-ccc24a4e1814 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:26.134465 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9040e9ed-7b46-45ba-9d5c-ccc24a4e1814 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:26.228251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040e9ed-7b46-45ba-9d5c-ccc24a4e1814 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:26.236212 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b4028-e74a-4af2-af49-a4ead7888f9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:26.237413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b4028-e74a-4af2-af49-a4ead7888f9e service swift] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:26.238632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b4028-e74a-4af2-af49-a4ead7888f9e service swift] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:26.238943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b4028-e74a-4af2-af49-a4ead7888f9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:26.252587 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b4028-e74a-4af2-af49-a4ead7888f9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:26.254619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b4028-e74a-4af2-af49-a4ead7888f9e service swift] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:26.265871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1180/2356] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:44:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 15:44:28.624728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ea796-9673-489e-967d-2f5a5b956bd7 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:28.627457 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-899ea796-9673-489e-967d-2f5a5b956bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:28.733876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ea796-9673-489e-967d-2f5a5b956bd7 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:28.740460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9631c9-6e77-43ca-a413-0b903d6fd515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:28.741581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9631c9-6e77-43ca-a413-0b903d6fd515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:28.742038 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9631c9-6e77-43ca-a413-0b903d6fd515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:28.742335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9631c9-6e77-43ca-a413-0b903d6fd515 admin admin] PATH_INFO: `/v3/users/ea62366d13ca4431b6ef1649cac874ec` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:28.743730 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9631c9-6e77-43ca-a413-0b903d6fd515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea62366d13ca4431b6ef1649cac874ec)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:28.746042 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9631c9-6e77-43ca-a413-0b903d6fd515 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:28.817308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-4f9631c9-6e77-43ca-a413-0b903d6fd515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea62366d13ca4431b6ef1649cac874ec'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:28.818022 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-4f9631c9-6e77-43ca-a413-0b903d6fd515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea62366d13ca4431b6ef1649cac874ec'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:28.827856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-4f9631c9-6e77-43ca-a413-0b903d6fd515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea62366d13ca4431b6ef1649cac874ec'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:28.837963 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-4f9631c9-6e77-43ca-a413-0b903d6fd515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea62366d13ca4431b6ef1649cac874ec'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:28.839333 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-4f9631c9-6e77-43ca-a413-0b903d6fd515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea62366d13ca4431b6ef1649cac874ec'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:28.864612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1177/2357] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:44:28 2022] DELETE /identity/v3/users/ea62366d13ca4431b6ef1649cac874ec => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:28.869117 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277667c2-1479-4430-b00d-b22cce8cf360 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:28.869733 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277667c2-1479-4430-b00d-b22cce8cf360 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:28.869733 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277667c2-1479-4430-b00d-b22cce8cf360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:28.904251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-277667c2-1479-4430-b00d-b22cce8cf360 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:28.905647 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-277667c2-1479-4430-b00d-b22cce8cf360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:29.048685 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1181/2358] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:44:29.061239 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9631c9-6e77-43ca-a413-0b903d6fd515 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:29.062923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4f9631c9-6e77-43ca-a413-0b903d6fd515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:29.140570 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9631c9-6e77-43ca-a413-0b903d6fd515 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:29.144360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5db87-06a7-4091-9e1f-0360d857e5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:29.145011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5db87-06a7-4091-9e1f-0360d857e5fc service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:29.145288 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5db87-06a7-4091-9e1f-0360d857e5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:29.145624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5db87-06a7-4091-9e1f-0360d857e5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:29.155881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5db87-06a7-4091-9e1f-0360d857e5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:29.157415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5db87-06a7-4091-9e1f-0360d857e5fc service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:29.174964 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1178/2359] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:29.610825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277667c2-1479-4430-b00d-b22cce8cf360 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:29.613333 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-277667c2-1479-4430-b00d-b22cce8cf360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:29.645806 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277667c2-1479-4430-b00d-b22cce8cf360 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:29.654050 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:29.655480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:29.655871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:29.656309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34 admin admin] PATH_INFO: `/v3/projects/b4fd80b7aab340c58cc35c2fd0c6928d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:29.658058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4fd80b7aab340c58cc35c2fd0c6928d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:29.661680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:29.734951 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4fd80b7aab340c58cc35c2fd0c6928d', 'request_id': 'req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:29.747336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4fd80b7aab340c58cc35c2fd0c6928d', 'request_id': 'req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:29.758829 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4fd80b7aab340c58cc35c2fd0c6928d', 'request_id': 'req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:29.784214 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34 admin admin] The token cache is being invalidate because project b4fd80b7aab340c58cc35c2fd0c6928d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:44:29.786099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:29.786991 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:29.789932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1182/2360] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:44:29 2022] DELETE /identity/v3/projects/b4fd80b7aab340c58cc35c2fd0c6928d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:29.794023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5db87-06a7-4091-9e1f-0360d857e5fc service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:29.829334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5db87-06a7-4091-9e1f-0360d857e5fc service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:29.925763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da475ccc-bbc8-4246-a206-092162138ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:29.925763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da475ccc-bbc8-4246-a206-092162138ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:29.925763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da475ccc-bbc8-4246-a206-092162138ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:29.925763 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da475ccc-bbc8-4246-a206-092162138ae6 admin admin] PATH_INFO: `/v3/users/fd5695dab31b4e0590ff154bb3f03919` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:29.926362 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da475ccc-bbc8-4246-a206-092162138ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd5695dab31b4e0590ff154bb3f03919)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:29.926362 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da475ccc-bbc8-4246-a206-092162138ae6 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:30.027556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-da475ccc-bbc8-4246-a206-092162138ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd5695dab31b4e0590ff154bb3f03919'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:30.029268 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-da475ccc-bbc8-4246-a206-092162138ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd5695dab31b4e0590ff154bb3f03919'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:30.065824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-da475ccc-bbc8-4246-a206-092162138ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd5695dab31b4e0590ff154bb3f03919'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:30.078057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-da475ccc-bbc8-4246-a206-092162138ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd5695dab31b4e0590ff154bb3f03919'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:30.079043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-da475ccc-bbc8-4246-a206-092162138ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd5695dab31b4e0590ff154bb3f03919'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:30.106857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1179/2361] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:44:29 2022] DELETE /identity/v3/users/fd5695dab31b4e0590ff154bb3f03919 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:30.491261 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:30.494530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:30.542943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae4da1-3f0d-48c6-bad9-c93a00d17e34 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:30.632484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b29ee-32a9-42de-b895-b41b1f620910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:30.634505 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b29ee-32a9-42de-b895-b41b1f620910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:30.634992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b29ee-32a9-42de-b895-b41b1f620910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:30.635513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b29ee-32a9-42de-b895-b41b1f620910 admin admin] PATH_INFO: `/v3/projects/3c77a8e9d30f48f886520880333bb642` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:30.637485 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b29ee-32a9-42de-b895-b41b1f620910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c77a8e9d30f48f886520880333bb642)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:30.640454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b29ee-32a9-42de-b895-b41b1f620910 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:30.711172 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d15b29ee-32a9-42de-b895-b41b1f620910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c77a8e9d30f48f886520880333bb642', 'request_id': 'req-d15b29ee-32a9-42de-b895-b41b1f620910'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:30.717860 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d15b29ee-32a9-42de-b895-b41b1f620910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c77a8e9d30f48f886520880333bb642', 'request_id': 'req-d15b29ee-32a9-42de-b895-b41b1f620910'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:30.725336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d15b29ee-32a9-42de-b895-b41b1f620910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c77a8e9d30f48f886520880333bb642', 'request_id': 'req-d15b29ee-32a9-42de-b895-b41b1f620910'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:30.741786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d15b29ee-32a9-42de-b895-b41b1f620910 admin admin] The token cache is being invalidate because project 3c77a8e9d30f48f886520880333bb642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:44:30.742222 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d15b29ee-32a9-42de-b895-b41b1f620910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:30.750851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d15b29ee-32a9-42de-b895-b41b1f620910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:30.752615 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1183/2362] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:44:30 2022] DELETE /identity/v3/projects/3c77a8e9d30f48f886520880333bb642 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:30.757641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da475ccc-bbc8-4246-a206-092162138ae6 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:30.759025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-da475ccc-bbc8-4246-a206-092162138ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:30.779971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da475ccc-bbc8-4246-a206-092162138ae6 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:30.963694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1d032-c550-45fd-86cf-2bd7ec1992cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:30.964731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d032-c550-45fd-86cf-2bd7ec1992cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:30.965106 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d032-c550-45fd-86cf-2bd7ec1992cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:30.965618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d032-c550-45fd-86cf-2bd7ec1992cf admin admin] PATH_INFO: `/v3/users/2ee66790ffb841fa884905aeb52fc3eb` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:30.967582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1d032-c550-45fd-86cf-2bd7ec1992cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee66790ffb841fa884905aeb52fc3eb)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:30.970683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1d032-c550-45fd-86cf-2bd7ec1992cf admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:31.080332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b29ee-32a9-42de-b895-b41b1f620910 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:31.083433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d15b29ee-32a9-42de-b895-b41b1f620910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:31.103893 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f8d1d032-c550-45fd-86cf-2bd7ec1992cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee66790ffb841fa884905aeb52fc3eb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:31.105289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f8d1d032-c550-45fd-86cf-2bd7ec1992cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee66790ffb841fa884905aeb52fc3eb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:31.128368 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f8d1d032-c550-45fd-86cf-2bd7ec1992cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee66790ffb841fa884905aeb52fc3eb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:31.142005 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f8d1d032-c550-45fd-86cf-2bd7ec1992cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee66790ffb841fa884905aeb52fc3eb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:31.142780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f8d1d032-c550-45fd-86cf-2bd7ec1992cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee66790ffb841fa884905aeb52fc3eb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:31.176581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b29ee-32a9-42de-b895-b41b1f620910 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:31.181393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1180/2363] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:44:30 2022] DELETE /identity/v3/users/2ee66790ffb841fa884905aeb52fc3eb => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:31.247801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade4e9c-9f5b-4dae-97b5-4b1793caa9b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:31.248783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade4e9c-9f5b-4dae-97b5-4b1793caa9b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:31.248783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade4e9c-9f5b-4dae-97b5-4b1793caa9b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:31.249033 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade4e9c-9f5b-4dae-97b5-4b1793caa9b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:31.251180 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9ade4e9c-9f5b-4dae-97b5-4b1793caa9b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:31.372862 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade4e9c-9f5b-4dae-97b5-4b1793caa9b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:31.377186 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade4e9c-9f5b-4dae-97b5-4b1793caa9b9 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:31.399871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1184/2364] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:31.691116 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1d032-c550-45fd-86cf-2bd7ec1992cf admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:31.703733 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-f8d1d032-c550-45fd-86cf-2bd7ec1992cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:31.830554 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1d032-c550-45fd-86cf-2bd7ec1992cf admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:31.837482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdd680-2823-4d63-a875-6086bde4cf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:31.838966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdd680-2823-4d63-a875-6086bde4cf86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:31.839805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdd680-2823-4d63-a875-6086bde4cf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:31.840603 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdd680-2823-4d63-a875-6086bde4cf86 admin admin] PATH_INFO: `/v3/projects/ef591a056354488ca588fa6efb63951d` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:31.843185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdd680-2823-4d63-a875-6086bde4cf86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef591a056354488ca588fa6efb63951d)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:31.846188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdd680-2823-4d63-a875-6086bde4cf86 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:31.992991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-a0fdd680-2823-4d63-a875-6086bde4cf86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef591a056354488ca588fa6efb63951d', 'request_id': 'req-a0fdd680-2823-4d63-a875-6086bde4cf86'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:32.012415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-a0fdd680-2823-4d63-a875-6086bde4cf86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef591a056354488ca588fa6efb63951d', 'request_id': 'req-a0fdd680-2823-4d63-a875-6086bde4cf86'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:32.019759 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-a0fdd680-2823-4d63-a875-6086bde4cf86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef591a056354488ca588fa6efb63951d', 'request_id': 'req-a0fdd680-2823-4d63-a875-6086bde4cf86'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:32.042112 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-a0fdd680-2823-4d63-a875-6086bde4cf86 admin admin] The token cache is being invalidate because project ef591a056354488ca588fa6efb63951d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:44:32.042817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-a0fdd680-2823-4d63-a875-6086bde4cf86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:32.043704 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-a0fdd680-2823-4d63-a875-6086bde4cf86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:32.045803 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1181/2365] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:44:31 2022] DELETE /identity/v3/projects/ef591a056354488ca588fa6efb63951d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:36.696098 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade4e9c-9f5b-4dae-97b5-4b1793caa9b9 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:36.697837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9ade4e9c-9f5b-4dae-97b5-4b1793caa9b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:36.718909 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade4e9c-9f5b-4dae-97b5-4b1793caa9b9 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:36.801378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b86a7-2dc5-4af8-9a09-4b2848b77353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:36.802347 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b86a7-2dc5-4af8-9a09-4b2848b77353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:36.802633 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b86a7-2dc5-4af8-9a09-4b2848b77353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:36.802913 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b86a7-2dc5-4af8-9a09-4b2848b77353 admin admin] PATH_INFO: `/v3/users/9ca666acf18846a18cdb19362ff4351d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:36.804357 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b86a7-2dc5-4af8-9a09-4b2848b77353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca666acf18846a18cdb19362ff4351d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:36.806354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b86a7-2dc5-4af8-9a09-4b2848b77353 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:36.868504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-ce6b86a7-2dc5-4af8-9a09-4b2848b77353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca666acf18846a18cdb19362ff4351d'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:36.876155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-ce6b86a7-2dc5-4af8-9a09-4b2848b77353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca666acf18846a18cdb19362ff4351d'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:36.876907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-ce6b86a7-2dc5-4af8-9a09-4b2848b77353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca666acf18846a18cdb19362ff4351d'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:36.877530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-ce6b86a7-2dc5-4af8-9a09-4b2848b77353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca666acf18846a18cdb19362ff4351d'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:36.891513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-ce6b86a7-2dc5-4af8-9a09-4b2848b77353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca666acf18846a18cdb19362ff4351d'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:36.909531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1185/2366] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:44:36 2022] DELETE /identity/v3/users/9ca666acf18846a18cdb19362ff4351d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:36.914100 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d07ab-4f8b-4b68-a951-5d8040cf1008 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:36.914672 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d07ab-4f8b-4b68-a951-5d8040cf1008 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:36.914672 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d07ab-4f8b-4b68-a951-5d8040cf1008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:36.939265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-ea3d07ab-4f8b-4b68-a951-5d8040cf1008 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:36.940978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-ea3d07ab-4f8b-4b68-a951-5d8040cf1008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:37.013762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1182/2367] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:37.024819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b86a7-2dc5-4af8-9a09-4b2848b77353 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:37.026516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ce6b86a7-2dc5-4af8-9a09-4b2848b77353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:37.088853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b86a7-2dc5-4af8-9a09-4b2848b77353 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:37.092883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c491a0-a8ad-48fe-a836-892c308d3e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:37.093688 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c491a0-a8ad-48fe-a836-892c308d3e53 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:37.094117 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c491a0-a8ad-48fe-a836-892c308d3e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:37.094423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c491a0-a8ad-48fe-a836-892c308d3e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:37.104603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c491a0-a8ad-48fe-a836-892c308d3e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:37.106123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c491a0-a8ad-48fe-a836-892c308d3e53 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:37.119151 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1186/2368] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:37.765730 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d07ab-4f8b-4b68-a951-5d8040cf1008 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:37.769009 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-ea3d07ab-4f8b-4b68-a951-5d8040cf1008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:37.800601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d07ab-4f8b-4b68-a951-5d8040cf1008 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:37.809633 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68e12c-a1c8-4c4a-9249-114dd97fd069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:37.810547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68e12c-a1c8-4c4a-9249-114dd97fd069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:37.810827 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68e12c-a1c8-4c4a-9249-114dd97fd069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:37.811097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68e12c-a1c8-4c4a-9249-114dd97fd069 admin admin] PATH_INFO: `/v3/projects/a731bffe41ae4c5782b82f14b1f43940` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:37.812449 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68e12c-a1c8-4c4a-9249-114dd97fd069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a731bffe41ae4c5782b82f14b1f43940)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:37.814546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68e12c-a1c8-4c4a-9249-114dd97fd069 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:37.899909 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cb68e12c-a1c8-4c4a-9249-114dd97fd069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a731bffe41ae4c5782b82f14b1f43940', 'request_id': 'req-cb68e12c-a1c8-4c4a-9249-114dd97fd069'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:37.910835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cb68e12c-a1c8-4c4a-9249-114dd97fd069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a731bffe41ae4c5782b82f14b1f43940', 'request_id': 'req-cb68e12c-a1c8-4c4a-9249-114dd97fd069'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:37.924409 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cb68e12c-a1c8-4c4a-9249-114dd97fd069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a731bffe41ae4c5782b82f14b1f43940', 'request_id': 'req-cb68e12c-a1c8-4c4a-9249-114dd97fd069'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:37.949119 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cb68e12c-a1c8-4c4a-9249-114dd97fd069 admin admin] The token cache is being invalidate because project a731bffe41ae4c5782b82f14b1f43940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:44:37.949556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cb68e12c-a1c8-4c4a-9249-114dd97fd069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:37.950332 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cb68e12c-a1c8-4c4a-9249-114dd97fd069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:37.952594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1183/2369] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:44:37 2022] DELETE /identity/v3/projects/a731bffe41ae4c5782b82f14b1f43940 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:37.956898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c491a0-a8ad-48fe-a836-892c308d3e53 service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:37.969790 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c491a0-a8ad-48fe-a836-892c308d3e53 service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:38.046973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f717764-25f9-4129-ab38-7abc19f42710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:38.047775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f717764-25f9-4129-ab38-7abc19f42710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:38.048054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f717764-25f9-4129-ab38-7abc19f42710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:38.048555 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f717764-25f9-4129-ab38-7abc19f42710 admin admin] PATH_INFO: `/v3/users/93b7ce7da7e14e708e34281e1ea43538` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:38.049795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f717764-25f9-4129-ab38-7abc19f42710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b7ce7da7e14e708e34281e1ea43538)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:38.051868 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f717764-25f9-4129-ab38-7abc19f42710 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:38.121208 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8f717764-25f9-4129-ab38-7abc19f42710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b7ce7da7e14e708e34281e1ea43538'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:38.128428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8f717764-25f9-4129-ab38-7abc19f42710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b7ce7da7e14e708e34281e1ea43538'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:38.129123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8f717764-25f9-4129-ab38-7abc19f42710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b7ce7da7e14e708e34281e1ea43538'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:38.129725 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8f717764-25f9-4129-ab38-7abc19f42710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b7ce7da7e14e708e34281e1ea43538'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:38.141574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-8f717764-25f9-4129-ab38-7abc19f42710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b7ce7da7e14e708e34281e1ea43538'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:38.155271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1187/2370] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:44:37 2022] DELETE /identity/v3/users/93b7ce7da7e14e708e34281e1ea43538 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:38.432567 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68e12c-a1c8-4c4a-9249-114dd97fd069 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:38.434878 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-cb68e12c-a1c8-4c4a-9249-114dd97fd069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:38.454881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68e12c-a1c8-4c4a-9249-114dd97fd069 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:38.513336 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fe314-789a-42bf-90e8-4ad051151999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:38.514811 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fe314-789a-42bf-90e8-4ad051151999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:38.515307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fe314-789a-42bf-90e8-4ad051151999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:38.515728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fe314-789a-42bf-90e8-4ad051151999 admin admin] PATH_INFO: `/v3/projects/1e3f6487c73c4b4390d8a18999326015` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:38.517235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fe314-789a-42bf-90e8-4ad051151999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3f6487c73c4b4390d8a18999326015)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:38.519802 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fe314-789a-42bf-90e8-4ad051151999 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:38.565025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b22fe314-789a-42bf-90e8-4ad051151999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3f6487c73c4b4390d8a18999326015', 'request_id': 'req-b22fe314-789a-42bf-90e8-4ad051151999'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:38.570411 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b22fe314-789a-42bf-90e8-4ad051151999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3f6487c73c4b4390d8a18999326015', 'request_id': 'req-b22fe314-789a-42bf-90e8-4ad051151999'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:38.576507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b22fe314-789a-42bf-90e8-4ad051151999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3f6487c73c4b4390d8a18999326015', 'request_id': 'req-b22fe314-789a-42bf-90e8-4ad051151999'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:38.591130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b22fe314-789a-42bf-90e8-4ad051151999 admin admin] The token cache is being invalidate because project 1e3f6487c73c4b4390d8a18999326015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:44:38.591422 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b22fe314-789a-42bf-90e8-4ad051151999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:38.592050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-b22fe314-789a-42bf-90e8-4ad051151999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:38.593583 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1184/2371] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:44:38 2022] DELETE /identity/v3/projects/1e3f6487c73c4b4390d8a18999326015 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:44:38.601193 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7690292-c132-4573-9a48-d66ba44a34a3 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:38.601522 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7690292-c132-4573-9a48-d66ba44a34a3 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:38.601828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7690292-c132-4573-9a48-d66ba44a34a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:38.634082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d7690292-c132-4573-9a48-d66ba44a34a3 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:38.635775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d7690292-c132-4573-9a48-d66ba44a34a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:38.729358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1188/2372] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:38.731248 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4f7c-9170-4bf5-becd-aa06cdd12a8f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:38.732166 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4f7c-9170-4bf5-becd-aa06cdd12a8f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:38.732452 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4f7c-9170-4bf5-becd-aa06cdd12a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:38.753186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-066d4f7c-9170-4bf5-becd-aa06cdd12a8f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:38.754624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-066d4f7c-9170-4bf5-becd-aa06cdd12a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:38.763121 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1185/2373] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:38.767156 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7690292-c132-4573-9a48-d66ba44a34a3 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:38.778591 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7690292-c132-4573-9a48-d66ba44a34a3 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:38.784496 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09b970-d9dc-452c-9c4c-5738709ab7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:38.785169 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09b970-d9dc-452c-9c4c-5738709ab7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:38.785449 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09b970-d9dc-452c-9c4c-5738709ab7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:38.785726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09b970-d9dc-452c-9c4c-5738709ab7c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:38.786506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09b970-d9dc-452c-9c4c-5738709ab7c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:44:38.786806 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09b970-d9dc-452c-9c4c-5738709ab7c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:38.788414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09b970-d9dc-452c-9c4c-5738709ab7c6 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:38.805496 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d4f7c-9170-4bf5-becd-aa06cdd12a8f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:38.807877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1189/2374] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:44:38.816256 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d4f7c-9170-4bf5-becd-aa06cdd12a8f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:38.821284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14a5f5-36b6-49d5-b8f6-058ae6e0feea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:38.822059 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14a5f5-36b6-49d5-b8f6-058ae6e0feea admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:38.822461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14a5f5-36b6-49d5-b8f6-058ae6e0feea admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:38.822832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14a5f5-36b6-49d5-b8f6-058ae6e0feea admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:38.823629 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14a5f5-36b6-49d5-b8f6-058ae6e0feea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:38.825873 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14a5f5-36b6-49d5-b8f6-058ae6e0feea admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:38.851898 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1186/2375] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:44:38 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:38.856120 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09b970-d9dc-452c-9c4c-5738709ab7c6 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:38.866635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09b970-d9dc-452c-9c4c-5738709ab7c6 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:38.920776 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd514c16-f1b0-46ea-999c-6ca775ca884b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:38.921464 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd514c16-f1b0-46ea-999c-6ca775ca884b admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:38.921748 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd514c16-f1b0-46ea-999c-6ca775ca884b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:38.922022 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd514c16-f1b0-46ea-999c-6ca775ca884b admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:38.922745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd514c16-f1b0-46ea-999c-6ca775ca884b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:38.924734 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd514c16-f1b0-46ea-999c-6ca775ca884b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:38.945721 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1190/2376] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:44:38 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:38.948450 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14a5f5-36b6-49d5-b8f6-058ae6e0feea admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:38.959683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14a5f5-36b6-49d5-b8f6-058ae6e0feea admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:38.964269 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b71342-063b-4a87-9e18-b524107043c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:38.964919 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b71342-063b-4a87-9e18-b524107043c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:38.965204 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b71342-063b-4a87-9e18-b524107043c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:38.965481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b71342-063b-4a87-9e18-b524107043c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:38.966511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b71342-063b-4a87-9e18-b524107043c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:38.968087 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b71342-063b-4a87-9e18-b524107043c3 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:38.978252 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1187/2377] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:38.982094 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd514c16-f1b0-46ea-999c-6ca775ca884b admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:38.991812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd514c16-f1b0-46ea-999c-6ca775ca884b admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:38.996385 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800009f-e945-4699-a58d-15fd780c4166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:38.997027 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800009f-e945-4699-a58d-15fd780c4166 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:38.997306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800009f-e945-4699-a58d-15fd780c4166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:38.997579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800009f-e945-4699-a58d-15fd780c4166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:38.998330 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800009f-e945-4699-a58d-15fd780c4166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:38.999896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800009f-e945-4699-a58d-15fd780c4166 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:39.009906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1191/2378] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:39.013799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b71342-063b-4a87-9e18-b524107043c3 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:39.023678 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b71342-063b-4a87-9e18-b524107043c3 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:39.028215 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d264bdd-c9f8-4162-9690-dcf726cbde1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:39.029145 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d264bdd-c9f8-4162-9690-dcf726cbde1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:39.029510 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d264bdd-c9f8-4162-9690-dcf726cbde1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:39.029784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d264bdd-c9f8-4162-9690-dcf726cbde1a admin admin] PATH_INFO: `/v3/projects/ed67db8258f7475ba1573b790862fffd/users/1ac63be14e6b479182b0eff0d1e1f31c/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:39.045051 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d264bdd-c9f8-4162-9690-dcf726cbde1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed67db8258f7475ba1573b790862fffd, user_id=1ac63be14e6b479182b0eff0d1e1f31c, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:39.047801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d264bdd-c9f8-4162-9690-dcf726cbde1a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:39.061396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1188/2379] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:39 2022] PUT /identity/v3/projects/ed67db8258f7475ba1573b790862fffd/users/1ac63be14e6b479182b0eff0d1e1f31c/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:39.073515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879b932-2199-449d-8172-c13b4fd17347 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:39.073743 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879b932-2199-449d-8172-c13b4fd17347 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:39.074051 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879b932-2199-449d-8172-c13b4fd17347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:39.101466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b879b932-2199-449d-8172-c13b4fd17347 None None] MFA Rules not processed for user `1ac63be14e6b479182b0eff0d1e1f31c`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:39.102762 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b879b932-2199-449d-8172-c13b4fd17347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:39.166003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1192/2380] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:39.176880 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d264bdd-c9f8-4162-9690-dcf726cbde1a admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:39.178597 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4d264bdd-c9f8-4162-9690-dcf726cbde1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:39.234562 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d264bdd-c9f8-4162-9690-dcf726cbde1a admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:39.238430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018bbc6-4478-4213-9434-0937dac858dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:39.239066 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018bbc6-4478-4213-9434-0937dac858dd service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:39.239343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018bbc6-4478-4213-9434-0937dac858dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:39.239617 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018bbc6-4478-4213-9434-0937dac858dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:39.248140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018bbc6-4478-4213-9434-0937dac858dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:39.249600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018bbc6-4478-4213-9434-0937dac858dd service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:39.258664 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1189/2381] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:41.552298 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879b932-2199-449d-8172-c13b4fd17347 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:41.553933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b879b932-2199-449d-8172-c13b4fd17347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:41.615167 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879b932-2199-449d-8172-c13b4fd17347 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:41.618816 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bb3a1-be28-4c10-b79e-9604292fa283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:41.619466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bb3a1-be28-4c10-b79e-9604292fa283 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:41.619920 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bb3a1-be28-4c10-b79e-9604292fa283 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:41.620380 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bb3a1-be28-4c10-b79e-9604292fa283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:41.622192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-644bb3a1-be28-4c10-b79e-9604292fa283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:41.701814 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644bb3a1-be28-4c10-b79e-9604292fa283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:41.703121 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644bb3a1-be28-4c10-b79e-9604292fa283 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:41.714609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1193/2382] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:44:51.500446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22029af1-2657-46f0-bdd2-241476f7cff4 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:51.501079 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22029af1-2657-46f0-bdd2-241476f7cff4 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:51.501187 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22029af1-2657-46f0-bdd2-241476f7cff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:51.522190 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-22029af1-2657-46f0-bdd2-241476f7cff4 None None] MFA Rules not processed for user `4b161aa0d704420baaedf64d635f85ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:51.524184 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-22029af1-2657-46f0-bdd2-241476f7cff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:51.611601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1190/2383] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:54.196692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bb3a1-be28-4c10-b79e-9604292fa283 service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:54.281085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bb3a1-be28-4c10-b79e-9604292fa283 service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:54.286745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99560b6-b446-4c32-9c1b-11bdbac9bd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:54.287977 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99560b6-b446-4c32-9c1b-11bdbac9bd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:54.288807 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99560b6-b446-4c32-9c1b-11bdbac9bd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:54.289313 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99560b6-b446-4c32-9c1b-11bdbac9bd7e admin admin] PATH_INFO: `/v3/users/1ac63be14e6b479182b0eff0d1e1f31c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:54.290835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99560b6-b446-4c32-9c1b-11bdbac9bd7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac63be14e6b479182b0eff0d1e1f31c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:54.293070 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99560b6-b446-4c32-9c1b-11bdbac9bd7e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:54.367671 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c99560b6-b446-4c32-9c1b-11bdbac9bd7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac63be14e6b479182b0eff0d1e1f31c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:54.376201 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c99560b6-b446-4c32-9c1b-11bdbac9bd7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac63be14e6b479182b0eff0d1e1f31c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:54.377721 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c99560b6-b446-4c32-9c1b-11bdbac9bd7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac63be14e6b479182b0eff0d1e1f31c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:54.378533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c99560b6-b446-4c32-9c1b-11bdbac9bd7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac63be14e6b479182b0eff0d1e1f31c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:54.399114 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c99560b6-b446-4c32-9c1b-11bdbac9bd7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac63be14e6b479182b0eff0d1e1f31c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:54.429690 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1194/2384] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:44:54 2022] DELETE /identity/v3/users/1ac63be14e6b479182b0eff0d1e1f31c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:54.434700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63d2c9-cced-4f7e-893d-344c77d9dea8 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:54.438997 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63d2c9-cced-4f7e-893d-344c77d9dea8 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:54.439984 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63d2c9-cced-4f7e-893d-344c77d9dea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:54.477426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-bd63d2c9-cced-4f7e-893d-344c77d9dea8 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:54.478714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bd63d2c9-cced-4f7e-893d-344c77d9dea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:54.560970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1191/2385] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:54.572251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99560b6-b446-4c32-9c1b-11bdbac9bd7e admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:54.579216 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c99560b6-b446-4c32-9c1b-11bdbac9bd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:54.662812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99560b6-b446-4c32-9c1b-11bdbac9bd7e admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:54.667229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1531b-84d7-47dd-a5db-65ddb471d182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:54.667907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1531b-84d7-47dd-a5db-65ddb471d182 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:54.668258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1531b-84d7-47dd-a5db-65ddb471d182 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:54.668651 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1531b-84d7-47dd-a5db-65ddb471d182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:54.679469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1531b-84d7-47dd-a5db-65ddb471d182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:54.680929 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1531b-84d7-47dd-a5db-65ddb471d182 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:54.692420 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1195/2386] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:44:54.988602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63d2c9-cced-4f7e-893d-344c77d9dea8 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:54.990129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bd63d2c9-cced-4f7e-893d-344c77d9dea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:55.002587 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63d2c9-cced-4f7e-893d-344c77d9dea8 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:55.009748 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354228d1-dafe-4696-8b81-185cec63499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:55.010844 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354228d1-dafe-4696-8b81-185cec63499e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:55.011273 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354228d1-dafe-4696-8b81-185cec63499e admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:55.011700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354228d1-dafe-4696-8b81-185cec63499e admin admin] PATH_INFO: `/v3/projects/ed67db8258f7475ba1573b790862fffd` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:55.013473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354228d1-dafe-4696-8b81-185cec63499e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed67db8258f7475ba1573b790862fffd)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:55.016438 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354228d1-dafe-4696-8b81-185cec63499e admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:55.091881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-354228d1-dafe-4696-8b81-185cec63499e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed67db8258f7475ba1573b790862fffd', 'request_id': 'req-354228d1-dafe-4696-8b81-185cec63499e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:55.099974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-354228d1-dafe-4696-8b81-185cec63499e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed67db8258f7475ba1573b790862fffd', 'request_id': 'req-354228d1-dafe-4696-8b81-185cec63499e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:55.108528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-354228d1-dafe-4696-8b81-185cec63499e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed67db8258f7475ba1573b790862fffd', 'request_id': 'req-354228d1-dafe-4696-8b81-185cec63499e'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:55.145501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-354228d1-dafe-4696-8b81-185cec63499e admin admin] The token cache is being invalidate because project ed67db8258f7475ba1573b790862fffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:44:55.145796 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-354228d1-dafe-4696-8b81-185cec63499e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:55.146981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-354228d1-dafe-4696-8b81-185cec63499e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:55.153210 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1192/2387] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:44:54 2022] DELETE /identity/v3/projects/ed67db8258f7475ba1573b790862fffd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:44:55.161670 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a546e8-83c6-4147-a056-af83a7ad2d1a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:55.161981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a546e8-83c6-4147-a056-af83a7ad2d1a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:55.162368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a546e8-83c6-4147-a056-af83a7ad2d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:55.184753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-26a546e8-83c6-4147-a056-af83a7ad2d1a None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:55.186317 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-26a546e8-83c6-4147-a056-af83a7ad2d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:55.203923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bea8d-585d-4b76-ba3a-547bd77afe30 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:55.204536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bea8d-585d-4b76-ba3a-547bd77afe30 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:55.205717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bea8d-585d-4b76-ba3a-547bd77afe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:55.239920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-2b7bea8d-585d-4b76-ba3a-547bd77afe30 None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:55.241149 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-2b7bea8d-585d-4b76-ba3a-547bd77afe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:55.257261 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1196/2388] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:55.265001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab1788-0f19-4f67-85d1-904798947b6d None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:55.265318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab1788-0f19-4f67-85d1-904798947b6d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:55.265600 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab1788-0f19-4f67-85d1-904798947b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:55.289173 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ccab1788-0f19-4f67-85d1-904798947b6d None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:55.290915 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ccab1788-0f19-4f67-85d1-904798947b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:55.301297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1197/2389] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:44:55.305640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab1788-0f19-4f67-85d1-904798947b6d None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:55.316959 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab1788-0f19-4f67-85d1-904798947b6d None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:55.322306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1d6ef-092c-4c71-a5dc-eb20951a2a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:55.323074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1d6ef-092c-4c71-a5dc-eb20951a2a6a admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:55.323429 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1d6ef-092c-4c71-a5dc-eb20951a2a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:55.323774 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1d6ef-092c-4c71-a5dc-eb20951a2a6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:55.324695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1193/2390] 10.222.0.58 () {58 vars in 967 bytes} [Thu May 5 15:44:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:44:55.324815 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1d6ef-092c-4c71-a5dc-eb20951a2a6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:44:55.325775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1d6ef-092c-4c71-a5dc-eb20951a2a6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:55.328137 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1d6ef-092c-4c71-a5dc-eb20951a2a6a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:55.345262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bea8d-585d-4b76-ba3a-547bd77afe30 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:55.350650 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-2b7bea8d-585d-4b76-ba3a-547bd77afe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:55.350839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1198/2391] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:44:55.355785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1d6ef-092c-4c71-a5dc-eb20951a2a6a admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:55.379318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1d6ef-092c-4c71-a5dc-eb20951a2a6a admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:55.385763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04863e-37eb-43ae-80b8-dd478b322040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:55.387348 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04863e-37eb-43ae-80b8-dd478b322040 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:55.387796 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04863e-37eb-43ae-80b8-dd478b322040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:55.388655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04863e-37eb-43ae-80b8-dd478b322040 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:55.390393 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04863e-37eb-43ae-80b8-dd478b322040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:55.393835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04863e-37eb-43ae-80b8-dd478b322040 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:55.437891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1199/2392] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:44:55 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:44:55.442056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04863e-37eb-43ae-80b8-dd478b322040 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:55.446917 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bea8d-585d-4b76-ba3a-547bd77afe30 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:55.540412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd0d2e-5ab0-45e4-9d65-d920e9d1ba9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:55.541073 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd0d2e-5ab0-45e4-9d65-d920e9d1ba9b service swift] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:55.541553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd0d2e-5ab0-45e4-9d65-d920e9d1ba9b service swift] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:55.541980 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd0d2e-5ab0-45e4-9d65-d920e9d1ba9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:55.546431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04863e-37eb-43ae-80b8-dd478b322040 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:55.552625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef02b7-8122-40b6-a4d9-86344fefc1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:55.553402 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef02b7-8122-40b6-a4d9-86344fefc1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:55.553691 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef02b7-8122-40b6-a4d9-86344fefc1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:55.554829 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef02b7-8122-40b6-a4d9-86344fefc1d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:55.555907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef02b7-8122-40b6-a4d9-86344fefc1d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:55.558539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef02b7-8122-40b6-a4d9-86344fefc1d6 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:55.584557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1200/2393] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:44:55 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:55.588740 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef02b7-8122-40b6-a4d9-86344fefc1d6 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:55.599908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef02b7-8122-40b6-a4d9-86344fefc1d6 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:55.605698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16702fb-aaa8-4127-b172-c3f757d976e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:55.606418 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16702fb-aaa8-4127-b172-c3f757d976e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:55.606701 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16702fb-aaa8-4127-b172-c3f757d976e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:55.606973 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16702fb-aaa8-4127-b172-c3f757d976e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:55.607692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16702fb-aaa8-4127-b172-c3f757d976e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:55.609329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16702fb-aaa8-4127-b172-c3f757d976e7 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:55.613105 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd0d2e-5ab0-45e4-9d65-d920e9d1ba9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:55.614924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd0d2e-5ab0-45e4-9d65-d920e9d1ba9b service swift] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:55.620946 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1201/2394] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:55.624653 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16702fb-aaa8-4127-b172-c3f757d976e7 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:55.628449 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1194/2395] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:44:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:44:55.636376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16702fb-aaa8-4127-b172-c3f757d976e7 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:55.643966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93bd8e-ba41-4a67-9a19-3faf46391173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:55.644777 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93bd8e-ba41-4a67-9a19-3faf46391173 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:55.645160 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93bd8e-ba41-4a67-9a19-3faf46391173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:55.645530 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93bd8e-ba41-4a67-9a19-3faf46391173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:55.646398 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93bd8e-ba41-4a67-9a19-3faf46391173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:55.648414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93bd8e-ba41-4a67-9a19-3faf46391173 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:55.666793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1202/2396] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:44:55.668776 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd0d2e-5ab0-45e4-9d65-d920e9d1ba9b service swift] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:55.691405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd0d2e-5ab0-45e4-9d65-d920e9d1ba9b service swift] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:55.699334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574baeb-a267-41f6-85d8-ba26576d4850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:55.700228 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574baeb-a267-41f6-85d8-ba26576d4850 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:55.700507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574baeb-a267-41f6-85d8-ba26576d4850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:55.700771 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574baeb-a267-41f6-85d8-ba26576d4850 admin admin] PATH_INFO: `/v3/projects/63eb128493f149f79635d4d840f1d395/users/624862e882b243c6a6fca5596921da59/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:55.718549 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574baeb-a267-41f6-85d8-ba26576d4850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63eb128493f149f79635d4d840f1d395, user_id=624862e882b243c6a6fca5596921da59, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:55.721334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574baeb-a267-41f6-85d8-ba26576d4850 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:55.734990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1195/2397] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:55 2022] PUT /identity/v3/projects/63eb128493f149f79635d4d840f1d395/users/624862e882b243c6a6fca5596921da59/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:55.746738 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e34ee-9e67-4d52-838c-a11d62388ac7 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:55.747035 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e34ee-9e67-4d52-838c-a11d62388ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:55.747335 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e34ee-9e67-4d52-838c-a11d62388ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:55.776593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-0e6e34ee-9e67-4d52-838c-a11d62388ac7 None None] MFA Rules not processed for user `624862e882b243c6a6fca5596921da59`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:55.777771 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0e6e34ee-9e67-4d52-838c-a11d62388ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:55.866349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1203/2398] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:55.879774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574baeb-a267-41f6-85d8-ba26576d4850 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:55.881859 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c574baeb-a267-41f6-85d8-ba26576d4850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:55.975902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574baeb-a267-41f6-85d8-ba26576d4850 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:55.982901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035c232-6f11-49ee-ae6d-726fe83d4775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:55.983943 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035c232-6f11-49ee-ae6d-726fe83d4775 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:55.984459 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035c232-6f11-49ee-ae6d-726fe83d4775 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:55.985060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035c232-6f11-49ee-ae6d-726fe83d4775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:55.996533 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035c232-6f11-49ee-ae6d-726fe83d4775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:55.997972 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035c232-6f11-49ee-ae6d-726fe83d4775 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:56.008423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1196/2399] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:44:57.411930 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3261524-c9af-4965-8e45-6fb114d8c073 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:57.412431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3261524-c9af-4965-8e45-6fb114d8c073 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:57.412611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3261524-c9af-4965-8e45-6fb114d8c073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:57.429788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d3261524-c9af-4965-8e45-6fb114d8c073 None None] MFA Rules not processed for user `624862e882b243c6a6fca5596921da59`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:57.431125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d3261524-c9af-4965-8e45-6fb114d8c073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:57.439540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1204/2400] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:57.847773 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035c232-6f11-49ee-ae6d-726fe83d4775 service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:57.849375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-1035c232-6f11-49ee-ae6d-726fe83d4775 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:57.916834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035c232-6f11-49ee-ae6d-726fe83d4775 service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:57.921576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9ba88-9130-4153-bf30-6ed300cfb97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:57.922514 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9ba88-9130-4153-bf30-6ed300cfb97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:57.922801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9ba88-9130-4153-bf30-6ed300cfb97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:57.923075 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9ba88-9130-4153-bf30-6ed300cfb97a admin admin] PATH_INFO: `/v3/users/d161fa00a7ee48a8a8bb77fe72ad87ba` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:57.924281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9ba88-9130-4153-bf30-6ed300cfb97a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d161fa00a7ee48a8a8bb77fe72ad87ba)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:57.926209 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9ba88-9130-4153-bf30-6ed300cfb97a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:57.974377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1fd9ba88-9130-4153-bf30-6ed300cfb97a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd161fa00a7ee48a8a8bb77fe72ad87ba'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:57.975176 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1fd9ba88-9130-4153-bf30-6ed300cfb97a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd161fa00a7ee48a8a8bb77fe72ad87ba'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:57.983306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1fd9ba88-9130-4153-bf30-6ed300cfb97a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd161fa00a7ee48a8a8bb77fe72ad87ba'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:57.990892 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1fd9ba88-9130-4153-bf30-6ed300cfb97a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd161fa00a7ee48a8a8bb77fe72ad87ba'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:57.991526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1fd9ba88-9130-4153-bf30-6ed300cfb97a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd161fa00a7ee48a8a8bb77fe72ad87ba'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:58.009261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1197/2401] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:44:57 2022] DELETE /identity/v3/users/d161fa00a7ee48a8a8bb77fe72ad87ba => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:58.286346 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3261524-c9af-4965-8e45-6fb114d8c073 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:58.303335 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3261524-c9af-4965-8e45-6fb114d8c073 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:58.370131 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652bd47-7b57-4f32-a703-ab692d35da7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:58.371133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652bd47-7b57-4f32-a703-ab692d35da7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:58.371501 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652bd47-7b57-4f32-a703-ab692d35da7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:58.371711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652bd47-7b57-4f32-a703-ab692d35da7a admin admin] PATH_INFO: `/v3/projects/d4e49eb80f604a5cb27b5f86788302f0` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:58.372937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652bd47-7b57-4f32-a703-ab692d35da7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4e49eb80f604a5cb27b5f86788302f0)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:58.375014 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652bd47-7b57-4f32-a703-ab692d35da7a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:58.425981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4652bd47-7b57-4f32-a703-ab692d35da7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4e49eb80f604a5cb27b5f86788302f0', 'request_id': 'req-4652bd47-7b57-4f32-a703-ab692d35da7a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:58.432145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4652bd47-7b57-4f32-a703-ab692d35da7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4e49eb80f604a5cb27b5f86788302f0', 'request_id': 'req-4652bd47-7b57-4f32-a703-ab692d35da7a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:58.438342 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4652bd47-7b57-4f32-a703-ab692d35da7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4e49eb80f604a5cb27b5f86788302f0', 'request_id': 'req-4652bd47-7b57-4f32-a703-ab692d35da7a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:58.451408 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4652bd47-7b57-4f32-a703-ab692d35da7a admin admin] The token cache is being invalidate because project d4e49eb80f604a5cb27b5f86788302f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:44:58.451948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4652bd47-7b57-4f32-a703-ab692d35da7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:58.452770 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4652bd47-7b57-4f32-a703-ab692d35da7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:44:58.454837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1205/2402] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:44:58 2022] DELETE /identity/v3/projects/d4e49eb80f604a5cb27b5f86788302f0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:58.460681 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c0dbe-6509-4174-91bf-30514a6bb2a3 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:58.461174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c0dbe-6509-4174-91bf-30514a6bb2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:58.461694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c0dbe-6509-4174-91bf-30514a6bb2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:58.481722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-ca7c0dbe-6509-4174-91bf-30514a6bb2a3 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:58.483595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-ca7c0dbe-6509-4174-91bf-30514a6bb2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:58.546260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1198/2403] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:44:58.555151 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9170e-72e5-4457-8a18-ff62f77b68fb None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:58.555439 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9170e-72e5-4457-8a18-ff62f77b68fb None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:58.555717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9170e-72e5-4457-8a18-ff62f77b68fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:58.574137 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-bbc9170e-72e5-4457-8a18-ff62f77b68fb None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:58.575523 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-bbc9170e-72e5-4457-8a18-ff62f77b68fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:58.585205 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1206/2404] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:58.589126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c0dbe-6509-4174-91bf-30514a6bb2a3 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:58.600267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c0dbe-6509-4174-91bf-30514a6bb2a3 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:58.605155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a58fba-7c5f-4cfc-ba1a-c2090c91d7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:58.605915 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a58fba-7c5f-4cfc-ba1a-c2090c91d7ca admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:58.606424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a58fba-7c5f-4cfc-ba1a-c2090c91d7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:58.606740 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a58fba-7c5f-4cfc-ba1a-c2090c91d7ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:58.607658 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a58fba-7c5f-4cfc-ba1a-c2090c91d7ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:44:58.607929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a58fba-7c5f-4cfc-ba1a-c2090c91d7ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:58.609570 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a58fba-7c5f-4cfc-ba1a-c2090c91d7ca admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:58.623484 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1199/2405] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:44:58.628192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9170e-72e5-4457-8a18-ff62f77b68fb None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:58.637388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9170e-72e5-4457-8a18-ff62f77b68fb None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:58.643052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac162a-8a18-4f85-99b0-fcbc10277a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:58.643704 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac162a-8a18-4f85-99b0-fcbc10277a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:58.643979 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac162a-8a18-4f85-99b0-fcbc10277a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:58.644249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac162a-8a18-4f85-99b0-fcbc10277a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:58.644930 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac162a-8a18-4f85-99b0-fcbc10277a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:58.646895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac162a-8a18-4f85-99b0-fcbc10277a61 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:58.676819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1207/2406] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:44:58 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:58.680938 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a58fba-7c5f-4cfc-ba1a-c2090c91d7ca admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:58.692107 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a58fba-7c5f-4cfc-ba1a-c2090c91d7ca admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:58.768261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa2ccb-49ec-44e2-bf4b-b3646420a456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:58.769353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2ccb-49ec-44e2-bf4b-b3646420a456 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:58.769843 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2ccb-49ec-44e2-bf4b-b3646420a456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:58.770133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2ccb-49ec-44e2-bf4b-b3646420a456 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:58.771008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa2ccb-49ec-44e2-bf4b-b3646420a456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:58.773026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa2ccb-49ec-44e2-bf4b-b3646420a456 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:58.799100 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1200/2407] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:44:58 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:44:58.800444 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac162a-8a18-4f85-99b0-fcbc10277a61 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:58.810480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac162a-8a18-4f85-99b0-fcbc10277a61 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:58.815192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f34bb-0c5d-4dc0-93ca-c0bcd2e4f94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:58.815852 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f34bb-0c5d-4dc0-93ca-c0bcd2e4f94d admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:58.816134 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f34bb-0c5d-4dc0-93ca-c0bcd2e4f94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:58.816417 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f34bb-0c5d-4dc0-93ca-c0bcd2e4f94d admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:58.817152 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f34bb-0c5d-4dc0-93ca-c0bcd2e4f94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:58.818806 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f34bb-0c5d-4dc0-93ca-c0bcd2e4f94d admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:58.829328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1208/2408] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:58.833829 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa2ccb-49ec-44e2-bf4b-b3646420a456 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:58.844153 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa2ccb-49ec-44e2-bf4b-b3646420a456 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:58.849516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d66f11-ecbb-43c2-b8c7-21f60d0d29b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:58.850200 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d66f11-ecbb-43c2-b8c7-21f60d0d29b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:58.850492 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d66f11-ecbb-43c2-b8c7-21f60d0d29b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:58.850797 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d66f11-ecbb-43c2-b8c7-21f60d0d29b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:58.851515 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d66f11-ecbb-43c2-b8c7-21f60d0d29b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:58.853142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d66f11-ecbb-43c2-b8c7-21f60d0d29b9 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:58.863914 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1201/2409] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:44:58.868237 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f34bb-0c5d-4dc0-93ca-c0bcd2e4f94d admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:58.879218 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f34bb-0c5d-4dc0-93ca-c0bcd2e4f94d admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:58.884149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b4c20-2625-440d-a6a1-ccd59453c89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:58.885054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b4c20-2625-440d-a6a1-ccd59453c89e admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:58.885319 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b4c20-2625-440d-a6a1-ccd59453c89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:58.885698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b4c20-2625-440d-a6a1-ccd59453c89e admin admin] PATH_INFO: `/v3/projects/1eecd6b87f2b4e658945796fd234715f/users/ad2ce1d9df53427c9147fa5e7fdf12bb/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:58.901222 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b4c20-2625-440d-a6a1-ccd59453c89e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eecd6b87f2b4e658945796fd234715f, user_id=ad2ce1d9df53427c9147fa5e7fdf12bb, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:58.903943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b4c20-2625-440d-a6a1-ccd59453c89e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:58.918286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1209/2410] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:44:58 2022] PUT /identity/v3/projects/1eecd6b87f2b4e658945796fd234715f/users/ad2ce1d9df53427c9147fa5e7fdf12bb/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:44:58.928266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca06fd8-5aae-406d-80d7-06e779d23105 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:58.928487 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca06fd8-5aae-406d-80d7-06e779d23105 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:58.928746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca06fd8-5aae-406d-80d7-06e779d23105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:58.955685 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-bca06fd8-5aae-406d-80d7-06e779d23105 None None] MFA Rules not processed for user `ad2ce1d9df53427c9147fa5e7fdf12bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:44:58.956921 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bca06fd8-5aae-406d-80d7-06e779d23105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:59.021942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1202/2411] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:44:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:44:59.033087 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b4c20-2625-440d-a6a1-ccd59453c89e admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:44:59.034803 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-088b4c20-2625-440d-a6a1-ccd59453c89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:44:59.097788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b4c20-2625-440d-a6a1-ccd59453c89e admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:44:59.103806 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62573e-f9a9-4310-b105-7b7f773bf45f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab6c13dc02ba49d0be523fa9a73fdf5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:44:59.105311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62573e-f9a9-4310-b105-7b7f773bf45f service glance] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:44:59.105613 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62573e-f9a9-4310-b105-7b7f773bf45f service glance] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:44:59.105891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62573e-f9a9-4310-b105-7b7f773bf45f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:44:59.120980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62573e-f9a9-4310-b105-7b7f773bf45f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:44:59.122629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62573e-f9a9-4310-b105-7b7f773bf45f service glance] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:44:59.133381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1210/2412] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:44:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:45:11.473919 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66295380-b46e-421f-b96c-6a958da5ed49 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:11.474440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66295380-b46e-421f-b96c-6a958da5ed49 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:11.474546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66295380-b46e-421f-b96c-6a958da5ed49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:11.492026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-66295380-b46e-421f-b96c-6a958da5ed49 None None] MFA Rules not processed for user `ac454c6b807842ba821a9087f1cf4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:45:11.493198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-66295380-b46e-421f-b96c-6a958da5ed49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:11.547462 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1203/2413] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:45:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:45:12.169869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62573e-f9a9-4310-b105-7b7f773bf45f service glance] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:12.171860 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ac62573e-f9a9-4310-b105-7b7f773bf45f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:12.260942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62573e-f9a9-4310-b105-7b7f773bf45f service glance] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:12.264994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a90e0-b956-4407-a529-c42479061aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:12.265635 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a90e0-b956-4407-a529-c42479061aba service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:12.265910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a90e0-b956-4407-a529-c42479061aba service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:12.266195 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a90e0-b956-4407-a529-c42479061aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:12.268649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-269a90e0-b956-4407-a529-c42479061aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:12.332076 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a90e0-b956-4407-a529-c42479061aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:12.333619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a90e0-b956-4407-a529-c42479061aba service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:12.350393 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1211/2414] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:45:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:45:16.145905 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66295380-b46e-421f-b96c-6a958da5ed49 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:16.147460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-66295380-b46e-421f-b96c-6a958da5ed49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:16.274970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66295380-b46e-421f-b96c-6a958da5ed49 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:16.281808 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4449f-b30c-475c-8c4e-4593cfd4b9f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12f5d874be84f1ca79eb439267c7b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:16.283265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4449f-b30c-475c-8c4e-4593cfd4b9f5 service placement] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:16.283616 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4449f-b30c-475c-8c4e-4593cfd4b9f5 service placement] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:16.284130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4449f-b30c-475c-8c4e-4593cfd4b9f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:16.287365 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7ee4449f-b30c-475c-8c4e-4593cfd4b9f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:16.305172 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4449f-b30c-475c-8c4e-4593cfd4b9f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:16.307924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4449f-b30c-475c-8c4e-4593cfd4b9f5 service placement] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:16.320109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1204/2415] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:45:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:45:24.818880 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88605138-09e9-4840-808a-5bb1da9a48d6 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:24.819356 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88605138-09e9-4840-808a-5bb1da9a48d6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:24.819474 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88605138-09e9-4840-808a-5bb1da9a48d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:24.870467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-88605138-09e9-4840-808a-5bb1da9a48d6 None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:45:24.871997 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-88605138-09e9-4840-808a-5bb1da9a48d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:24.937707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1212/2416] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 5 15:45:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:45:24.949749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4449f-b30c-475c-8c4e-4593cfd4b9f5 service placement] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:24.951162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7ee4449f-b30c-475c-8c4e-4593cfd4b9f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:25.045786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4449f-b30c-475c-8c4e-4593cfd4b9f5 service placement] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:25.050945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc1572-2d6c-4858-9cd0-291242f483cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:25.051592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc1572-2d6c-4858-9cd0-291242f483cc service swift] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:25.051875 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc1572-2d6c-4858-9cd0-291242f483cc service swift] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:25.052152 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc1572-2d6c-4858-9cd0-291242f483cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:25.061492 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc1572-2d6c-4858-9cd0-291242f483cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:25.063138 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc1572-2d6c-4858-9cd0-291242f483cc service swift] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:25.082300 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1205/2417] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:45:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:45:25.647288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22119a23-f033-4abf-8c5e-554bfd643737 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:25.647580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22119a23-f033-4abf-8c5e-554bfd643737 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:25.647857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22119a23-f033-4abf-8c5e-554bfd643737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:25.666279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-22119a23-f033-4abf-8c5e-554bfd643737 None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:45:25.667469 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-22119a23-f033-4abf-8c5e-554bfd643737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:25.674847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1213/2418] 10.222.0.58 () {58 vars in 967 bytes} [Thu May 5 15:45:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:45:25.686838 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc1572-2d6c-4858-9cd0-291242f483cc service swift] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:25.697128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc1572-2d6c-4858-9cd0-291242f483cc service swift] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:25.702044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5255958-f248-4493-a00d-7b8cd024a53d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:25.702711 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5255958-f248-4493-a00d-7b8cd024a53d service swift] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:25.702989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5255958-f248-4493-a00d-7b8cd024a53d service swift] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:25.703258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5255958-f248-4493-a00d-7b8cd024a53d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:25.712313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5255958-f248-4493-a00d-7b8cd024a53d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:25.713870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5255958-f248-4493-a00d-7b8cd024a53d service swift] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:25.722708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1206/2419] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:45:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:45:25.905287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78c7df-4931-4c1f-98ec-fc1b8cddf2d0 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:25.905753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78c7df-4931-4c1f-98ec-fc1b8cddf2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:25.905878 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78c7df-4931-4c1f-98ec-fc1b8cddf2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:25.923446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ea78c7df-4931-4c1f-98ec-fc1b8cddf2d0 None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:45:25.924609 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ea78c7df-4931-4c1f-98ec-fc1b8cddf2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:25.931678 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1214/2420] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 5 15:45:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:45:25.943839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5255958-f248-4493-a00d-7b8cd024a53d service swift] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:25.954772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5255958-f248-4493-a00d-7b8cd024a53d service swift] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:25.959787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb38be7-f75f-49de-a115-89d318c6caef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:25.960416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb38be7-f75f-49de-a115-89d318c6caef service swift] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:25.960700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb38be7-f75f-49de-a115-89d318c6caef service swift] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:25.960975 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb38be7-f75f-49de-a115-89d318c6caef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:25.969281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb38be7-f75f-49de-a115-89d318c6caef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:25.970856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb38be7-f75f-49de-a115-89d318c6caef service swift] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:25.978747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1207/2421] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:45:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:45:26.288270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25651d7c-9959-4c40-843e-dc7192e22e1a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:26.288562 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25651d7c-9959-4c40-843e-dc7192e22e1a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:26.288842 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25651d7c-9959-4c40-843e-dc7192e22e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:26.307120 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-25651d7c-9959-4c40-843e-dc7192e22e1a None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:45:26.308568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-25651d7c-9959-4c40-843e-dc7192e22e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:26.316386 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1215/2422] 10.222.0.58 () {58 vars in 967 bytes} [Thu May 5 15:45:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:45:26.339560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb38be7-f75f-49de-a115-89d318c6caef service swift] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:26.350677 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb38be7-f75f-49de-a115-89d318c6caef service swift] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:26.355585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6950f-4779-4483-8a7e-3a0240f0a52d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:26.356209 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6950f-4779-4483-8a7e-3a0240f0a52d service swift] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:26.356490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6950f-4779-4483-8a7e-3a0240f0a52d service swift] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:26.356762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6950f-4779-4483-8a7e-3a0240f0a52d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:26.364819 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6950f-4779-4483-8a7e-3a0240f0a52d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:26.366409 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6950f-4779-4483-8a7e-3a0240f0a52d service swift] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:26.374186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1208/2423] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:45:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:45:31.560799 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25651d7c-9959-4c40-843e-dc7192e22e1a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:31.562334 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-25651d7c-9959-4c40-843e-dc7192e22e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:31.625599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25651d7c-9959-4c40-843e-dc7192e22e1a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:31.630129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fec60-12ce-4c06-898b-5039c310c724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:31.631084 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fec60-12ce-4c06-898b-5039c310c724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:31.631372 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fec60-12ce-4c06-898b-5039c310c724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:31.631651 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fec60-12ce-4c06-898b-5039c310c724 admin admin] PATH_INFO: `/v3/users/624862e882b243c6a6fca5596921da59` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:31.632884 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0fec60-12ce-4c06-898b-5039c310c724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=624862e882b243c6a6fca5596921da59)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:31.634947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0fec60-12ce-4c06-898b-5039c310c724 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:31.680067 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-fe0fec60-12ce-4c06-898b-5039c310c724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624862e882b243c6a6fca5596921da59'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:31.686676 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-fe0fec60-12ce-4c06-898b-5039c310c724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624862e882b243c6a6fca5596921da59'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:31.687327 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-fe0fec60-12ce-4c06-898b-5039c310c724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624862e882b243c6a6fca5596921da59'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:31.687937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-fe0fec60-12ce-4c06-898b-5039c310c724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624862e882b243c6a6fca5596921da59'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:31.699288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-fe0fec60-12ce-4c06-898b-5039c310c724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624862e882b243c6a6fca5596921da59'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:31.713484 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1216/2424] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:45:31 2022] DELETE /identity/v3/users/624862e882b243c6a6fca5596921da59 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:45:31.720743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353486a-2b99-4725-b84b-a0619f9e3e85 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:31.721290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353486a-2b99-4725-b84b-a0619f9e3e85 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:31.721290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353486a-2b99-4725-b84b-a0619f9e3e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:31.738477 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-c353486a-2b99-4725-b84b-a0619f9e3e85 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:45:31.739674 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c353486a-2b99-4725-b84b-a0619f9e3e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:31.795803 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1209/2425] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:45:31.805522 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fec60-12ce-4c06-898b-5039c310c724 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:31.806987 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-fe0fec60-12ce-4c06-898b-5039c310c724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:31.862833 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fec60-12ce-4c06-898b-5039c310c724 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:31.866458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fba26-e249-4cb9-bc84-a57342892886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:31.867093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fba26-e249-4cb9-bc84-a57342892886 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:31.867376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fba26-e249-4cb9-bc84-a57342892886 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:31.867651 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fba26-e249-4cb9-bc84-a57342892886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:31.876406 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fba26-e249-4cb9-bc84-a57342892886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:31.877819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fba26-e249-4cb9-bc84-a57342892886 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:31.887009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1217/2426] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:45:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:45:32.053834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353486a-2b99-4725-b84b-a0619f9e3e85 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:32.055271 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c353486a-2b99-4725-b84b-a0619f9e3e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:32.067131 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353486a-2b99-4725-b84b-a0619f9e3e85 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:32.072706 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a87e25-c675-4b2a-9d86-0418ca045487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:32.073840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a87e25-c675-4b2a-9d86-0418ca045487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:32.074334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a87e25-c675-4b2a-9d86-0418ca045487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:32.074815 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a87e25-c675-4b2a-9d86-0418ca045487 admin admin] PATH_INFO: `/v3/projects/63eb128493f149f79635d4d840f1d395` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:32.076880 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a87e25-c675-4b2a-9d86-0418ca045487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63eb128493f149f79635d4d840f1d395)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:32.080617 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a87e25-c675-4b2a-9d86-0418ca045487 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:32.137848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-23a87e25-c675-4b2a-9d86-0418ca045487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63eb128493f149f79635d4d840f1d395', 'request_id': 'req-23a87e25-c675-4b2a-9d86-0418ca045487'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:32.145690 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-23a87e25-c675-4b2a-9d86-0418ca045487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63eb128493f149f79635d4d840f1d395', 'request_id': 'req-23a87e25-c675-4b2a-9d86-0418ca045487'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:32.155165 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-23a87e25-c675-4b2a-9d86-0418ca045487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63eb128493f149f79635d4d840f1d395', 'request_id': 'req-23a87e25-c675-4b2a-9d86-0418ca045487'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:32.170746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-23a87e25-c675-4b2a-9d86-0418ca045487 admin admin] The token cache is being invalidate because project 63eb128493f149f79635d4d840f1d395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:45:32.171035 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-23a87e25-c675-4b2a-9d86-0418ca045487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:32.171659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-23a87e25-c675-4b2a-9d86-0418ca045487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:32.173972 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1210/2427] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:45:32 2022] DELETE /identity/v3/projects/63eb128493f149f79635d4d840f1d395 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:45:36.733254 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fba26-e249-4cb9-bc84-a57342892886 service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:36.734840 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-1e5fba26-e249-4cb9-bc84-a57342892886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:36.747603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fba26-e249-4cb9-bc84-a57342892886 service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:36.802137 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ff199-c076-4a3d-9605-49d856b822ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:36.802951 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ff199-c076-4a3d-9605-49d856b822ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:36.803229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ff199-c076-4a3d-9605-49d856b822ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:36.803500 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ff199-c076-4a3d-9605-49d856b822ab admin admin] PATH_INFO: `/v3/users/ad2ce1d9df53427c9147fa5e7fdf12bb` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:36.804661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ff199-c076-4a3d-9605-49d856b822ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2ce1d9df53427c9147fa5e7fdf12bb)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:36.806600 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ff199-c076-4a3d-9605-49d856b822ab admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:36.857889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-132ff199-c076-4a3d-9605-49d856b822ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2ce1d9df53427c9147fa5e7fdf12bb'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:36.865495 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-132ff199-c076-4a3d-9605-49d856b822ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2ce1d9df53427c9147fa5e7fdf12bb'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:36.866192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-132ff199-c076-4a3d-9605-49d856b822ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2ce1d9df53427c9147fa5e7fdf12bb'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:36.866795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-132ff199-c076-4a3d-9605-49d856b822ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2ce1d9df53427c9147fa5e7fdf12bb'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:36.878831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-132ff199-c076-4a3d-9605-49d856b822ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2ce1d9df53427c9147fa5e7fdf12bb'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:36.891102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1218/2428] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:45:36 2022] DELETE /identity/v3/users/ad2ce1d9df53427c9147fa5e7fdf12bb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:45:36.895502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de080-d9d8-404f-a419-04e935a72898 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:36.895978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de080-d9d8-404f-a419-04e935a72898 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:36.896088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de080-d9d8-404f-a419-04e935a72898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:36.912962 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-6a3de080-d9d8-404f-a419-04e935a72898 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:45:36.914145 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6a3de080-d9d8-404f-a419-04e935a72898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:36.972172 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1211/2429] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:45:36.981913 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ff199-c076-4a3d-9605-49d856b822ab admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:36.983380 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-132ff199-c076-4a3d-9605-49d856b822ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:37.038764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ff199-c076-4a3d-9605-49d856b822ab admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:37.042358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c1e99-5157-4818-90ce-dd8ec02785b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:37.042994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c1e99-5157-4818-90ce-dd8ec02785b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:37.043271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c1e99-5157-4818-90ce-dd8ec02785b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:37.043541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c1e99-5157-4818-90ce-dd8ec02785b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:37.052821 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c1e99-5157-4818-90ce-dd8ec02785b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:37.054185 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c1e99-5157-4818-90ce-dd8ec02785b2 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:37.064180 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1219/2430] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:45:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:45:37.321656 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3de080-d9d8-404f-a419-04e935a72898 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:37.323405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6a3de080-d9d8-404f-a419-04e935a72898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:37.335767 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3de080-d9d8-404f-a419-04e935a72898 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:37.341627 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ac043-f081-463f-80b1-289a9764ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:37.342626 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ac043-f081-463f-80b1-289a9764ff03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:37.342799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ac043-f081-463f-80b1-289a9764ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:37.343073 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ac043-f081-463f-80b1-289a9764ff03 admin admin] PATH_INFO: `/v3/projects/1eecd6b87f2b4e658945796fd234715f` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:37.345524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ac043-f081-463f-80b1-289a9764ff03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eecd6b87f2b4e658945796fd234715f)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:37.347655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ac043-f081-463f-80b1-289a9764ff03 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:37.393508 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-625ac043-f081-463f-80b1-289a9764ff03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eecd6b87f2b4e658945796fd234715f', 'request_id': 'req-625ac043-f081-463f-80b1-289a9764ff03'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:37.398790 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-625ac043-f081-463f-80b1-289a9764ff03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eecd6b87f2b4e658945796fd234715f', 'request_id': 'req-625ac043-f081-463f-80b1-289a9764ff03'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:37.404765 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-625ac043-f081-463f-80b1-289a9764ff03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eecd6b87f2b4e658945796fd234715f', 'request_id': 'req-625ac043-f081-463f-80b1-289a9764ff03'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:37.417098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-625ac043-f081-463f-80b1-289a9764ff03 admin admin] The token cache is being invalidate because project 1eecd6b87f2b4e658945796fd234715f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:45:37.417382 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-625ac043-f081-463f-80b1-289a9764ff03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:37.418026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-625ac043-f081-463f-80b1-289a9764ff03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:45:37.419581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1212/2431] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:45:37 2022] DELETE /identity/v3/projects/1eecd6b87f2b4e658945796fd234715f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:45:37.425366 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266c33a-c943-4f38-ac0f-b11c9b97e15d None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:37.425653 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266c33a-c943-4f38-ac0f-b11c9b97e15d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:37.425927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266c33a-c943-4f38-ac0f-b11c9b97e15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:37.443306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-9266c33a-c943-4f38-ac0f-b11c9b97e15d None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:45:37.444485 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9266c33a-c943-4f38-ac0f-b11c9b97e15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:37.501588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1220/2432] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:45:37.509286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b829b-d162-40f6-8475-24bb2fef6606 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:37.509592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b829b-d162-40f6-8475-24bb2fef6606 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:37.509877 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b829b-d162-40f6-8475-24bb2fef6606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:37.530733 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-bb3b829b-d162-40f6-8475-24bb2fef6606 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:45:37.532692 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bb3b829b-d162-40f6-8475-24bb2fef6606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:37.543415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1213/2433] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:45:37.547566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266c33a-c943-4f38-ac0f-b11c9b97e15d None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:37.557059 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266c33a-c943-4f38-ac0f-b11c9b97e15d None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:37.561568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f433f2-1d3e-4431-8dfa-a2e1829382da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:37.562241 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f433f2-1d3e-4431-8dfa-a2e1829382da admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:37.562560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f433f2-1d3e-4431-8dfa-a2e1829382da admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:37.562835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f433f2-1d3e-4431-8dfa-a2e1829382da admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:37.563557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f433f2-1d3e-4431-8dfa-a2e1829382da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:45:37.563863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f433f2-1d3e-4431-8dfa-a2e1829382da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:37.565491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f433f2-1d3e-4431-8dfa-a2e1829382da admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:37.576790 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1221/2434] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:45:37.581404 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b829b-d162-40f6-8475-24bb2fef6606 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:37.590948 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b829b-d162-40f6-8475-24bb2fef6606 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:37.596391 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c3ddf-2066-4b45-bd9a-744b6ac93a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:37.597071 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c3ddf-2066-4b45-bd9a-744b6ac93a70 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:37.597349 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c3ddf-2066-4b45-bd9a-744b6ac93a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:37.597618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c3ddf-2066-4b45-bd9a-744b6ac93a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:37.598340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c3ddf-2066-4b45-bd9a-744b6ac93a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:37.600211 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c3ddf-2066-4b45-bd9a-744b6ac93a70 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:37.624375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1214/2435] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:45:37 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:45:37.629059 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f433f2-1d3e-4431-8dfa-a2e1829382da admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:37.638939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f433f2-1d3e-4431-8dfa-a2e1829382da admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:37.694341 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc92285-a5c0-416b-9bf4-d5dcea0493b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:37.694997 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc92285-a5c0-416b-9bf4-d5dcea0493b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:37.695276 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc92285-a5c0-416b-9bf4-d5dcea0493b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:37.695549 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc92285-a5c0-416b-9bf4-d5dcea0493b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:37.696243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc92285-a5c0-416b-9bf4-d5dcea0493b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:37.698157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc92285-a5c0-416b-9bf4-d5dcea0493b9 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:37.720825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1222/2436] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:45:37 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:45:37.721824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c3ddf-2066-4b45-bd9a-744b6ac93a70 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:37.731916 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c3ddf-2066-4b45-bd9a-744b6ac93a70 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:37.737052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9c30-d179-4e6f-9e2b-2d546c4aac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:37.737708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9c30-d179-4e6f-9e2b-2d546c4aac90 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:37.738010 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9c30-d179-4e6f-9e2b-2d546c4aac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:37.738317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9c30-d179-4e6f-9e2b-2d546c4aac90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:37.739077 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd9c30-d179-4e6f-9e2b-2d546c4aac90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:37.740661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd9c30-d179-4e6f-9e2b-2d546c4aac90 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:37.751613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1215/2437] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:45:37.755570 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc92285-a5c0-416b-9bf4-d5dcea0493b9 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:37.765476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc92285-a5c0-416b-9bf4-d5dcea0493b9 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:37.770304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f260f6-2df1-4f03-ba4e-f88b055433c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:37.771077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f260f6-2df1-4f03-ba4e-f88b055433c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:37.771361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f260f6-2df1-4f03-ba4e-f88b055433c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:37.771639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f260f6-2df1-4f03-ba4e-f88b055433c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:37.772357 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f260f6-2df1-4f03-ba4e-f88b055433c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:37.773945 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f260f6-2df1-4f03-ba4e-f88b055433c5 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:37.786018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1223/2438] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:45:37.788975 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9c30-d179-4e6f-9e2b-2d546c4aac90 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:37.800399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9c30-d179-4e6f-9e2b-2d546c4aac90 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:37.804956 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429df842-a2de-41d9-b5ae-9f72bd5b8a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:37.805824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429df842-a2de-41d9-b5ae-9f72bd5b8a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:37.806102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429df842-a2de-41d9-b5ae-9f72bd5b8a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:37.806403 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429df842-a2de-41d9-b5ae-9f72bd5b8a9a admin admin] PATH_INFO: `/v3/projects/5b6028f0382a4bc6866aa908ad9be566/users/077cdd9e8beb4449bfe116bee974cbc5/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:37.823265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429df842-a2de-41d9-b5ae-9f72bd5b8a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6028f0382a4bc6866aa908ad9be566, user_id=077cdd9e8beb4449bfe116bee974cbc5, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:37.825851 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429df842-a2de-41d9-b5ae-9f72bd5b8a9a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:37.839243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1216/2439] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:45:37 2022] PUT /identity/v3/projects/5b6028f0382a4bc6866aa908ad9be566/users/077cdd9e8beb4449bfe116bee974cbc5/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:45:37.850627 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f6116-fbcb-4887-bdda-e03a47603cbd None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:37.850946 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f6116-fbcb-4887-bdda-e03a47603cbd None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:37.851229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f6116-fbcb-4887-bdda-e03a47603cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:37.878328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-6d1f6116-fbcb-4887-bdda-e03a47603cbd None None] MFA Rules not processed for user `077cdd9e8beb4449bfe116bee974cbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:45:37.879433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6d1f6116-fbcb-4887-bdda-e03a47603cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:37.943706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1224/2440] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:45:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:45:37.954987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429df842-a2de-41d9-b5ae-9f72bd5b8a9a admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:45:37.956655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-429df842-a2de-41d9-b5ae-9f72bd5b8a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:45:38.037513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429df842-a2de-41d9-b5ae-9f72bd5b8a9a admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:45:38.041325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f64e7-1706-473c-9ef2-66cad7f0ee6c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab6c13dc02ba49d0be523fa9a73fdf5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:45:38.041970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f64e7-1706-473c-9ef2-66cad7f0ee6c service glance] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:45:38.042312 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f64e7-1706-473c-9ef2-66cad7f0ee6c service glance] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:45:38.042592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f64e7-1706-473c-9ef2-66cad7f0ee6c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:45:38.051116 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f64e7-1706-473c-9ef2-66cad7f0ee6c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:45:38.052549 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f64e7-1706-473c-9ef2-66cad7f0ee6c service glance] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:45:38.062307 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1217/2441] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:45:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:24.385247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e0505-c2e0-48b4-9b2a-92f26d57aab7 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:24.385648 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e0505-c2e0-48b4-9b2a-92f26d57aab7 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:24.385837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e0505-c2e0-48b4-9b2a-92f26d57aab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:24.403673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-207e0505-c2e0-48b4-9b2a-92f26d57aab7 None None] MFA Rules not processed for user `e2e0f15742ea49bba055538ae4e99303`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:24.404863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-207e0505-c2e0-48b4-9b2a-92f26d57aab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:24.460650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1225/2442] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:46:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:25.610288 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f64e7-1706-473c-9ef2-66cad7f0ee6c service glance] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:25.675174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f64e7-1706-473c-9ef2-66cad7f0ee6c service glance] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:25.679680 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b7d75-9f33-4bbc-94e1-9b5abc7a9702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:25.680537 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b7d75-9f33-4bbc-94e1-9b5abc7a9702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:25.680822 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b7d75-9f33-4bbc-94e1-9b5abc7a9702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:25.681099 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b7d75-9f33-4bbc-94e1-9b5abc7a9702 admin admin] PATH_INFO: `/v3/users/077cdd9e8beb4449bfe116bee974cbc5` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:25.682366 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b7d75-9f33-4bbc-94e1-9b5abc7a9702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=077cdd9e8beb4449bfe116bee974cbc5)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:25.684272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b7d75-9f33-4bbc-94e1-9b5abc7a9702 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:25.728977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d87b7d75-9f33-4bbc-94e1-9b5abc7a9702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '077cdd9e8beb4449bfe116bee974cbc5'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:25.729648 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d87b7d75-9f33-4bbc-94e1-9b5abc7a9702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '077cdd9e8beb4449bfe116bee974cbc5'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:25.736951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d87b7d75-9f33-4bbc-94e1-9b5abc7a9702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '077cdd9e8beb4449bfe116bee974cbc5'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:25.743701 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d87b7d75-9f33-4bbc-94e1-9b5abc7a9702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '077cdd9e8beb4449bfe116bee974cbc5'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:25.744340 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-d87b7d75-9f33-4bbc-94e1-9b5abc7a9702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '077cdd9e8beb4449bfe116bee974cbc5'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:25.762490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1218/2443] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:46:25 2022] DELETE /identity/v3/users/077cdd9e8beb4449bfe116bee974cbc5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:25.767617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923872e-2c67-4910-ac84-2b06635c7ca4 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:25.768103 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923872e-2c67-4910-ac84-2b06635c7ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:25.768270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923872e-2c67-4910-ac84-2b06635c7ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:25.785565 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8923872e-2c67-4910-ac84-2b06635c7ca4 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:25.786752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8923872e-2c67-4910-ac84-2b06635c7ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:25.847860 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1226/2444] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:46:25.857724 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b7d75-9f33-4bbc-94e1-9b5abc7a9702 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:25.859152 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d87b7d75-9f33-4bbc-94e1-9b5abc7a9702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:25.917119 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b7d75-9f33-4bbc-94e1-9b5abc7a9702 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:25.920797 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630ab98-b058-4b0f-8a89-c776d22e6d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:25.921934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630ab98-b058-4b0f-8a89-c776d22e6d7e service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:25.922259 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630ab98-b058-4b0f-8a89-c776d22e6d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:25.922528 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630ab98-b058-4b0f-8a89-c776d22e6d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:25.932019 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630ab98-b058-4b0f-8a89-c776d22e6d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:25.933452 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630ab98-b058-4b0f-8a89-c776d22e6d7e service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:25.944140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1219/2445] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:26.206649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923872e-2c67-4910-ac84-2b06635c7ca4 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:26.208132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8923872e-2c67-4910-ac84-2b06635c7ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:26.220666 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923872e-2c67-4910-ac84-2b06635c7ca4 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:26.229289 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3a31e-2ffa-43e9-a796-efa1b83f979f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:26.230154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3a31e-2ffa-43e9-a796-efa1b83f979f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:26.230468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3a31e-2ffa-43e9-a796-efa1b83f979f admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:26.230742 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3a31e-2ffa-43e9-a796-efa1b83f979f admin admin] PATH_INFO: `/v3/projects/5b6028f0382a4bc6866aa908ad9be566` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:26.231952 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3a31e-2ffa-43e9-a796-efa1b83f979f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b6028f0382a4bc6866aa908ad9be566)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:26.234672 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3a31e-2ffa-43e9-a796-efa1b83f979f admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:26.281510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-00e3a31e-2ffa-43e9-a796-efa1b83f979f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b6028f0382a4bc6866aa908ad9be566', 'request_id': 'req-00e3a31e-2ffa-43e9-a796-efa1b83f979f'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:26.287414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-00e3a31e-2ffa-43e9-a796-efa1b83f979f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b6028f0382a4bc6866aa908ad9be566', 'request_id': 'req-00e3a31e-2ffa-43e9-a796-efa1b83f979f'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:26.293389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-00e3a31e-2ffa-43e9-a796-efa1b83f979f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b6028f0382a4bc6866aa908ad9be566', 'request_id': 'req-00e3a31e-2ffa-43e9-a796-efa1b83f979f'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:26.307656 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-00e3a31e-2ffa-43e9-a796-efa1b83f979f admin admin] The token cache is being invalidate because project 5b6028f0382a4bc6866aa908ad9be566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:46:26.307938 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-00e3a31e-2ffa-43e9-a796-efa1b83f979f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:26.308549 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-00e3a31e-2ffa-43e9-a796-efa1b83f979f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:26.310084 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1227/2446] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:46:26 2022] DELETE /identity/v3/projects/5b6028f0382a4bc6866aa908ad9be566 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:26.315984 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa82a6-a437-45cb-af27-ed2630c082a0 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:26.316266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa82a6-a437-45cb-af27-ed2630c082a0 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:26.316539 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa82a6-a437-45cb-af27-ed2630c082a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:26.333776 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-31aa82a6-a437-45cb-af27-ed2630c082a0 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:26.334999 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-31aa82a6-a437-45cb-af27-ed2630c082a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:26.395059 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1220/2447] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:26.402714 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adf847-2b4c-4d19-8176-78394413a628 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:26.403069 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adf847-2b4c-4d19-8176-78394413a628 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:26.403355 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adf847-2b4c-4d19-8176-78394413a628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:26.422343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a7adf847-2b4c-4d19-8176-78394413a628 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:26.423527 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a7adf847-2b4c-4d19-8176-78394413a628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:26.431414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1228/2448] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:26.435618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa82a6-a437-45cb-af27-ed2630c082a0 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:26.445289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa82a6-a437-45cb-af27-ed2630c082a0 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:26.449777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b45f5-a748-452c-92a8-941600c9c3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:26.450458 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b45f5-a748-452c-92a8-941600c9c3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:26.450738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b45f5-a748-452c-92a8-941600c9c3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:26.451011 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b45f5-a748-452c-92a8-941600c9c3a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:26.451721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b45f5-a748-452c-92a8-941600c9c3a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:46:26.452058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b45f5-a748-452c-92a8-941600c9c3a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:26.453744 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b45f5-a748-452c-92a8-941600c9c3a8 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:26.465119 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1221/2449] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:46:26.469950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7adf847-2b4c-4d19-8176-78394413a628 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:26.478992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7adf847-2b4c-4d19-8176-78394413a628 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:26.484100 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca840a4-2954-42d4-8245-dd21b3aea121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:26.484745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca840a4-2954-42d4-8245-dd21b3aea121 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:26.485020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca840a4-2954-42d4-8245-dd21b3aea121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:26.485472 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca840a4-2954-42d4-8245-dd21b3aea121 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:26.486177 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca840a4-2954-42d4-8245-dd21b3aea121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:26.488068 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca840a4-2954-42d4-8245-dd21b3aea121 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:26.514932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1229/2450] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:46:26 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:46:26.519902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b45f5-a748-452c-92a8-941600c9c3a8 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:26.529651 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b45f5-a748-452c-92a8-941600c9c3a8 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:26.583058 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1c216-c2ea-414e-893b-526920048bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:26.583741 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1c216-c2ea-414e-893b-526920048bde admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:26.584021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1c216-c2ea-414e-893b-526920048bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:26.584295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1c216-c2ea-414e-893b-526920048bde admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:26.584973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1c216-c2ea-414e-893b-526920048bde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:26.586896 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1c216-c2ea-414e-893b-526920048bde admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:26.606104 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1222/2451] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:46:26 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:46:26.610997 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca840a4-2954-42d4-8245-dd21b3aea121 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:26.620897 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca840a4-2954-42d4-8245-dd21b3aea121 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:26.625516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70947436-348a-4963-90e3-bd71d758170a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:26.626158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70947436-348a-4963-90e3-bd71d758170a admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:26.626467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70947436-348a-4963-90e3-bd71d758170a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:26.626738 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70947436-348a-4963-90e3-bd71d758170a admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:26.627443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70947436-348a-4963-90e3-bd71d758170a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:26.629015 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70947436-348a-4963-90e3-bd71d758170a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:26.644076 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1230/2452] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:46:26.645223 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1c216-c2ea-414e-893b-526920048bde admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:26.657043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1c216-c2ea-414e-893b-526920048bde admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:26.662065 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6b483-2b7a-4ccb-b1ab-cb616d0c4909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:26.662856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6b483-2b7a-4ccb-b1ab-cb616d0c4909 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:26.663261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6b483-2b7a-4ccb-b1ab-cb616d0c4909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:26.663541 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6b483-2b7a-4ccb-b1ab-cb616d0c4909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:26.664895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6b483-2b7a-4ccb-b1ab-cb616d0c4909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:26.666748 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6b483-2b7a-4ccb-b1ab-cb616d0c4909 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:26.677328 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1223/2453] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:46:26.681390 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70947436-348a-4963-90e3-bd71d758170a admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:26.691778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70947436-348a-4963-90e3-bd71d758170a admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:26.696422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f976d-111f-4eb6-ad62-3f080b0774f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:26.697288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f976d-111f-4eb6-ad62-3f080b0774f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:26.697564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f976d-111f-4eb6-ad62-3f080b0774f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:26.697831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f976d-111f-4eb6-ad62-3f080b0774f2 admin admin] PATH_INFO: `/v3/projects/c514ad1026564ac69a8ea5f4443371f7/users/2686a0d7f7da49fb8e79f10cf9be0108/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:26.712983 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f976d-111f-4eb6-ad62-3f080b0774f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c514ad1026564ac69a8ea5f4443371f7, user_id=2686a0d7f7da49fb8e79f10cf9be0108, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:26.715661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f976d-111f-4eb6-ad62-3f080b0774f2 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:26.730473 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1231/2454] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:46:26 2022] PUT /identity/v3/projects/c514ad1026564ac69a8ea5f4443371f7/users/2686a0d7f7da49fb8e79f10cf9be0108/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:26.735387 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403a511-bf9b-464d-a00b-2d0c91ef4bcd None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:26.735675 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403a511-bf9b-464d-a00b-2d0c91ef4bcd None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:26.735950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403a511-bf9b-464d-a00b-2d0c91ef4bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:26.753623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-2403a511-bf9b-464d-a00b-2d0c91ef4bcd None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:26.754843 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-2403a511-bf9b-464d-a00b-2d0c91ef4bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:26.812850 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1224/2455] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:26.822428 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f976d-111f-4eb6-ad62-3f080b0774f2 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:26.824183 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-641f976d-111f-4eb6-ad62-3f080b0774f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:26.880088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f976d-111f-4eb6-ad62-3f080b0774f2 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:26.883662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1291cb0-577e-4a63-b566-704275233f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:26.884301 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1291cb0-577e-4a63-b566-704275233f41 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:26.884587 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1291cb0-577e-4a63-b566-704275233f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:26.884859 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1291cb0-577e-4a63-b566-704275233f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:26.894183 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1291cb0-577e-4a63-b566-704275233f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:26.895619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1291cb0-577e-4a63-b566-704275233f41 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:26.906735 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1232/2456] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:32.696344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403a511-bf9b-464d-a00b-2d0c91ef4bcd None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:32.702809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-2403a511-bf9b-464d-a00b-2d0c91ef4bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:32.721864 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403a511-bf9b-464d-a00b-2d0c91ef4bcd None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:32.742482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525574e-fb1e-4dae-b314-2ac480da1520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:32.743754 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525574e-fb1e-4dae-b314-2ac480da1520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:32.744266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525574e-fb1e-4dae-b314-2ac480da1520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:32.744757 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525574e-fb1e-4dae-b314-2ac480da1520 admin admin] PATH_INFO: `/v3/users/ac454c6b807842ba821a9087f1cf4e2d` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:32.746526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525574e-fb1e-4dae-b314-2ac480da1520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac454c6b807842ba821a9087f1cf4e2d)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:32.757687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525574e-fb1e-4dae-b314-2ac480da1520 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:32.824933 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6525574e-fb1e-4dae-b314-2ac480da1520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac454c6b807842ba821a9087f1cf4e2d'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:32.825652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6525574e-fb1e-4dae-b314-2ac480da1520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac454c6b807842ba821a9087f1cf4e2d'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:32.837713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6525574e-fb1e-4dae-b314-2ac480da1520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac454c6b807842ba821a9087f1cf4e2d'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:32.852785 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6525574e-fb1e-4dae-b314-2ac480da1520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac454c6b807842ba821a9087f1cf4e2d'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:32.854777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-6525574e-fb1e-4dae-b314-2ac480da1520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac454c6b807842ba821a9087f1cf4e2d'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:32.880151 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1225/2457] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:46:32 2022] DELETE /identity/v3/users/ac454c6b807842ba821a9087f1cf4e2d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:33.033115 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6db4a0-38db-4f7e-a42d-44f7985979fe None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:33.033603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6db4a0-38db-4f7e-a42d-44f7985979fe None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:33.033707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6db4a0-38db-4f7e-a42d-44f7985979fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:33.060126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ed6db4a0-38db-4f7e-a42d-44f7985979fe None None] MFA Rules not processed for user `2686a0d7f7da49fb8e79f10cf9be0108`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:33.061386 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ed6db4a0-38db-4f7e-a42d-44f7985979fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:33.134352 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1233/2458] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:46:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:33.138541 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525574e-fb1e-4dae-b314-2ac480da1520 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:33.142472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6525574e-fb1e-4dae-b314-2ac480da1520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:33.235300 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525574e-fb1e-4dae-b314-2ac480da1520 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:33.241649 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97a405-12a4-475b-a481-13c33fd9bc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:33.242707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97a405-12a4-475b-a481-13c33fd9bc54 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:33.243147 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97a405-12a4-475b-a481-13c33fd9bc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:33.243598 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97a405-12a4-475b-a481-13c33fd9bc54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:33.244558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97a405-12a4-475b-a481-13c33fd9bc54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:33.246787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97a405-12a4-475b-a481-13c33fd9bc54 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:33.278139 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1226/2459] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:46:33 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:46:33.283436 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6db4a0-38db-4f7e-a42d-44f7985979fe None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:33.300000 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6db4a0-38db-4f7e-a42d-44f7985979fe None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:33.370352 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b63c60-fbb9-4a19-9810-4bfb8d6b1abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:33.371045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b63c60-fbb9-4a19-9810-4bfb8d6b1abb admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:33.371312 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b63c60-fbb9-4a19-9810-4bfb8d6b1abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:33.371580 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b63c60-fbb9-4a19-9810-4bfb8d6b1abb admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:33.372334 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b63c60-fbb9-4a19-9810-4bfb8d6b1abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:33.375104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b63c60-fbb9-4a19-9810-4bfb8d6b1abb admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:33.377548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97a405-12a4-475b-a481-13c33fd9bc54 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:33.379295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-ce97a405-12a4-475b-a481-13c33fd9bc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:33.392658 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97a405-12a4-475b-a481-13c33fd9bc54 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:33.401029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f2e59-289a-4507-9161-8635493ab078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:33.403525 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f2e59-289a-4507-9161-8635493ab078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:33.403914 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f2e59-289a-4507-9161-8635493ab078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:33.404267 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f2e59-289a-4507-9161-8635493ab078 admin admin] PATH_INFO: `/v3/projects/b17842fa85384865aba313f5fa724882` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:33.406029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f2e59-289a-4507-9161-8635493ab078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b17842fa85384865aba313f5fa724882)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:33.408962 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f2e59-289a-4507-9161-8635493ab078 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:33.418902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1234/2460] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:46:33 2022] POST /identity/v3/users => generated 298 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:46:33.425242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b63c60-fbb9-4a19-9810-4bfb8d6b1abb admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:33.444988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b63c60-fbb9-4a19-9810-4bfb8d6b1abb admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:33.454196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6149d47-a61b-42a1-854d-702a13c227e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:33.456132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6149d47-a61b-42a1-854d-702a13c227e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:33.456638 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6149d47-a61b-42a1-854d-702a13c227e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:33.457415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6149d47-a61b-42a1-854d-702a13c227e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:33.458516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6149d47-a61b-42a1-854d-702a13c227e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:33.461011 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6149d47-a61b-42a1-854d-702a13c227e5 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:33.487520 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-ac3f2e59-289a-4507-9161-8635493ab078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b17842fa85384865aba313f5fa724882', 'request_id': 'req-ac3f2e59-289a-4507-9161-8635493ab078'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:33.493341 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-ac3f2e59-289a-4507-9161-8635493ab078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b17842fa85384865aba313f5fa724882', 'request_id': 'req-ac3f2e59-289a-4507-9161-8635493ab078'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:33.496160 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1235/2461] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:46:33.500768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6149d47-a61b-42a1-854d-702a13c227e5 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:33.501236 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-ac3f2e59-289a-4507-9161-8635493ab078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b17842fa85384865aba313f5fa724882', 'request_id': 'req-ac3f2e59-289a-4507-9161-8635493ab078'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:33.520790 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6149d47-a61b-42a1-854d-702a13c227e5 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:33.525095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-ac3f2e59-289a-4507-9161-8635493ab078 admin admin] The token cache is being invalidate because project b17842fa85384865aba313f5fa724882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:46:33.525095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-ac3f2e59-289a-4507-9161-8635493ab078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:33.525739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-ac3f2e59-289a-4507-9161-8635493ab078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:33.532088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1227/2462] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:46:33 2022] DELETE /identity/v3/projects/b17842fa85384865aba313f5fa724882 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:33.534123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65d2b8-4fe7-464e-a533-c5df01df20cd None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:33.534450 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65d2b8-4fe7-464e-a533-c5df01df20cd None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:33.535004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65d2b8-4fe7-464e-a533-c5df01df20cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:33.559212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-3e65d2b8-4fe7-464e-a533-c5df01df20cd None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:33.560462 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-3e65d2b8-4fe7-464e-a533-c5df01df20cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:33.593975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbf79e-597d-43ba-9b1a-472f6304f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:33.595018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbf79e-597d-43ba-9b1a-472f6304f42d admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:33.595301 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbf79e-597d-43ba-9b1a-472f6304f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:33.595575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbf79e-597d-43ba-9b1a-472f6304f42d admin admin] PATH_INFO: `/v3/projects/e7ca00cab61a48839a14ea98c12f0db6/users/0bc4c90113734cae9fc2d4b64b29089f/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:33.612222 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbf79e-597d-43ba-9b1a-472f6304f42d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ca00cab61a48839a14ea98c12f0db6, user_id=0bc4c90113734cae9fc2d4b64b29089f, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:33.615031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbf79e-597d-43ba-9b1a-472f6304f42d admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:33.628848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1236/2463] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:46:33 2022] PUT /identity/v3/projects/e7ca00cab61a48839a14ea98c12f0db6/users/0bc4c90113734cae9fc2d4b64b29089f/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:33.630345 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1228/2464] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:46:33.632699 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbf79e-597d-43ba-9b1a-472f6304f42d admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:33.634347 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-bbbbf79e-597d-43ba-9b1a-472f6304f42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:33.636443 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099f26e-2205-47ef-8771-df5c7845117e None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:33.636828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099f26e-2205-47ef-8771-df5c7845117e None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:33.637005 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099f26e-2205-47ef-8771-df5c7845117e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:33.655885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-e099f26e-2205-47ef-8771-df5c7845117e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:33.657695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e099f26e-2205-47ef-8771-df5c7845117e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:33.701828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbf79e-597d-43ba-9b1a-472f6304f42d admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:33.706672 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf5103-51cf-4fad-8a8e-f67f654e844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:33.707377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf5103-51cf-4fad-8a8e-f67f654e844f admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:33.707662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf5103-51cf-4fad-8a8e-f67f654e844f admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:33.707941 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf5103-51cf-4fad-8a8e-f67f654e844f admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:33.708680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf5103-51cf-4fad-8a8e-f67f654e844f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:33.710291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf5103-51cf-4fad-8a8e-f67f654e844f admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:33.719439 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1229/2465] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:46:33.723962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1237/2466] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:46:33.724850 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf5103-51cf-4fad-8a8e-f67f654e844f admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:33.725141 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099f26e-2205-47ef-8771-df5c7845117e None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:33.735448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099f26e-2205-47ef-8771-df5c7845117e None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:33.740443 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac11770-3fd9-4ccb-a4a9-b03e8525e9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:33.741120 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac11770-3fd9-4ccb-a4a9-b03e8525e9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:33.741397 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac11770-3fd9-4ccb-a4a9-b03e8525e9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:33.741669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac11770-3fd9-4ccb-a4a9-b03e8525e9a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:33.742439 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac11770-3fd9-4ccb-a4a9-b03e8525e9a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:46:33.742743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac11770-3fd9-4ccb-a4a9-b03e8525e9a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:33.744336 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac11770-3fd9-4ccb-a4a9-b03e8525e9a0 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:33.744440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf5103-51cf-4fad-8a8e-f67f654e844f admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:33.749610 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a3e9e-c850-49d9-a85b-e55961022714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:33.750539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a3e9e-c850-49d9-a85b-e55961022714 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:33.750824 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a3e9e-c850-49d9-a85b-e55961022714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:33.751097 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a3e9e-c850-49d9-a85b-e55961022714 admin admin] PATH_INFO: `/v3/projects/e7ca00cab61a48839a14ea98c12f0db6/users/0bc4c90113734cae9fc2d4b64b29089f/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:33.753090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a3e9e-c850-49d9-a85b-e55961022714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ca00cab61a48839a14ea98c12f0db6, user_id=0bc4c90113734cae9fc2d4b64b29089f, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:33.755814 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a3e9e-c850-49d9-a85b-e55961022714 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:33.756546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1230/2467] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:46:33.760874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac11770-3fd9-4ccb-a4a9-b03e8525e9a0 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:33.767391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1238/2468] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:46:33 2022] PUT /identity/v3/projects/e7ca00cab61a48839a14ea98c12f0db6/users/0bc4c90113734cae9fc2d4b64b29089f/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:33.771511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac11770-3fd9-4ccb-a4a9-b03e8525e9a0 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:33.840599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b08de-78da-4473-9ef0-5a82f7952813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:33.840954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b08de-78da-4473-9ef0-5a82f7952813 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:33.841220 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b08de-78da-4473-9ef0-5a82f7952813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:33.841490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b08de-78da-4473-9ef0-5a82f7952813 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:33.842377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b08de-78da-4473-9ef0-5a82f7952813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:33.844240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b08de-78da-4473-9ef0-5a82f7952813 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:33.877232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1231/2469] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:46:33 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:46:33.882099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a3e9e-c850-49d9-a85b-e55961022714 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:33.894640 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a3e9e-c850-49d9-a85b-e55961022714 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:33.961228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b603f-7168-4346-826d-64b22c1a38fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:33.962046 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b603f-7168-4346-826d-64b22c1a38fe admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:33.962686 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b603f-7168-4346-826d-64b22c1a38fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:33.963213 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b603f-7168-4346-826d-64b22c1a38fe admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:33.964019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b603f-7168-4346-826d-64b22c1a38fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:33.966981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b603f-7168-4346-826d-64b22c1a38fe admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:33.997617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1239/2470] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:46:33 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:46:34.001827 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b08de-78da-4473-9ef0-5a82f7952813 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:34.011940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b08de-78da-4473-9ef0-5a82f7952813 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:34.017154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052fc43-59b4-4e1c-8582-9fcdd712c53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:34.017821 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052fc43-59b4-4e1c-8582-9fcdd712c53e admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:34.018107 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052fc43-59b4-4e1c-8582-9fcdd712c53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:34.018412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052fc43-59b4-4e1c-8582-9fcdd712c53e admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:34.019137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052fc43-59b4-4e1c-8582-9fcdd712c53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:34.021029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052fc43-59b4-4e1c-8582-9fcdd712c53e admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:34.036055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1232/2471] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:46:34.039902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b603f-7168-4346-826d-64b22c1a38fe admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:34.051288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b603f-7168-4346-826d-64b22c1a38fe admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:34.061736 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eeeec9-ff11-4869-8fb4-0969083c7c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:34.062680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eeeec9-ff11-4869-8fb4-0969083c7c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:34.063059 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eeeec9-ff11-4869-8fb4-0969083c7c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:34.063433 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eeeec9-ff11-4869-8fb4-0969083c7c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:34.064258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eeeec9-ff11-4869-8fb4-0969083c7c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:34.065967 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eeeec9-ff11-4869-8fb4-0969083c7c9a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:34.077702 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1240/2472] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:46:34.081965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052fc43-59b4-4e1c-8582-9fcdd712c53e admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:34.094039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052fc43-59b4-4e1c-8582-9fcdd712c53e admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:34.099755 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a0bd8-980f-450c-8166-7c445fddf521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:34.100655 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a0bd8-980f-450c-8166-7c445fddf521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:34.101082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a0bd8-980f-450c-8166-7c445fddf521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:34.101383 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a0bd8-980f-450c-8166-7c445fddf521 admin admin] PATH_INFO: `/v3/projects/098291d672cb4fea85aa666b1941b08e/users/914a8ecf4d56412ab28b2ad1c35408ba/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:34.118225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a0bd8-980f-450c-8166-7c445fddf521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098291d672cb4fea85aa666b1941b08e, user_id=914a8ecf4d56412ab28b2ad1c35408ba, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:34.121526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a0bd8-980f-450c-8166-7c445fddf521 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:34.144669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1233/2473] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:46:34 2022] PUT /identity/v3/projects/098291d672cb4fea85aa666b1941b08e/users/914a8ecf4d56412ab28b2ad1c35408ba/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:34.155606 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d31d66-6327-4e65-bd18-0d2b1666a5f5 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:34.155893 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d31d66-6327-4e65-bd18-0d2b1666a5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:34.156269 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d31d66-6327-4e65-bd18-0d2b1666a5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:34.190375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f3d31d66-6327-4e65-bd18-0d2b1666a5f5 None None] MFA Rules not processed for user `914a8ecf4d56412ab28b2ad1c35408ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:34.191695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f3d31d66-6327-4e65-bd18-0d2b1666a5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:34.289843 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1241/2474] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:46:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:46:34.302268 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a0bd8-980f-450c-8166-7c445fddf521 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:34.304271 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-468a0bd8-980f-450c-8166-7c445fddf521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:34.376376 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a0bd8-980f-450c-8166-7c445fddf521 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:34.380124 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a08827-29d9-40f0-8b88-d440348576b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:34.380780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a08827-29d9-40f0-8b88-d440348576b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:34.381060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a08827-29d9-40f0-8b88-d440348576b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:34.381332 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a08827-29d9-40f0-8b88-d440348576b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:34.394747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a08827-29d9-40f0-8b88-d440348576b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:34.397333 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a08827-29d9-40f0-8b88-d440348576b4 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:34.407007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1234/2475] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:46:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:38.508785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4139df-a8ab-4cc3-bd53-9117f52c57bb None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:38.509229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4139df-a8ab-4cc3-bd53-9117f52c57bb None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:38.509410 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4139df-a8ab-4cc3-bd53-9117f52c57bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:38.536746 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-cc4139df-a8ab-4cc3-bd53-9117f52c57bb None None] MFA Rules not processed for user `0bc4c90113734cae9fc2d4b64b29089f`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:38.537941 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-cc4139df-a8ab-4cc3-bd53-9117f52c57bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:38.605713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1242/2476] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:46:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:38.617278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a08827-29d9-40f0-8b88-d440348576b4 service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:38.618736 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b1a08827-29d9-40f0-8b88-d440348576b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:38.679157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a08827-29d9-40f0-8b88-d440348576b4 service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:38.682805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0b61a-c1bf-4560-8f1e-8dd2c91b4ca0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab6c13dc02ba49d0be523fa9a73fdf5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:38.683440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0b61a-c1bf-4560-8f1e-8dd2c91b4ca0 service glance] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:38.683719 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0b61a-c1bf-4560-8f1e-8dd2c91b4ca0 service glance] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:38.683994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0b61a-c1bf-4560-8f1e-8dd2c91b4ca0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:38.685993 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-21a0b61a-c1bf-4560-8f1e-8dd2c91b4ca0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:38.745548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0b61a-c1bf-4560-8f1e-8dd2c91b4ca0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:38.746933 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0b61a-c1bf-4560-8f1e-8dd2c91b4ca0 service glance] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:38.757020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1235/2477] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:46:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:38.861967 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d0c1b-dbd9-4e53-9083-9d8a7f8ed2d7 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:38.862280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d0c1b-dbd9-4e53-9083-9d8a7f8ed2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:38.862572 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d0c1b-dbd9-4e53-9083-9d8a7f8ed2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:38.882896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d34d0c1b-dbd9-4e53-9083-9d8a7f8ed2d7 None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:38.884157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d34d0c1b-dbd9-4e53-9083-9d8a7f8ed2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:38.949541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1243/2478] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 5 15:46:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:39.009723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0b61a-c1bf-4560-8f1e-8dd2c91b4ca0 service glance] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:39.011244 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-21a0b61a-c1bf-4560-8f1e-8dd2c91b4ca0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:39.110367 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0b61a-c1bf-4560-8f1e-8dd2c91b4ca0 service glance] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:39.115558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e271f-65ed-449d-bb09-fd6f458ca54c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:39.116406 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e271f-65ed-449d-bb09-fd6f458ca54c service swift] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:39.116738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e271f-65ed-449d-bb09-fd6f458ca54c service swift] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:39.117097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e271f-65ed-449d-bb09-fd6f458ca54c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:39.127953 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e271f-65ed-449d-bb09-fd6f458ca54c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:39.129944 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e271f-65ed-449d-bb09-fd6f458ca54c service swift] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:39.139029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1236/2479] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:46:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:46:48.382308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce7b71-4bc2-4e31-a3ca-d1f02403298b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:48.382871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce7b71-4bc2-4e31-a3ca-d1f02403298b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:48.382871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce7b71-4bc2-4e31-a3ca-d1f02403298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:48.399936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-93ce7b71-4bc2-4e31-a3ca-d1f02403298b None None] MFA Rules not processed for user `2686a0d7f7da49fb8e79f10cf9be0108`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:48.401120 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-93ce7b71-4bc2-4e31-a3ca-d1f02403298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:48.407956 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1244/2480] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:46:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:50.118241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4332c-9360-4267-886d-65b72dc8465d None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:50.118786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4332c-9360-4267-886d-65b72dc8465d None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:50.118786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4332c-9360-4267-886d-65b72dc8465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:50.140132 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-46a4332c-9360-4267-886d-65b72dc8465d None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:50.141487 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-46a4332c-9360-4267-886d-65b72dc8465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:50.150593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1237/2481] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 5 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:46:50.162850 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce7b71-4bc2-4e31-a3ca-d1f02403298b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:50.177101 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce7b71-4bc2-4e31-a3ca-d1f02403298b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:50.187363 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2699aca-0047-48e9-ae15-c866786bd4de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:50.188066 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2699aca-0047-48e9-ae15-c866786bd4de service swift] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:50.188392 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2699aca-0047-48e9-ae15-c866786bd4de service swift] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:50.188631 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2699aca-0047-48e9-ae15-c866786bd4de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:50.200318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2699aca-0047-48e9-ae15-c866786bd4de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:50.202293 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2699aca-0047-48e9-ae15-c866786bd4de service swift] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:50.212209 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1245/2482] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:46:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 15:46:51.275225 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4332c-9360-4267-886d-65b72dc8465d None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:51.345961 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4332c-9360-4267-886d-65b72dc8465d None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:51.350636 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a42bc8-e67c-43c0-8ce5-9b2988683678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:51.351504 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a42bc8-e67c-43c0-8ce5-9b2988683678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:51.351784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a42bc8-e67c-43c0-8ce5-9b2988683678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:51.352051 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a42bc8-e67c-43c0-8ce5-9b2988683678 admin admin] PATH_INFO: `/v3/users/914a8ecf4d56412ab28b2ad1c35408ba` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:51.353222 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a42bc8-e67c-43c0-8ce5-9b2988683678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=914a8ecf4d56412ab28b2ad1c35408ba)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:51.355189 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a42bc8-e67c-43c0-8ce5-9b2988683678 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:51.406044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-18a42bc8-e67c-43c0-8ce5-9b2988683678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914a8ecf4d56412ab28b2ad1c35408ba'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:51.406835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-18a42bc8-e67c-43c0-8ce5-9b2988683678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914a8ecf4d56412ab28b2ad1c35408ba'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:51.416303 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-18a42bc8-e67c-43c0-8ce5-9b2988683678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914a8ecf4d56412ab28b2ad1c35408ba'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:51.426277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-18a42bc8-e67c-43c0-8ce5-9b2988683678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914a8ecf4d56412ab28b2ad1c35408ba'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:51.426985 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-18a42bc8-e67c-43c0-8ce5-9b2988683678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914a8ecf4d56412ab28b2ad1c35408ba'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:51.446142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1238/2483] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:46:51 2022] DELETE /identity/v3/users/914a8ecf4d56412ab28b2ad1c35408ba => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:46:51.451102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30de6f-97ca-46a8-959b-30c3d777ecc9 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:51.452204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30de6f-97ca-46a8-959b-30c3d777ecc9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:51.452707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30de6f-97ca-46a8-959b-30c3d777ecc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:51.473030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-3c30de6f-97ca-46a8-959b-30c3d777ecc9 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:46:51.474491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3c30de6f-97ca-46a8-959b-30c3d777ecc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:51.535026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1246/2484] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:46:51.545190 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a42bc8-e67c-43c0-8ce5-9b2988683678 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:51.547238 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-18a42bc8-e67c-43c0-8ce5-9b2988683678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:51.610547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a42bc8-e67c-43c0-8ce5-9b2988683678 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:51.614283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac760f23-8925-4805-9c0d-c96f844d6a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:51.614997 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac760f23-8925-4805-9c0d-c96f844d6a2e service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:51.615288 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac760f23-8925-4805-9c0d-c96f844d6a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:51.615566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac760f23-8925-4805-9c0d-c96f844d6a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:51.626750 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac760f23-8925-4805-9c0d-c96f844d6a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:51.628289 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac760f23-8925-4805-9c0d-c96f844d6a2e service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:51.638977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1239/2485] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:46:51.915296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30de6f-97ca-46a8-959b-30c3d777ecc9 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:46:51.920045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3c30de6f-97ca-46a8-959b-30c3d777ecc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:46:51.938552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30de6f-97ca-46a8-959b-30c3d777ecc9 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:46:51.946749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304480b9-de85-4f41-af7a-2264fe867feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:46:51.947739 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304480b9-de85-4f41-af7a-2264fe867feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:46:51.948346 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304480b9-de85-4f41-af7a-2264fe867feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:46:51.948918 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304480b9-de85-4f41-af7a-2264fe867feb admin admin] PATH_INFO: `/v3/projects/098291d672cb4fea85aa666b1941b08e` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:46:51.950371 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304480b9-de85-4f41-af7a-2264fe867feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=098291d672cb4fea85aa666b1941b08e)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:46:51.952449 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304480b9-de85-4f41-af7a-2264fe867feb admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:46:52.006947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-304480b9-de85-4f41-af7a-2264fe867feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098291d672cb4fea85aa666b1941b08e', 'request_id': 'req-304480b9-de85-4f41-af7a-2264fe867feb'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:52.012208 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-304480b9-de85-4f41-af7a-2264fe867feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098291d672cb4fea85aa666b1941b08e', 'request_id': 'req-304480b9-de85-4f41-af7a-2264fe867feb'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:52.018740 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-304480b9-de85-4f41-af7a-2264fe867feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098291d672cb4fea85aa666b1941b08e', 'request_id': 'req-304480b9-de85-4f41-af7a-2264fe867feb'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:52.033147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-304480b9-de85-4f41-af7a-2264fe867feb admin admin] The token cache is being invalidate because project 098291d672cb4fea85aa666b1941b08e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:46:52.033458 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-304480b9-de85-4f41-af7a-2264fe867feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:52.034117 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-304480b9-de85-4f41-af7a-2264fe867feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:46:52.035763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1247/2486] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:46:51 2022] DELETE /identity/v3/projects/098291d672cb4fea85aa666b1941b08e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:47:14.087077 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac760f23-8925-4805-9c0d-c96f844d6a2e service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:14.096168 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac760f23-8925-4805-9c0d-c96f844d6a2e service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:14.141633 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc8530-5a2c-47b0-aeb0-9ce1dcfb23ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:14.142296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc8530-5a2c-47b0-aeb0-9ce1dcfb23ef service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:14.142576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc8530-5a2c-47b0-aeb0-9ce1dcfb23ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:14.142848 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc8530-5a2c-47b0-aeb0-9ce1dcfb23ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:14.144564 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-30cc8530-5a2c-47b0-aeb0-9ce1dcfb23ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:14.224152 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc8530-5a2c-47b0-aeb0-9ce1dcfb23ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:14.225586 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc8530-5a2c-47b0-aeb0-9ce1dcfb23ef service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:14.245902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1240/2487] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:14.589597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304480b9-de85-4f41-af7a-2264fe867feb admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:14.591087 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-304480b9-de85-4f41-af7a-2264fe867feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:14.603612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304480b9-de85-4f41-af7a-2264fe867feb admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:14.607158 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93680de4-211c-4dd3-b896-fcfe2e6d3037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:14.607826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93680de4-211c-4dd3-b896-fcfe2e6d3037 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:14.608154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93680de4-211c-4dd3-b896-fcfe2e6d3037 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:14.608434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93680de4-211c-4dd3-b896-fcfe2e6d3037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:14.610127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-93680de4-211c-4dd3-b896-fcfe2e6d3037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:14.622766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93680de4-211c-4dd3-b896-fcfe2e6d3037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:14.624745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93680de4-211c-4dd3-b896-fcfe2e6d3037 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:14.635352 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1248/2488] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:22.961496 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc8530-5a2c-47b0-aeb0-9ce1dcfb23ef service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:22.970946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc8530-5a2c-47b0-aeb0-9ce1dcfb23ef service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:22.974483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb7e36-af35-4587-9c23-0f21c5466926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:22.975111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb7e36-af35-4587-9c23-0f21c5466926 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:22.975393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb7e36-af35-4587-9c23-0f21c5466926 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:22.975663 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb7e36-af35-4587-9c23-0f21c5466926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:22.977426 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-2dfb7e36-af35-4587-9c23-0f21c5466926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:23.039360 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb7e36-af35-4587-9c23-0f21c5466926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:23.040773 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb7e36-af35-4587-9c23-0f21c5466926 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:23.051114 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1241/2489] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:23.125606 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93680de4-211c-4dd3-b896-fcfe2e6d3037 service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:23.127765 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-93680de4-211c-4dd3-b896-fcfe2e6d3037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:23.151700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93680de4-211c-4dd3-b896-fcfe2e6d3037 service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:23.159367 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0425fe4-11ff-4a8e-917c-f0e7447ddfb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:23.160082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0425fe4-11ff-4a8e-917c-f0e7447ddfb0 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:23.160366 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0425fe4-11ff-4a8e-917c-f0e7447ddfb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:23.160639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0425fe4-11ff-4a8e-917c-f0e7447ddfb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:23.162425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f0425fe4-11ff-4a8e-917c-f0e7447ddfb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:23.228199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0425fe4-11ff-4a8e-917c-f0e7447ddfb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:23.229779 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0425fe4-11ff-4a8e-917c-f0e7447ddfb0 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:23.239265 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1249/2490] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:23.280787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb7e36-af35-4587-9c23-0f21c5466926 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:23.282251 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-2dfb7e36-af35-4587-9c23-0f21c5466926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:23.296398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb7e36-af35-4587-9c23-0f21c5466926 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:23.301724 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb71542-c86b-4133-a2e6-d8ce89e41bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:23.302516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb71542-c86b-4133-a2e6-d8ce89e41bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:23.302822 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb71542-c86b-4133-a2e6-d8ce89e41bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:23.303192 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb71542-c86b-4133-a2e6-d8ce89e41bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:23.305302 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9eb71542-c86b-4133-a2e6-d8ce89e41bc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:23.369207 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb71542-c86b-4133-a2e6-d8ce89e41bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:23.370681 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb71542-c86b-4133-a2e6-d8ce89e41bc4 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:23.380841 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1242/2491] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:27.495340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0425fe4-11ff-4a8e-917c-f0e7447ddfb0 service nova] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:27.496897 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f0425fe4-11ff-4a8e-917c-f0e7447ddfb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:27.519788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0425fe4-11ff-4a8e-917c-f0e7447ddfb0 service nova] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:27.526708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df321b-23d6-4d46-8b70-2978306d8457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:27.527696 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df321b-23d6-4d46-8b70-2978306d8457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:27.528188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df321b-23d6-4d46-8b70-2978306d8457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:27.528556 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df321b-23d6-4d46-8b70-2978306d8457 admin admin] PATH_INFO: `/v3/users/e2e0f15742ea49bba055538ae4e99303` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:27.530723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df321b-23d6-4d46-8b70-2978306d8457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e0f15742ea49bba055538ae4e99303)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:27.532785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df321b-23d6-4d46-8b70-2978306d8457 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:27.585735 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c4df321b-23d6-4d46-8b70-2978306d8457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e0f15742ea49bba055538ae4e99303'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:27.593496 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c4df321b-23d6-4d46-8b70-2978306d8457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e0f15742ea49bba055538ae4e99303'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:27.594224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c4df321b-23d6-4d46-8b70-2978306d8457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e0f15742ea49bba055538ae4e99303'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:27.595488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c4df321b-23d6-4d46-8b70-2978306d8457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e0f15742ea49bba055538ae4e99303'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:27.608045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c4df321b-23d6-4d46-8b70-2978306d8457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e0f15742ea49bba055538ae4e99303'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:27.626211 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1250/2492] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:47:27 2022] DELETE /identity/v3/users/e2e0f15742ea49bba055538ae4e99303 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:47:27.907463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb71542-c86b-4133-a2e6-d8ce89e41bc4 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:27.917363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb71542-c86b-4133-a2e6-d8ce89e41bc4 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:27.971360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df321b-23d6-4d46-8b70-2978306d8457 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:27.972838 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c4df321b-23d6-4d46-8b70-2978306d8457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:28.020278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d56dd-d8d4-45c7-b5af-23c3d99c9ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:28.020721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d56dd-d8d4-45c7-b5af-23c3d99c9ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:28.021062 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d56dd-d8d4-45c7-b5af-23c3d99c9ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:28.021343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d56dd-d8d4-45c7-b5af-23c3d99c9ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:28.023429 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-ba9d56dd-d8d4-45c7-b5af-23c3d99c9ac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:28.035183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d56dd-d8d4-45c7-b5af-23c3d99c9ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:28.037024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d56dd-d8d4-45c7-b5af-23c3d99c9ac5 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:28.049040 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1243/2493] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:28.050381 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d56dd-d8d4-45c7-b5af-23c3d99c9ac5 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:28.052619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-ba9d56dd-d8d4-45c7-b5af-23c3d99c9ac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:28.073341 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df321b-23d6-4d46-8b70-2978306d8457 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:28.082617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0a0b1-a8c4-493a-878c-0c123238bdc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:28.083365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0a0b1-a8c4-493a-878c-0c123238bdc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:28.083545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0a0b1-a8c4-493a-878c-0c123238bdc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:28.084078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0a0b1-a8c4-493a-878c-0c123238bdc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:28.096828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0a0b1-a8c4-493a-878c-0c123238bdc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:28.098856 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0a0b1-a8c4-493a-878c-0c123238bdc8 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:28.109602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1251/2494] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:28.136024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d56dd-d8d4-45c7-b5af-23c3d99c9ac5 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:28.142313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39b604-d484-4d1b-be0c-78969f276f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:28.143582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39b604-d484-4d1b-be0c-78969f276f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:28.144013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39b604-d484-4d1b-be0c-78969f276f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:28.144459 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39b604-d484-4d1b-be0c-78969f276f3c admin admin] PATH_INFO: `/v3/projects/39d949f289df486faadefe44a5063929` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:28.145808 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39b604-d484-4d1b-be0c-78969f276f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d949f289df486faadefe44a5063929)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:28.147820 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39b604-d484-4d1b-be0c-78969f276f3c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:28.240401 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0e39b604-d484-4d1b-be0c-78969f276f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d949f289df486faadefe44a5063929', 'request_id': 'req-0e39b604-d484-4d1b-be0c-78969f276f3c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:28.249568 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0e39b604-d484-4d1b-be0c-78969f276f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d949f289df486faadefe44a5063929', 'request_id': 'req-0e39b604-d484-4d1b-be0c-78969f276f3c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:28.258526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0e39b604-d484-4d1b-be0c-78969f276f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d949f289df486faadefe44a5063929', 'request_id': 'req-0e39b604-d484-4d1b-be0c-78969f276f3c'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:28.275444 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0e39b604-d484-4d1b-be0c-78969f276f3c admin admin] The token cache is being invalidate because project 39d949f289df486faadefe44a5063929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:47:28.275880 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0e39b604-d484-4d1b-be0c-78969f276f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:28.276671 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0e39b604-d484-4d1b-be0c-78969f276f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:47:28.282766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1244/2495] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:47:28 2022] DELETE /identity/v3/projects/39d949f289df486faadefe44a5063929 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:47:28.284262 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300eed16-05e9-47d8-845d-5fc9fd424158 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:28.284552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300eed16-05e9-47d8-845d-5fc9fd424158 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:28.284826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300eed16-05e9-47d8-845d-5fc9fd424158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:28.313121 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-300eed16-05e9-47d8-845d-5fc9fd424158 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:47:28.316219 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-300eed16-05e9-47d8-845d-5fc9fd424158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:28.404382 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1252/2496] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:47:28.412665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de93c0-6912-4a03-9010-0aa569b6e821 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:28.413216 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de93c0-6912-4a03-9010-0aa569b6e821 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:28.413554 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de93c0-6912-4a03-9010-0aa569b6e821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:28.437065 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-c7de93c0-6912-4a03-9010-0aa569b6e821 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:47:28.438634 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c7de93c0-6912-4a03-9010-0aa569b6e821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:28.452460 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300eed16-05e9-47d8-845d-5fc9fd424158 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:28.453189 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1245/2497] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:47:28.465845 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300eed16-05e9-47d8-845d-5fc9fd424158 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:28.473259 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe4eb-92be-4a0f-9ba9-866b2f3e63c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:28.474423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe4eb-92be-4a0f-9ba9-866b2f3e63c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:28.474888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe4eb-92be-4a0f-9ba9-866b2f3e63c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:28.475323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe4eb-92be-4a0f-9ba9-866b2f3e63c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:28.476277 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfe4eb-92be-4a0f-9ba9-866b2f3e63c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:47:28.476736 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfe4eb-92be-4a0f-9ba9-866b2f3e63c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:28.482426 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfe4eb-92be-4a0f-9ba9-866b2f3e63c4 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:28.505243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1253/2498] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:47:28.508362 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de93c0-6912-4a03-9010-0aa569b6e821 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:28.522015 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de93c0-6912-4a03-9010-0aa569b6e821 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:28.527705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c3a69-007c-422a-b3a4-8b02ab71483a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:28.528669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c3a69-007c-422a-b3a4-8b02ab71483a admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:28.529296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c3a69-007c-422a-b3a4-8b02ab71483a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:28.529911 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c3a69-007c-422a-b3a4-8b02ab71483a admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:28.530940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c3a69-007c-422a-b3a4-8b02ab71483a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:28.533020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c3a69-007c-422a-b3a4-8b02ab71483a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:28.567184 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1246/2499] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:47:28 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:47:28.570822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe4eb-92be-4a0f-9ba9-866b2f3e63c4 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:28.587287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe4eb-92be-4a0f-9ba9-866b2f3e63c4 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:28.673670 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786701d-64a6-4fb7-99ff-421f36134da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:28.674809 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786701d-64a6-4fb7-99ff-421f36134da7 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:28.675258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786701d-64a6-4fb7-99ff-421f36134da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:28.676320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786701d-64a6-4fb7-99ff-421f36134da7 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:28.677194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786701d-64a6-4fb7-99ff-421f36134da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:28.680163 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786701d-64a6-4fb7-99ff-421f36134da7 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:28.713046 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1254/2500] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:47:28 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:47:28.717481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c3a69-007c-422a-b3a4-8b02ab71483a admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:28.730247 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c3a69-007c-422a-b3a4-8b02ab71483a admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:28.737648 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1db06-9ec4-4511-9806-5492c70e6852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:28.738630 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1db06-9ec4-4511-9806-5492c70e6852 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:28.739055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1db06-9ec4-4511-9806-5492c70e6852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:28.739478 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1db06-9ec4-4511-9806-5492c70e6852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:28.740816 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1db06-9ec4-4511-9806-5492c70e6852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:28.743001 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1db06-9ec4-4511-9806-5492c70e6852 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:28.758824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1247/2501] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:47:28.763721 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786701d-64a6-4fb7-99ff-421f36134da7 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:28.776556 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786701d-64a6-4fb7-99ff-421f36134da7 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:28.783602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91603a2-b8f1-4a81-91b3-caea6655c76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:28.785082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91603a2-b8f1-4a81-91b3-caea6655c76a admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:28.786160 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91603a2-b8f1-4a81-91b3-caea6655c76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:28.786966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91603a2-b8f1-4a81-91b3-caea6655c76a admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:28.789752 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91603a2-b8f1-4a81-91b3-caea6655c76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:28.792682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91603a2-b8f1-4a81-91b3-caea6655c76a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:28.805086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1255/2502] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:47:28.809371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1db06-9ec4-4511-9806-5492c70e6852 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:28.821165 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1db06-9ec4-4511-9806-5492c70e6852 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:28.826930 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671129ac-76f8-4123-b8b0-4f3901dd1fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:28.827820 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671129ac-76f8-4123-b8b0-4f3901dd1fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:28.828128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671129ac-76f8-4123-b8b0-4f3901dd1fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:28.828396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671129ac-76f8-4123-b8b0-4f3901dd1fe5 admin admin] PATH_INFO: `/v3/projects/ef541155816d4ac0938103cc1c142845/users/6e94bc50928f4fc28f804cac5b6293ed/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:28.843897 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671129ac-76f8-4123-b8b0-4f3901dd1fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef541155816d4ac0938103cc1c142845, user_id=6e94bc50928f4fc28f804cac5b6293ed, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:28.846560 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671129ac-76f8-4123-b8b0-4f3901dd1fe5 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:28.859814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1248/2503] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:47:28 2022] PUT /identity/v3/projects/ef541155816d4ac0938103cc1c142845/users/6e94bc50928f4fc28f804cac5b6293ed/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:47:28.865097 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115d0e4-a32e-44ee-9686-08d43fe5502f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:28.865467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115d0e4-a32e-44ee-9686-08d43fe5502f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:28.865760 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115d0e4-a32e-44ee-9686-08d43fe5502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:28.883172 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-c115d0e4-a32e-44ee-9686-08d43fe5502f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:47:28.884374 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c115d0e4-a32e-44ee-9686-08d43fe5502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:28.947360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1256/2504] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:47:28.963783 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671129ac-76f8-4123-b8b0-4f3901dd1fe5 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:28.966072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-671129ac-76f8-4123-b8b0-4f3901dd1fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:29.032741 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671129ac-76f8-4123-b8b0-4f3901dd1fe5 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:29.038215 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1f1de-3311-451b-93ef-b871c3110825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:29.039191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1f1de-3311-451b-93ef-b871c3110825 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:29.039462 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1f1de-3311-451b-93ef-b871c3110825 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:29.039739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1f1de-3311-451b-93ef-b871c3110825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:29.051775 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1f1de-3311-451b-93ef-b871c3110825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:29.053717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1f1de-3311-451b-93ef-b871c3110825 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:29.070976 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1249/2505] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:31.708203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115d0e4-a32e-44ee-9686-08d43fe5502f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:31.709626 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c115d0e4-a32e-44ee-9686-08d43fe5502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:31.722312 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115d0e4-a32e-44ee-9686-08d43fe5502f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:31.725876 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d55b23-36af-4ef5-a4c8-33e88b95b540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:31.726576 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d55b23-36af-4ef5-a4c8-33e88b95b540 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:31.726856 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d55b23-36af-4ef5-a4c8-33e88b95b540 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:31.727123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d55b23-36af-4ef5-a4c8-33e88b95b540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:31.728879 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b1d55b23-36af-4ef5-a4c8-33e88b95b540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:31.738758 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d55b23-36af-4ef5-a4c8-33e88b95b540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:31.741278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d55b23-36af-4ef5-a4c8-33e88b95b540 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:31.749949 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1257/2506] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:31.874429 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b42a38-678b-4d60-8591-e8ef762aab73 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:31.875013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b42a38-678b-4d60-8591-e8ef762aab73 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:31.875013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b42a38-678b-4d60-8591-e8ef762aab73 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:31.876514 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1250/2507] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 5 15:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:47:31.883959 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd427d-21b9-4647-8998-cc33ee62cbf0 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:31.884229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd427d-21b9-4647-8998-cc33ee62cbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:31.884512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd427d-21b9-4647-8998-cc33ee62cbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:31.912113 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-bdcd427d-21b9-4647-8998-cc33ee62cbf0 None None] MFA Rules not processed for user `2fe9f8eb94c84c36ad7a49507b2c8360`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:47:31.913348 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-bdcd427d-21b9-4647-8998-cc33ee62cbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:31.920763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1258/2508] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 5 15:47:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:47:31.935375 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b42a38-678b-4d60-8591-e8ef762aab73 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:31.947470 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b42a38-678b-4d60-8591-e8ef762aab73 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:31.951486 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660da339-fe67-4cfc-b957-a21464e6d222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:31.952216 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660da339-fe67-4cfc-b957-a21464e6d222 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:31.952508 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660da339-fe67-4cfc-b957-a21464e6d222 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:31.952785 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660da339-fe67-4cfc-b957-a21464e6d222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:31.961649 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660da339-fe67-4cfc-b957-a21464e6d222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:31.963089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660da339-fe67-4cfc-b957-a21464e6d222 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:31.972553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1251/2509] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:32.068583 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77405693-a024-4962-a353-849d5c473f84 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:32.069229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77405693-a024-4962-a353-849d5c473f84 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:32.069513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77405693-a024-4962-a353-849d5c473f84 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:32.071057 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1259/2510] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 5 15:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:47:32.077759 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f67566-de68-41d7-b831-3c7d1c131fa2 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:32.078043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f67566-de68-41d7-b831-3c7d1c131fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:32.078350 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f67566-de68-41d7-b831-3c7d1c131fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:32.126833 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-35f67566-de68-41d7-b831-3c7d1c131fa2 None None] MFA Rules not processed for user `2a29a4b1b1aa45aea2e466d8f8b79365`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:47:32.128315 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-35f67566-de68-41d7-b831-3c7d1c131fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:32.221585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1252/2511] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 5 15:47:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:47:32.245040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77405693-a024-4962-a353-849d5c473f84 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:32.261933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77405693-a024-4962-a353-849d5c473f84 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:32.271000 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23335b09-a540-469d-8cb1-95a70871a83d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:32.271788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23335b09-a540-469d-8cb1-95a70871a83d service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:32.272739 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23335b09-a540-469d-8cb1-95a70871a83d service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:32.273245 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23335b09-a540-469d-8cb1-95a70871a83d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:32.287246 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23335b09-a540-469d-8cb1-95a70871a83d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:32.289600 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23335b09-a540-469d-8cb1-95a70871a83d service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:32.304488 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1260/2512] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:32.389997 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f67566-de68-41d7-b831-3c7d1c131fa2 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:32.392191 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-35f67566-de68-41d7-b831-3c7d1c131fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:32.550940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f67566-de68-41d7-b831-3c7d1c131fa2 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:32.556432 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5a4a0-4d11-458a-9128-19e5258cf85d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12f5d874be84f1ca79eb439267c7b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:32.557097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5a4a0-4d11-458a-9128-19e5258cf85d service placement] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:32.557377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5a4a0-4d11-458a-9128-19e5258cf85d service placement] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:32.557652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5a4a0-4d11-458a-9128-19e5258cf85d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:32.559526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-36b5a4a0-4d11-458a-9128-19e5258cf85d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:32.572281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5a4a0-4d11-458a-9128-19e5258cf85d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:32.574662 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5a4a0-4d11-458a-9128-19e5258cf85d service placement] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:32.588119 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1253/2513] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:33.754527 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23335b09-a540-469d-8cb1-95a70871a83d service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:33.756648 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-23335b09-a540-469d-8cb1-95a70871a83d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:33.773430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23335b09-a540-469d-8cb1-95a70871a83d service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:33.781087 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b2753-86ef-47c3-8147-d4f4bb6960e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:33.782159 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b2753-86ef-47c3-8147-d4f4bb6960e7 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:33.782612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b2753-86ef-47c3-8147-d4f4bb6960e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:33.783040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b2753-86ef-47c3-8147-d4f4bb6960e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:33.785419 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a34b2753-86ef-47c3-8147-d4f4bb6960e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:33.857441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b2753-86ef-47c3-8147-d4f4bb6960e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:33.859098 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b2753-86ef-47c3-8147-d4f4bb6960e7 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:33.868866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1261/2514] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:35.565912 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ad6e6-1480-47d6-95dc-725c1961bc51 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:35.566490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ad6e6-1480-47d6-95dc-725c1961bc51 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:35.566490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ad6e6-1480-47d6-95dc-725c1961bc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:35.604676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-730ad6e6-1480-47d6-95dc-725c1961bc51 None None] MFA Rules not processed for user `6e94bc50928f4fc28f804cac5b6293ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:47:35.606931 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-730ad6e6-1480-47d6-95dc-725c1961bc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:35.685550 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1254/2515] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:47:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:47:35.697628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b2753-86ef-47c3-8147-d4f4bb6960e7 service nova] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:35.716334 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b2753-86ef-47c3-8147-d4f4bb6960e7 service nova] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:35.722309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715f5c5-9f02-49f9-a3ed-7fae3f9de6ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:35.723250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715f5c5-9f02-49f9-a3ed-7fae3f9de6ce service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:35.723533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715f5c5-9f02-49f9-a3ed-7fae3f9de6ce service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:35.723810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715f5c5-9f02-49f9-a3ed-7fae3f9de6ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:35.733117 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715f5c5-9f02-49f9-a3ed-7fae3f9de6ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:35.735172 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715f5c5-9f02-49f9-a3ed-7fae3f9de6ce service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:35.745936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1262/2516] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:36.183326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841f193-81cc-4094-9df0-a0b411b3e198 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:36.183620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841f193-81cc-4094-9df0-a0b411b3e198 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:36.183946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841f193-81cc-4094-9df0-a0b411b3e198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:36.207154 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-9841f193-81cc-4094-9df0-a0b411b3e198 None None] MFA Rules not processed for user `1b9eeed01d41446986dbf37c15ee4e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:47:36.208383 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9841f193-81cc-4094-9df0-a0b411b3e198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:36.221561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1255/2517] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:47:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:47:37.806102 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96fa24-8efa-4228-bfc0-b82f8fa10116 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:37.806564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96fa24-8efa-4228-bfc0-b82f8fa10116 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:37.806694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96fa24-8efa-4228-bfc0-b82f8fa10116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:37.840448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ac96fa24-8efa-4228-bfc0-b82f8fa10116 None None] MFA Rules not processed for user `6e94bc50928f4fc28f804cac5b6293ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:47:37.842475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ac96fa24-8efa-4228-bfc0-b82f8fa10116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:37.850461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1263/2518] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:47:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:47:40.228444 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841f193-81cc-4094-9df0-a0b411b3e198 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:40.230060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9841f193-81cc-4094-9df0-a0b411b3e198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:40.259668 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841f193-81cc-4094-9df0-a0b411b3e198 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:40.267985 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d9972-d274-43f0-8094-ed9477bdf0af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:40.268904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d9972-d274-43f0-8094-ed9477bdf0af service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:40.269346 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d9972-d274-43f0-8094-ed9477bdf0af service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:40.269809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d9972-d274-43f0-8094-ed9477bdf0af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:40.271900 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-3d8d9972-d274-43f0-8094-ed9477bdf0af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:40.286699 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d9972-d274-43f0-8094-ed9477bdf0af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:40.288824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d9972-d274-43f0-8094-ed9477bdf0af service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:40.302856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1256/2519] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:41.803135 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96fa24-8efa-4228-bfc0-b82f8fa10116 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:41.820674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96fa24-8efa-4228-bfc0-b82f8fa10116 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:41.826953 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52d23d-684a-438e-b4f1-b9ffe57aecce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:41.827944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52d23d-684a-438e-b4f1-b9ffe57aecce service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:41.828332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52d23d-684a-438e-b4f1-b9ffe57aecce service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:41.828632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52d23d-684a-438e-b4f1-b9ffe57aecce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:41.830627 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8f52d23d-684a-438e-b4f1-b9ffe57aecce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:41.848548 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52d23d-684a-438e-b4f1-b9ffe57aecce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:41.850139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52d23d-684a-438e-b4f1-b9ffe57aecce service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:41.866517 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1264/2520] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:46.383908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d9972-d274-43f0-8094-ed9477bdf0af service nova] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:47:46.401235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d9972-d274-43f0-8094-ed9477bdf0af service nova] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:47:46.412926 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e028d5-9fe8-4fdc-b0a6-cc92187d120d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:47:46.413613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e028d5-9fe8-4fdc-b0a6-cc92187d120d service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:46.413893 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e028d5-9fe8-4fdc-b0a6-cc92187d120d service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:46.414355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e028d5-9fe8-4fdc-b0a6-cc92187d120d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:46.419602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-23e028d5-9fe8-4fdc-b0a6-cc92187d120d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:46.432999 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e028d5-9fe8-4fdc-b0a6-cc92187d120d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:47:46.434631 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e028d5-9fe8-4fdc-b0a6-cc92187d120d service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:47:46.446998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1257/2521] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:47:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:47:53.093671 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272d5ea-16c2-498e-9691-9d2d2019fd2d None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:47:53.094297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272d5ea-16c2-498e-9691-9d2d2019fd2d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:47:53.094405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272d5ea-16c2-498e-9691-9d2d2019fd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:47:53.112126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a272d5ea-16c2-498e-9691-9d2d2019fd2d None None] MFA Rules not processed for user `4b161aa0d704420baaedf64d635f85ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:47:53.113593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a272d5ea-16c2-498e-9691-9d2d2019fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:47:53.174952 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1265/2522] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:47:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:48:57.129465 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e1680-e50d-4bb9-a847-21d402a48846 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:48:57.129935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e1680-e50d-4bb9-a847-21d402a48846 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:48:57.130030 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e1680-e50d-4bb9-a847-21d402a48846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:48:57.147299 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-812e1680-e50d-4bb9-a847-21d402a48846 None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:48:57.148503 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-812e1680-e50d-4bb9-a847-21d402a48846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:48:57.201007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1258/2523] 10.222.0.58 () {58 vars in 967 bytes} [Thu May 5 15:48:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:48:57.242473 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272d5ea-16c2-498e-9691-9d2d2019fd2d None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:48:57.243902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a272d5ea-16c2-498e-9691-9d2d2019fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:48:57.315389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272d5ea-16c2-498e-9691-9d2d2019fd2d None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:48:57.320470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499cdef-f1c0-46ca-9602-ca2e7805625d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:48:57.321115 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499cdef-f1c0-46ca-9602-ca2e7805625d service swift] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:48:57.321401 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499cdef-f1c0-46ca-9602-ca2e7805625d service swift] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:48:57.321679 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499cdef-f1c0-46ca-9602-ca2e7805625d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:48:57.330253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499cdef-f1c0-46ca-9602-ca2e7805625d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:48:57.331766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499cdef-f1c0-46ca-9602-ca2e7805625d service swift] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:48:57.340331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1266/2524] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:48:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:48:59.012408 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8225-32fe-484c-bd3e-812fa042bec7 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:48:59.012921 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8225-32fe-484c-bd3e-812fa042bec7 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:48:59.013001 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8225-32fe-484c-bd3e-812fa042bec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:48:59.034862 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-82cc8225-32fe-484c-bd3e-812fa042bec7 None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:48:59.036377 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-82cc8225-32fe-484c-bd3e-812fa042bec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:48:59.046628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1259/2525] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 5 15:48:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:48:59.060360 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499cdef-f1c0-46ca-9602-ca2e7805625d service swift] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:48:59.073095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499cdef-f1c0-46ca-9602-ca2e7805625d service swift] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:48:59.079800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34f682-9cbd-44f0-a399-761102ba764d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:48:59.080690 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34f682-9cbd-44f0-a399-761102ba764d service swift] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:48:59.081209 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34f682-9cbd-44f0-a399-761102ba764d service swift] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:48:59.081695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34f682-9cbd-44f0-a399-761102ba764d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:48:59.097423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34f682-9cbd-44f0-a399-761102ba764d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:48:59.100892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34f682-9cbd-44f0-a399-761102ba764d service swift] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:48:59.133996 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1267/2526] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:48:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 15:49:06.918798 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc8225-32fe-484c-bd3e-812fa042bec7 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:06.920903 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-82cc8225-32fe-484c-bd3e-812fa042bec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:06.942578 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc8225-32fe-484c-bd3e-812fa042bec7 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:06.952967 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de42626-cd4e-4df6-a566-a5224b15e596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:06.954196 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42626-cd4e-4df6-a566-a5224b15e596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:06.954682 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42626-cd4e-4df6-a566-a5224b15e596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:06.955122 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42626-cd4e-4df6-a566-a5224b15e596 admin admin] PATH_INFO: `/v3/users/2686a0d7f7da49fb8e79f10cf9be0108` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:06.956834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de42626-cd4e-4df6-a566-a5224b15e596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2686a0d7f7da49fb8e79f10cf9be0108)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:06.959416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de42626-cd4e-4df6-a566-a5224b15e596 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:07.024421 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0de42626-cd4e-4df6-a566-a5224b15e596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2686a0d7f7da49fb8e79f10cf9be0108'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:07.025174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0de42626-cd4e-4df6-a566-a5224b15e596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2686a0d7f7da49fb8e79f10cf9be0108'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:07.033906 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0de42626-cd4e-4df6-a566-a5224b15e596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2686a0d7f7da49fb8e79f10cf9be0108'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:07.041887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0de42626-cd4e-4df6-a566-a5224b15e596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2686a0d7f7da49fb8e79f10cf9be0108'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:07.042885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0de42626-cd4e-4df6-a566-a5224b15e596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2686a0d7f7da49fb8e79f10cf9be0108'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:07.069732 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1260/2527] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:06 2022] DELETE /identity/v3/users/2686a0d7f7da49fb8e79f10cf9be0108 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:07.107418 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34f682-9cbd-44f0-a399-761102ba764d service swift] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:07.117996 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34f682-9cbd-44f0-a399-761102ba764d service swift] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:07.180890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41faff-1a2d-43a8-a409-a641749b11f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:07.181637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41faff-1a2d-43a8-a409-a641749b11f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:07.182027 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41faff-1a2d-43a8-a409-a641749b11f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:07.182399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41faff-1a2d-43a8-a409-a641749b11f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:07.185010 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9f41faff-1a2d-43a8-a409-a641749b11f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:07.279660 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41faff-1a2d-43a8-a409-a641749b11f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:07.282902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41faff-1a2d-43a8-a409-a641749b11f9 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:07.313450 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1268/2528] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:07.342150 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de42626-cd4e-4df6-a566-a5224b15e596 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:07.343728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-0de42626-cd4e-4df6-a566-a5224b15e596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:07.368092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de42626-cd4e-4df6-a566-a5224b15e596 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:07.373731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742dfb9-726b-4015-afca-ffa89962a53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:07.375184 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742dfb9-726b-4015-afca-ffa89962a53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:07.375467 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742dfb9-726b-4015-afca-ffa89962a53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:07.376680 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742dfb9-726b-4015-afca-ffa89962a53f admin admin] PATH_INFO: `/v3/projects/c514ad1026564ac69a8ea5f4443371f7` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:07.378615 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742dfb9-726b-4015-afca-ffa89962a53f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c514ad1026564ac69a8ea5f4443371f7)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:07.381227 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742dfb9-726b-4015-afca-ffa89962a53f admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:07.465698 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7742dfb9-726b-4015-afca-ffa89962a53f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c514ad1026564ac69a8ea5f4443371f7', 'request_id': 'req-7742dfb9-726b-4015-afca-ffa89962a53f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:07.472707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7742dfb9-726b-4015-afca-ffa89962a53f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c514ad1026564ac69a8ea5f4443371f7', 'request_id': 'req-7742dfb9-726b-4015-afca-ffa89962a53f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:07.492129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7742dfb9-726b-4015-afca-ffa89962a53f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c514ad1026564ac69a8ea5f4443371f7', 'request_id': 'req-7742dfb9-726b-4015-afca-ffa89962a53f'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:07.527615 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7742dfb9-726b-4015-afca-ffa89962a53f admin admin] The token cache is being invalidate because project c514ad1026564ac69a8ea5f4443371f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:07.527982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7742dfb9-726b-4015-afca-ffa89962a53f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:07.528592 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7742dfb9-726b-4015-afca-ffa89962a53f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:07.533692 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1261/2529] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:07 2022] DELETE /identity/v3/projects/c514ad1026564ac69a8ea5f4443371f7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:07.534932 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41faff-1a2d-43a8-a409-a641749b11f9 service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:07.552739 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41faff-1a2d-43a8-a409-a641749b11f9 service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:07.665327 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd53852-e75e-48e5-a6ed-dc953a543583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:07.666650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd53852-e75e-48e5-a6ed-dc953a543583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:07.667170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd53852-e75e-48e5-a6ed-dc953a543583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:07.667641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd53852-e75e-48e5-a6ed-dc953a543583 admin admin] PATH_INFO: `/v3/users/0bc4c90113734cae9fc2d4b64b29089f` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:07.669314 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd53852-e75e-48e5-a6ed-dc953a543583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bc4c90113734cae9fc2d4b64b29089f)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:07.671267 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd53852-e75e-48e5-a6ed-dc953a543583 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:07.740211 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-1fd53852-e75e-48e5-a6ed-dc953a543583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bc4c90113734cae9fc2d4b64b29089f'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:07.749314 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-1fd53852-e75e-48e5-a6ed-dc953a543583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bc4c90113734cae9fc2d4b64b29089f'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:07.750405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-1fd53852-e75e-48e5-a6ed-dc953a543583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bc4c90113734cae9fc2d4b64b29089f'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:07.751411 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-1fd53852-e75e-48e5-a6ed-dc953a543583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bc4c90113734cae9fc2d4b64b29089f'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:07.767756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-1fd53852-e75e-48e5-a6ed-dc953a543583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bc4c90113734cae9fc2d4b64b29089f'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:07.785525 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1269/2530] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:07 2022] DELETE /identity/v3/users/0bc4c90113734cae9fc2d4b64b29089f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:49:08.035566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742dfb9-726b-4015-afca-ffa89962a53f admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:08.039471 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7742dfb9-726b-4015-afca-ffa89962a53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:08.061629 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742dfb9-726b-4015-afca-ffa89962a53f admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:08.137688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92102287-224a-4024-b527-bb9942da81ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:08.138840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92102287-224a-4024-b527-bb9942da81ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:08.139349 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92102287-224a-4024-b527-bb9942da81ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:08.139807 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92102287-224a-4024-b527-bb9942da81ff admin admin] PATH_INFO: `/v3/projects/e7ca00cab61a48839a14ea98c12f0db6` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:08.141415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92102287-224a-4024-b527-bb9942da81ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ca00cab61a48839a14ea98c12f0db6)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:08.143783 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92102287-224a-4024-b527-bb9942da81ff admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:08.268201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-92102287-224a-4024-b527-bb9942da81ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ca00cab61a48839a14ea98c12f0db6', 'request_id': 'req-92102287-224a-4024-b527-bb9942da81ff'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:08.276271 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-92102287-224a-4024-b527-bb9942da81ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ca00cab61a48839a14ea98c12f0db6', 'request_id': 'req-92102287-224a-4024-b527-bb9942da81ff'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:08.283835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-92102287-224a-4024-b527-bb9942da81ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ca00cab61a48839a14ea98c12f0db6', 'request_id': 'req-92102287-224a-4024-b527-bb9942da81ff'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:08.306995 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-92102287-224a-4024-b527-bb9942da81ff admin admin] The token cache is being invalidate because project e7ca00cab61a48839a14ea98c12f0db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:08.307319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-92102287-224a-4024-b527-bb9942da81ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:08.308643 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-92102287-224a-4024-b527-bb9942da81ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:08.310803 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1262/2531] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:08 2022] DELETE /identity/v3/projects/e7ca00cab61a48839a14ea98c12f0db6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:11.382727 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd53852-e75e-48e5-a6ed-dc953a543583 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:11.384323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-1fd53852-e75e-48e5-a6ed-dc953a543583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:11.398702 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd53852-e75e-48e5-a6ed-dc953a543583 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:11.453547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d606ef9-9f02-4f4d-b8aa-2cc2536f36fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:11.454447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d606ef9-9f02-4f4d-b8aa-2cc2536f36fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:11.454722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d606ef9-9f02-4f4d-b8aa-2cc2536f36fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:11.454992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d606ef9-9f02-4f4d-b8aa-2cc2536f36fa admin admin] PATH_INFO: `/v3/users/1b9eeed01d41446986dbf37c15ee4e2e` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:11.456160 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d606ef9-9f02-4f4d-b8aa-2cc2536f36fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9eeed01d41446986dbf37c15ee4e2e)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:11.458331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d606ef9-9f02-4f4d-b8aa-2cc2536f36fa admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:11.502019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-5d606ef9-9f02-4f4d-b8aa-2cc2536f36fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9eeed01d41446986dbf37c15ee4e2e'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:11.509715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-5d606ef9-9f02-4f4d-b8aa-2cc2536f36fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9eeed01d41446986dbf37c15ee4e2e'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:11.510786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-5d606ef9-9f02-4f4d-b8aa-2cc2536f36fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9eeed01d41446986dbf37c15ee4e2e'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:11.512078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-5d606ef9-9f02-4f4d-b8aa-2cc2536f36fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9eeed01d41446986dbf37c15ee4e2e'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:11.526032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-5d606ef9-9f02-4f4d-b8aa-2cc2536f36fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9eeed01d41446986dbf37c15ee4e2e'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:11.540704 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1270/2532] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:11 2022] DELETE /identity/v3/users/1b9eeed01d41446986dbf37c15ee4e2e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:49:11.824707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92102287-224a-4024-b527-bb9942da81ff admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:11.827211 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-92102287-224a-4024-b527-bb9942da81ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:11.846298 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92102287-224a-4024-b527-bb9942da81ff admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:11.908523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2272b-aa19-46d3-8090-686899e597c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:11.909306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2272b-aa19-46d3-8090-686899e597c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:11.909588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2272b-aa19-46d3-8090-686899e597c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:11.909863 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2272b-aa19-46d3-8090-686899e597c4 admin admin] PATH_INFO: `/v3/projects/bd7f78fcf0be461796d2a86956cf3b9d` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:11.911083 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2272b-aa19-46d3-8090-686899e597c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7f78fcf0be461796d2a86956cf3b9d)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:11.912987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2272b-aa19-46d3-8090-686899e597c4 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:11.961810 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-c1c2272b-aa19-46d3-8090-686899e597c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7f78fcf0be461796d2a86956cf3b9d', 'request_id': 'req-c1c2272b-aa19-46d3-8090-686899e597c4'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:11.968087 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-c1c2272b-aa19-46d3-8090-686899e597c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7f78fcf0be461796d2a86956cf3b9d', 'request_id': 'req-c1c2272b-aa19-46d3-8090-686899e597c4'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:11.974084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-c1c2272b-aa19-46d3-8090-686899e597c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7f78fcf0be461796d2a86956cf3b9d', 'request_id': 'req-c1c2272b-aa19-46d3-8090-686899e597c4'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:11.987977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-c1c2272b-aa19-46d3-8090-686899e597c4 admin admin] The token cache is being invalidate because project bd7f78fcf0be461796d2a86956cf3b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:11.988318 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-c1c2272b-aa19-46d3-8090-686899e597c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:11.988965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-c1c2272b-aa19-46d3-8090-686899e597c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:11.991153 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1263/2533] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:11 2022] DELETE /identity/v3/projects/bd7f78fcf0be461796d2a86956cf3b9d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:11.996758 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74dc37-2f07-4892-ab95-5c8cdb1e2ef6 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:11.996945 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74dc37-2f07-4892-ab95-5c8cdb1e2ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:11.997140 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74dc37-2f07-4892-ab95-5c8cdb1e2ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.015331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-2c74dc37-2f07-4892-ab95-5c8cdb1e2ef6 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:12.016536 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-2c74dc37-2f07-4892-ab95-5c8cdb1e2ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:12.078709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1271/2534] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:12.086726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda4189-1be2-4fad-a026-26524bd97f70 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:12.087004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda4189-1be2-4fad-a026-26524bd97f70 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:12.087278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda4189-1be2-4fad-a026-26524bd97f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.106083 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-bcda4189-1be2-4fad-a026-26524bd97f70 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:12.107310 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bcda4189-1be2-4fad-a026-26524bd97f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:12.115295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1264/2535] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:12.119266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74dc37-2f07-4892-ab95-5c8cdb1e2ef6 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:12.128700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74dc37-2f07-4892-ab95-5c8cdb1e2ef6 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:12.133196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe3496-3530-4f2f-ac8b-11976b6a2ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:12.133844 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe3496-3530-4f2f-ac8b-11976b6a2ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:12.134122 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe3496-3530-4f2f-ac8b-11976b6a2ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:12.134427 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe3496-3530-4f2f-ac8b-11976b6a2ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.135144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe3496-3530-4f2f-ac8b-11976b6a2ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:49:12.135444 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe3496-3530-4f2f-ac8b-11976b6a2ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:12.137115 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe3496-3530-4f2f-ac8b-11976b6a2ae7 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:12.148336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1272/2536] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:49:12.153162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda4189-1be2-4fad-a026-26524bd97f70 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:12.162574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda4189-1be2-4fad-a026-26524bd97f70 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:12.167211 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5df834-86d9-4d8d-a365-459d105182d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:12.167952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5df834-86d9-4d8d-a365-459d105182d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:12.168235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5df834-86d9-4d8d-a365-459d105182d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:12.168517 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5df834-86d9-4d8d-a365-459d105182d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.169204 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5df834-86d9-4d8d-a365-459d105182d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:12.171150 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5df834-86d9-4d8d-a365-459d105182d0 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:12.207410 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1265/2537] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:49:12 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:12.211136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe3496-3530-4f2f-ac8b-11976b6a2ae7 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:12.221217 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe3496-3530-4f2f-ac8b-11976b6a2ae7 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:12.281018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e968a98-5d20-4835-927a-d31b9af3375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:12.281692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e968a98-5d20-4835-927a-d31b9af3375f admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:12.281977 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e968a98-5d20-4835-927a-d31b9af3375f admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:12.282286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e968a98-5d20-4835-927a-d31b9af3375f admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.282981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e968a98-5d20-4835-927a-d31b9af3375f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:12.284881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e968a98-5d20-4835-927a-d31b9af3375f admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:12.307966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1273/2538] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:49:12 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:12.309637 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5df834-86d9-4d8d-a365-459d105182d0 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:12.319737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5df834-86d9-4d8d-a365-459d105182d0 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:12.325614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204d797-6d0e-4aa4-beb2-988a5e5d717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:12.326420 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204d797-6d0e-4aa4-beb2-988a5e5d717b admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:12.326722 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204d797-6d0e-4aa4-beb2-988a5e5d717b admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:12.327056 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204d797-6d0e-4aa4-beb2-988a5e5d717b admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.327776 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204d797-6d0e-4aa4-beb2-988a5e5d717b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:12.329361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204d797-6d0e-4aa4-beb2-988a5e5d717b admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:12.339946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1266/2539] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:12.343883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e968a98-5d20-4835-927a-d31b9af3375f admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:12.353581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e968a98-5d20-4835-927a-d31b9af3375f admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:12.358213 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ce9f4-377b-4d77-8d0a-f5db2f6cdf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:12.358869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ce9f4-377b-4d77-8d0a-f5db2f6cdf9f admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:12.359149 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ce9f4-377b-4d77-8d0a-f5db2f6cdf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:12.359423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ce9f4-377b-4d77-8d0a-f5db2f6cdf9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.360170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ce9f4-377b-4d77-8d0a-f5db2f6cdf9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:12.361733 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ce9f4-377b-4d77-8d0a-f5db2f6cdf9f admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:12.372664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1274/2540] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:12.376629 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204d797-6d0e-4aa4-beb2-988a5e5d717b admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:12.387569 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204d797-6d0e-4aa4-beb2-988a5e5d717b admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:12.392202 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86b447-e9ec-40d0-aa05-cf9c6df6124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:12.393074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86b447-e9ec-40d0-aa05-cf9c6df6124b admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:12.393357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86b447-e9ec-40d0-aa05-cf9c6df6124b admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:12.393630 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86b447-e9ec-40d0-aa05-cf9c6df6124b admin admin] PATH_INFO: `/v3/projects/8eef5ac57630498e89acf752384ccaf8/users/82a370918f0c49bfbb5f8448c99e3795/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.408335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86b447-e9ec-40d0-aa05-cf9c6df6124b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eef5ac57630498e89acf752384ccaf8, user_id=82a370918f0c49bfbb5f8448c99e3795, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:12.411010 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86b447-e9ec-40d0-aa05-cf9c6df6124b admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:12.424197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1267/2541] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:12 2022] PUT /identity/v3/projects/8eef5ac57630498e89acf752384ccaf8/users/82a370918f0c49bfbb5f8448c99e3795/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:12.436271 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27980933-93b1-4f5b-8cee-676542591466 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:12.436773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27980933-93b1-4f5b-8cee-676542591466 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:12.436878 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27980933-93b1-4f5b-8cee-676542591466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.462990 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-27980933-93b1-4f5b-8cee-676542591466 None None] MFA Rules not processed for user `82a370918f0c49bfbb5f8448c99e3795`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:12.465551 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-27980933-93b1-4f5b-8cee-676542591466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:12.529145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1275/2542] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:12.533595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86b447-e9ec-40d0-aa05-cf9c6df6124b admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:12.592258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86b447-e9ec-40d0-aa05-cf9c6df6124b admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:12.596784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423c7be-8ef0-4f7a-862c-2db389425f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:12.597427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423c7be-8ef0-4f7a-862c-2db389425f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:12.597710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423c7be-8ef0-4f7a-862c-2db389425f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:12.597990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423c7be-8ef0-4f7a-862c-2db389425f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.598704 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423c7be-8ef0-4f7a-862c-2db389425f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:12.600577 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423c7be-8ef0-4f7a-862c-2db389425f00 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:12.625477 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1268/2543] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:49:12 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:12.629641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27980933-93b1-4f5b-8cee-676542591466 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:12.640326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27980933-93b1-4f5b-8cee-676542591466 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:12.694757 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f9cfe-4182-47f3-8c8e-342c1e04e298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:12.695351 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f9cfe-4182-47f3-8c8e-342c1e04e298 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:12.695633 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f9cfe-4182-47f3-8c8e-342c1e04e298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:12.695910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f9cfe-4182-47f3-8c8e-342c1e04e298 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.696585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f9cfe-4182-47f3-8c8e-342c1e04e298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:12.698796 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f9cfe-4182-47f3-8c8e-342c1e04e298 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:12.718038 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1276/2544] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:49:12 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:12.721964 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423c7be-8ef0-4f7a-862c-2db389425f00 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:12.732900 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423c7be-8ef0-4f7a-862c-2db389425f00 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:12.737431 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca65431-2a54-4c96-8caf-271c4861455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:12.738090 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca65431-2a54-4c96-8caf-271c4861455b admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:12.738408 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca65431-2a54-4c96-8caf-271c4861455b admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:12.738684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca65431-2a54-4c96-8caf-271c4861455b admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.739401 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca65431-2a54-4c96-8caf-271c4861455b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:12.740982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca65431-2a54-4c96-8caf-271c4861455b admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:12.751985 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1269/2545] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:12.756032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f9cfe-4182-47f3-8c8e-342c1e04e298 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:12.768773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f9cfe-4182-47f3-8c8e-342c1e04e298 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:12.773438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97c189-5b60-4943-94e8-601811896fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:12.774349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97c189-5b60-4943-94e8-601811896fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:12.774633 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97c189-5b60-4943-94e8-601811896fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:12.774908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97c189-5b60-4943-94e8-601811896fe6 admin admin] PATH_INFO: `/v3/projects/d26c019ca1494fdb92b0b0a1780fb4ca/users/d0dc04b51f5744659acefad9b9f68b4b/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.791342 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97c189-5b60-4943-94e8-601811896fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26c019ca1494fdb92b0b0a1780fb4ca, user_id=d0dc04b51f5744659acefad9b9f68b4b, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:12.794873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97c189-5b60-4943-94e8-601811896fe6 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:12.807820 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1277/2546] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:12 2022] PUT /identity/v3/projects/d26c019ca1494fdb92b0b0a1780fb4ca/users/d0dc04b51f5744659acefad9b9f68b4b/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:49:12.811946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca65431-2a54-4c96-8caf-271c4861455b admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:12.821706 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca65431-2a54-4c96-8caf-271c4861455b admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:12.877345 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d19e16-2fe4-4b15-82ac-2eb314ab636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:12.877990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d19e16-2fe4-4b15-82ac-2eb314ab636f admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:12.878309 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d19e16-2fe4-4b15-82ac-2eb314ab636f admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:12.878584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d19e16-2fe4-4b15-82ac-2eb314ab636f admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.879290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d19e16-2fe4-4b15-82ac-2eb314ab636f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:12.880878 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d19e16-2fe4-4b15-82ac-2eb314ab636f admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:12.890589 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1270/2547] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:12.894773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97c189-5b60-4943-94e8-601811896fe6 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:12.905890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97c189-5b60-4943-94e8-601811896fe6 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:12.910412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464e7bf-5599-4fb8-9c91-dedba9c5a10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:12.911291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464e7bf-5599-4fb8-9c91-dedba9c5a10e admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:12.911567 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464e7bf-5599-4fb8-9c91-dedba9c5a10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:12.911842 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464e7bf-5599-4fb8-9c91-dedba9c5a10e admin admin] PATH_INFO: `/v3/projects/d26c019ca1494fdb92b0b0a1780fb4ca/users/d0dc04b51f5744659acefad9b9f68b4b/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.913775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464e7bf-5599-4fb8-9c91-dedba9c5a10e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26c019ca1494fdb92b0b0a1780fb4ca, user_id=d0dc04b51f5744659acefad9b9f68b4b, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:12.916427 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464e7bf-5599-4fb8-9c91-dedba9c5a10e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:12.926904 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1278/2548] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:12 2022] PUT /identity/v3/projects/d26c019ca1494fdb92b0b0a1780fb4ca/users/d0dc04b51f5744659acefad9b9f68b4b/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:12.937630 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4e13a-f7a9-4ef5-8ee7-b1a4817704de None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:12.937920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4e13a-f7a9-4ef5-8ee7-b1a4817704de None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:12.938235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4e13a-f7a9-4ef5-8ee7-b1a4817704de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:12.963507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-fbb4e13a-f7a9-4ef5-8ee7-b1a4817704de None None] MFA Rules not processed for user `d0dc04b51f5744659acefad9b9f68b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:12.965231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-fbb4e13a-f7a9-4ef5-8ee7-b1a4817704de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:13.029675 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1271/2549] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:13.040789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464e7bf-5599-4fb8-9c91-dedba9c5a10e admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:13.042637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8464e7bf-5599-4fb8-9c91-dedba9c5a10e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:13.099793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464e7bf-5599-4fb8-9c91-dedba9c5a10e admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:13.103414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2eddc-0548-4c3f-96ab-f93f0ee72530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:13.104056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2eddc-0548-4c3f-96ab-f93f0ee72530 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:13.104338 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2eddc-0548-4c3f-96ab-f93f0ee72530 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:13.104614 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2eddc-0548-4c3f-96ab-f93f0ee72530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:13.113778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2eddc-0548-4c3f-96ab-f93f0ee72530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:13.115224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2eddc-0548-4c3f-96ab-f93f0ee72530 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:13.125348 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1279/2550] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:13.153598 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4e13a-f7a9-4ef5-8ee7-b1a4817704de None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:13.215708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4e13a-f7a9-4ef5-8ee7-b1a4817704de None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:13.220229 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f1956-43b0-4361-8fc7-46b6490e0c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:13.221091 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f1956-43b0-4361-8fc7-46b6490e0c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:13.221372 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f1956-43b0-4361-8fc7-46b6490e0c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:13.221653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f1956-43b0-4361-8fc7-46b6490e0c03 admin admin] PATH_INFO: `/v3/users/82a370918f0c49bfbb5f8448c99e3795` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:13.222886 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f1956-43b0-4361-8fc7-46b6490e0c03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82a370918f0c49bfbb5f8448c99e3795)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:13.224781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f1956-43b0-4361-8fc7-46b6490e0c03 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:13.270545 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-824f1956-43b0-4361-8fc7-46b6490e0c03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82a370918f0c49bfbb5f8448c99e3795'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:13.271205 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-824f1956-43b0-4361-8fc7-46b6490e0c03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82a370918f0c49bfbb5f8448c99e3795'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:13.279056 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-824f1956-43b0-4361-8fc7-46b6490e0c03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82a370918f0c49bfbb5f8448c99e3795'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:13.285755 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-824f1956-43b0-4361-8fc7-46b6490e0c03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82a370918f0c49bfbb5f8448c99e3795'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:13.286618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-824f1956-43b0-4361-8fc7-46b6490e0c03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82a370918f0c49bfbb5f8448c99e3795'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:13.305156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1272/2551] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:13 2022] DELETE /identity/v3/users/82a370918f0c49bfbb5f8448c99e3795 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:13.310564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fa5e1-9db8-4603-8a90-83f11948bbda None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:13.310847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fa5e1-9db8-4603-8a90-83f11948bbda None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:13.311519 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fa5e1-9db8-4603-8a90-83f11948bbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:13.329212 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d17fa5e1-9db8-4603-8a90-83f11948bbda None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:13.330506 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d17fa5e1-9db8-4603-8a90-83f11948bbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:13.387946 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1280/2552] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:13.397892 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f1956-43b0-4361-8fc7-46b6490e0c03 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:13.399337 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-824f1956-43b0-4361-8fc7-46b6490e0c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:13.457157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f1956-43b0-4361-8fc7-46b6490e0c03 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:13.460803 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d138ca8-4317-4a08-a61f-96a474a251b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:13.461449 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d138ca8-4317-4a08-a61f-96a474a251b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:13.461734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d138ca8-4317-4a08-a61f-96a474a251b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:13.462020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d138ca8-4317-4a08-a61f-96a474a251b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:13.471765 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d138ca8-4317-4a08-a61f-96a474a251b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:13.473123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d138ca8-4317-4a08-a61f-96a474a251b9 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:13.482473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1273/2553] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:13.741069 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fa5e1-9db8-4603-8a90-83f11948bbda None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:13.744058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d17fa5e1-9db8-4603-8a90-83f11948bbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:13.756447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fa5e1-9db8-4603-8a90-83f11948bbda None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:13.761584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec45321-2e95-412a-9414-fb7eef56467b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:13.762492 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec45321-2e95-412a-9414-fb7eef56467b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:13.762776 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec45321-2e95-412a-9414-fb7eef56467b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:13.763046 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec45321-2e95-412a-9414-fb7eef56467b admin admin] PATH_INFO: `/v3/projects/8eef5ac57630498e89acf752384ccaf8` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:13.764345 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec45321-2e95-412a-9414-fb7eef56467b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eef5ac57630498e89acf752384ccaf8)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:13.766282 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec45321-2e95-412a-9414-fb7eef56467b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:13.816446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7ec45321-2e95-412a-9414-fb7eef56467b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eef5ac57630498e89acf752384ccaf8', 'request_id': 'req-7ec45321-2e95-412a-9414-fb7eef56467b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:13.822621 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7ec45321-2e95-412a-9414-fb7eef56467b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eef5ac57630498e89acf752384ccaf8', 'request_id': 'req-7ec45321-2e95-412a-9414-fb7eef56467b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:13.829760 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7ec45321-2e95-412a-9414-fb7eef56467b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eef5ac57630498e89acf752384ccaf8', 'request_id': 'req-7ec45321-2e95-412a-9414-fb7eef56467b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:13.843284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7ec45321-2e95-412a-9414-fb7eef56467b admin admin] The token cache is being invalidate because project 8eef5ac57630498e89acf752384ccaf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:13.843800 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7ec45321-2e95-412a-9414-fb7eef56467b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:13.844567 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7ec45321-2e95-412a-9414-fb7eef56467b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:13.846292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1281/2554] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:13 2022] DELETE /identity/v3/projects/8eef5ac57630498e89acf752384ccaf8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:13.850352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d138ca8-4317-4a08-a61f-96a474a251b9 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:13.860814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d138ca8-4317-4a08-a61f-96a474a251b9 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:13.918929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a69584-281e-49d2-bed0-c7bd8c2c98bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:13.919820 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a69584-281e-49d2-bed0-c7bd8c2c98bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:13.920074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a69584-281e-49d2-bed0-c7bd8c2c98bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:13.920349 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a69584-281e-49d2-bed0-c7bd8c2c98bd admin admin] PATH_INFO: `/v3/users/d0dc04b51f5744659acefad9b9f68b4b` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:13.921532 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a69584-281e-49d2-bed0-c7bd8c2c98bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0dc04b51f5744659acefad9b9f68b4b)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:13.923479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a69584-281e-49d2-bed0-c7bd8c2c98bd admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:13.969325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-44a69584-281e-49d2-bed0-c7bd8c2c98bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0dc04b51f5744659acefad9b9f68b4b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:13.969990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-44a69584-281e-49d2-bed0-c7bd8c2c98bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0dc04b51f5744659acefad9b9f68b4b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:13.977234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-44a69584-281e-49d2-bed0-c7bd8c2c98bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0dc04b51f5744659acefad9b9f68b4b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:13.984582 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-44a69584-281e-49d2-bed0-c7bd8c2c98bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0dc04b51f5744659acefad9b9f68b4b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:13.985160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-44a69584-281e-49d2-bed0-c7bd8c2c98bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0dc04b51f5744659acefad9b9f68b4b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:14.001672 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1274/2555] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:13 2022] DELETE /identity/v3/users/d0dc04b51f5744659acefad9b9f68b4b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:14.271684 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec45321-2e95-412a-9414-fb7eef56467b admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:14.273136 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7ec45321-2e95-412a-9414-fb7eef56467b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:14.287780 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec45321-2e95-412a-9414-fb7eef56467b admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:14.356318 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cce34-4078-4fec-8a6b-225e3ce8dcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:14.357188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cce34-4078-4fec-8a6b-225e3ce8dcb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:14.357470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cce34-4078-4fec-8a6b-225e3ce8dcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:14.357745 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cce34-4078-4fec-8a6b-225e3ce8dcb2 admin admin] PATH_INFO: `/v3/projects/d26c019ca1494fdb92b0b0a1780fb4ca` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:14.358971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cce34-4078-4fec-8a6b-225e3ce8dcb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26c019ca1494fdb92b0b0a1780fb4ca)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:14.360937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cce34-4078-4fec-8a6b-225e3ce8dcb2 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:14.407267 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e66cce34-4078-4fec-8a6b-225e3ce8dcb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26c019ca1494fdb92b0b0a1780fb4ca', 'request_id': 'req-e66cce34-4078-4fec-8a6b-225e3ce8dcb2'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:14.412589 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e66cce34-4078-4fec-8a6b-225e3ce8dcb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26c019ca1494fdb92b0b0a1780fb4ca', 'request_id': 'req-e66cce34-4078-4fec-8a6b-225e3ce8dcb2'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:14.419589 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e66cce34-4078-4fec-8a6b-225e3ce8dcb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26c019ca1494fdb92b0b0a1780fb4ca', 'request_id': 'req-e66cce34-4078-4fec-8a6b-225e3ce8dcb2'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:14.432596 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e66cce34-4078-4fec-8a6b-225e3ce8dcb2 admin admin] The token cache is being invalidate because project d26c019ca1494fdb92b0b0a1780fb4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:14.432877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e66cce34-4078-4fec-8a6b-225e3ce8dcb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:14.433614 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e66cce34-4078-4fec-8a6b-225e3ce8dcb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:14.435463 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1282/2556] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:14 2022] DELETE /identity/v3/projects/d26c019ca1494fdb92b0b0a1780fb4ca => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:14.439997 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e642265-a0b8-458e-aed2-028db3e959c3 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:14.440271 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e642265-a0b8-458e-aed2-028db3e959c3 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:14.440549 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e642265-a0b8-458e-aed2-028db3e959c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:14.458087 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-7e642265-a0b8-458e-aed2-028db3e959c3 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:14.459332 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7e642265-a0b8-458e-aed2-028db3e959c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:14.520329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1275/2557] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:14.529753 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf04e4-58cf-48ca-8560-f048ee57ce93 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:14.530038 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf04e4-58cf-48ca-8560-f048ee57ce93 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:14.530806 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf04e4-58cf-48ca-8560-f048ee57ce93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:14.548644 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-12cf04e4-58cf-48ca-8560-f048ee57ce93 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:14.549828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-12cf04e4-58cf-48ca-8560-f048ee57ce93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:14.558540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1283/2558] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:14.562849 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e642265-a0b8-458e-aed2-028db3e959c3 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:14.574486 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e642265-a0b8-458e-aed2-028db3e959c3 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:14.579523 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc97a0-a607-416c-a591-3c5c81559963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:14.580345 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc97a0-a607-416c-a591-3c5c81559963 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:14.580719 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc97a0-a607-416c-a591-3c5c81559963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:14.581019 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc97a0-a607-416c-a591-3c5c81559963 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:14.582144 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc97a0-a607-416c-a591-3c5c81559963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:49:14.582576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc97a0-a607-416c-a591-3c5c81559963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:14.584363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc97a0-a607-416c-a591-3c5c81559963 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:14.596124 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1276/2559] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:49:14.600829 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf04e4-58cf-48ca-8560-f048ee57ce93 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:14.610415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc97a0-a607-416c-a591-3c5c81559963 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:14.611822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf04e4-58cf-48ca-8560-f048ee57ce93 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:14.612411 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-a9fc97a0-a607-416c-a591-3c5c81559963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:14.616702 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac8a75-3bc2-496a-be9c-9deec3d21772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:14.617597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac8a75-3bc2-496a-be9c-9deec3d21772 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:14.617930 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac8a75-3bc2-496a-be9c-9deec3d21772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:14.618260 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac8a75-3bc2-496a-be9c-9deec3d21772 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:14.619039 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac8a75-3bc2-496a-be9c-9deec3d21772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:14.621576 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac8a75-3bc2-496a-be9c-9deec3d21772 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:14.650263 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1284/2560] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:49:14 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:14.654507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac8a75-3bc2-496a-be9c-9deec3d21772 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:14.678859 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc97a0-a607-416c-a591-3c5c81559963 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:14.736612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df9970-cff0-426e-a0a6-43c6749ebb70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:14.736612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df9970-cff0-426e-a0a6-43c6749ebb70 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:14.736843 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac8a75-3bc2-496a-be9c-9deec3d21772 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:14.736942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df9970-cff0-426e-a0a6-43c6749ebb70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:14.736942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df9970-cff0-426e-a0a6-43c6749ebb70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:14.736942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d4df9970-cff0-426e-a0a6-43c6749ebb70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:14.739637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a60aa-f4ee-4ff4-9305-14cae44f37f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:14.740388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a60aa-f4ee-4ff4-9305-14cae44f37f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:14.740662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a60aa-f4ee-4ff4-9305-14cae44f37f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:14.740943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a60aa-f4ee-4ff4-9305-14cae44f37f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:14.741693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a60aa-f4ee-4ff4-9305-14cae44f37f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:14.743694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a60aa-f4ee-4ff4-9305-14cae44f37f1 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:14.766010 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1285/2561] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:49:14 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:49:14.769907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a60aa-f4ee-4ff4-9305-14cae44f37f1 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:14.780264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a60aa-f4ee-4ff4-9305-14cae44f37f1 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:14.785186 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183a9a2-a9dd-4253-a302-5c486fa80cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:14.785847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183a9a2-a9dd-4253-a302-5c486fa80cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:14.786125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183a9a2-a9dd-4253-a302-5c486fa80cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:14.786454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183a9a2-a9dd-4253-a302-5c486fa80cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:14.787178 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183a9a2-a9dd-4253-a302-5c486fa80cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:14.788744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183a9a2-a9dd-4253-a302-5c486fa80cdd admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:14.799399 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1286/2562] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:14.803141 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df9970-cff0-426e-a0a6-43c6749ebb70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:14.803406 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183a9a2-a9dd-4253-a302-5c486fa80cdd admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:14.804741 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df9970-cff0-426e-a0a6-43c6749ebb70 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:14.813759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183a9a2-a9dd-4253-a302-5c486fa80cdd admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:14.815391 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1277/2563] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:14.821751 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc231b45-5321-44be-9b8b-e38a045862ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:14.823777 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc231b45-5321-44be-9b8b-e38a045862ce admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:14.823777 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc231b45-5321-44be-9b8b-e38a045862ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:14.823777 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc231b45-5321-44be-9b8b-e38a045862ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:14.824078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc231b45-5321-44be-9b8b-e38a045862ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:14.825467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc231b45-5321-44be-9b8b-e38a045862ce admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:14.848327 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1287/2564] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:49:14.852702 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df9970-cff0-426e-a0a6-43c6749ebb70 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:14.864802 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df9970-cff0-426e-a0a6-43c6749ebb70 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:14.869630 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3354e4-89c8-4e72-a45f-6dd0c7d8db4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:14.871984 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3354e4-89c8-4e72-a45f-6dd0c7d8db4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:14.872542 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3354e4-89c8-4e72-a45f-6dd0c7d8db4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:14.872710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3354e4-89c8-4e72-a45f-6dd0c7d8db4d admin admin] PATH_INFO: `/v3/projects/688a433e55334f6d8f40dad5739bf5ac/users/4d909446828b41ea8c567d3d6fa702f5/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:14.889710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3354e4-89c8-4e72-a45f-6dd0c7d8db4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=688a433e55334f6d8f40dad5739bf5ac, user_id=4d909446828b41ea8c567d3d6fa702f5, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:14.892874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3354e4-89c8-4e72-a45f-6dd0c7d8db4d admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:14.907884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1278/2565] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:14 2022] PUT /identity/v3/projects/688a433e55334f6d8f40dad5739bf5ac/users/4d909446828b41ea8c567d3d6fa702f5/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:49:14.920019 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47669db9-44dd-42fd-b357-25e6ec5579e4 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:14.920310 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47669db9-44dd-42fd-b357-25e6ec5579e4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:14.920588 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47669db9-44dd-42fd-b357-25e6ec5579e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:14.949618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-47669db9-44dd-42fd-b357-25e6ec5579e4 None None] MFA Rules not processed for user `4d909446828b41ea8c567d3d6fa702f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:14.950939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-47669db9-44dd-42fd-b357-25e6ec5579e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:15.002670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32163fc4-61a1-466c-99e9-6a15d10ed826 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:15.003585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32163fc4-61a1-466c-99e9-6a15d10ed826 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:15.004051 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32163fc4-61a1-466c-99e9-6a15d10ed826 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:15.005918 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1279/2566] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 5 15:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 05 15:49:15.010786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd0e64-60b3-4abe-b818-579670bae517 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:15.011258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd0e64-60b3-4abe-b818-579670bae517 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:15.011751 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd0e64-60b3-4abe-b818-579670bae517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:15.031456 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-cddd0e64-60b3-4abe-b818-579670bae517 None None] MFA Rules not processed for user `2a29a4b1b1aa45aea2e466d8f8b79365`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:15.032972 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-cddd0e64-60b3-4abe-b818-579670bae517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:15.034007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1288/2567] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:15.038379 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47669db9-44dd-42fd-b357-25e6ec5579e4 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:15.103502 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1280/2568] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 5 15:49:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:15.119235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd0e64-60b3-4abe-b818-579670bae517 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:15.120776 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47669db9-44dd-42fd-b357-25e6ec5579e4 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:15.122496 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-cddd0e64-60b3-4abe-b818-579670bae517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:15.127306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47542165-7fcf-45d7-945a-f8882b1a48b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:15.128700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47542165-7fcf-45d7-945a-f8882b1a48b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:15.129094 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47542165-7fcf-45d7-945a-f8882b1a48b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:15.129461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47542165-7fcf-45d7-945a-f8882b1a48b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:15.130463 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47542165-7fcf-45d7-945a-f8882b1a48b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:15.132589 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47542165-7fcf-45d7-945a-f8882b1a48b2 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:15.174972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1289/2569] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:49:15 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:15.178810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47542165-7fcf-45d7-945a-f8882b1a48b2 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:15.190725 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd0e64-60b3-4abe-b818-579670bae517 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:15.244602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47542165-7fcf-45d7-945a-f8882b1a48b2 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:15.246765 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eacae5-ae90-4cfa-8d9d-69515f141bbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab6c13dc02ba49d0be523fa9a73fdf5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:15.247534 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eacae5-ae90-4cfa-8d9d-69515f141bbc service glance] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:15.247809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eacae5-ae90-4cfa-8d9d-69515f141bbc service glance] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:15.248084 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eacae5-ae90-4cfa-8d9d-69515f141bbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:15.252398 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f9329-5d87-4a18-a651-902579faaf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:15.253272 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f9329-5d87-4a18-a651-902579faaf15 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:15.253623 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f9329-5d87-4a18-a651-902579faaf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:15.253938 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f9329-5d87-4a18-a651-902579faaf15 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:15.254775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f9329-5d87-4a18-a651-902579faaf15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:15.256798 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f9329-5d87-4a18-a651-902579faaf15 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:15.283946 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1290/2570] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:49:15 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:15.284966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f9329-5d87-4a18-a651-902579faaf15 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:15.295281 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f9329-5d87-4a18-a651-902579faaf15 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:15.300332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17739e-999e-4cae-870c-6b00adf47c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:15.301058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17739e-999e-4cae-870c-6b00adf47c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:15.301264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17739e-999e-4cae-870c-6b00adf47c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:15.301564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17739e-999e-4cae-870c-6b00adf47c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:15.302376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17739e-999e-4cae-870c-6b00adf47c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:15.304003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17739e-999e-4cae-870c-6b00adf47c8a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:15.316247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1291/2571] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:49:15.320177 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17739e-999e-4cae-870c-6b00adf47c8a admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:15.329430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eacae5-ae90-4cfa-8d9d-69515f141bbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:15.330518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17739e-999e-4cae-870c-6b00adf47c8a admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:15.331180 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eacae5-ae90-4cfa-8d9d-69515f141bbc service glance] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:15.335436 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bc79b-4ee7-4ffa-8b9d-0d396eac0135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:15.336459 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bc79b-4ee7-4ffa-8b9d-0d396eac0135 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:15.336744 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bc79b-4ee7-4ffa-8b9d-0d396eac0135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:15.337017 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bc79b-4ee7-4ffa-8b9d-0d396eac0135 admin admin] PATH_INFO: `/v3/projects/caf25ce3da3b479e8be0087a40d808af/users/56498a843c58474abe6bf8358c0143bf/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:15.348402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1281/2572] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:49:15.359906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bc79b-4ee7-4ffa-8b9d-0d396eac0135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf25ce3da3b479e8be0087a40d808af, user_id=56498a843c58474abe6bf8358c0143bf, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:15.363141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bc79b-4ee7-4ffa-8b9d-0d396eac0135 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:15.382287 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1292/2573] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:15 2022] PUT /identity/v3/projects/caf25ce3da3b479e8be0087a40d808af/users/56498a843c58474abe6bf8358c0143bf/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:49:15.383280 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eacae5-ae90-4cfa-8d9d-69515f141bbc service glance] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:15.396273 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eacae5-ae90-4cfa-8d9d-69515f141bbc service glance] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:15.467932 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6347845-d1f1-42af-b9b4-2ce0c0d4a4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:15.468611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347845-d1f1-42af-b9b4-2ce0c0d4a4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:15.468894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347845-d1f1-42af-b9b4-2ce0c0d4a4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:15.469165 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347845-d1f1-42af-b9b4-2ce0c0d4a4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:15.469919 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6347845-d1f1-42af-b9b4-2ce0c0d4a4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:15.471536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6347845-d1f1-42af-b9b4-2ce0c0d4a4ae admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:15.483353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1282/2574] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:15.487442 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bc79b-4ee7-4ffa-8b9d-0d396eac0135 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:15.511377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bc79b-4ee7-4ffa-8b9d-0d396eac0135 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:15.519509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec9f0f-95a2-4265-8fb1-144ea652e980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:15.520874 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec9f0f-95a2-4265-8fb1-144ea652e980 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:15.521249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec9f0f-95a2-4265-8fb1-144ea652e980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:15.521545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec9f0f-95a2-4265-8fb1-144ea652e980 admin admin] PATH_INFO: `/v3/projects/caf25ce3da3b479e8be0087a40d808af/users/56498a843c58474abe6bf8358c0143bf/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:15.523718 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec9f0f-95a2-4265-8fb1-144ea652e980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf25ce3da3b479e8be0087a40d808af, user_id=56498a843c58474abe6bf8358c0143bf, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:15.527883 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec9f0f-95a2-4265-8fb1-144ea652e980 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:15.540749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1293/2575] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:15 2022] PUT /identity/v3/projects/caf25ce3da3b479e8be0087a40d808af/users/56498a843c58474abe6bf8358c0143bf/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:15.551604 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33aa2e-453a-44b6-8290-005a96315eba None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:15.551957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33aa2e-453a-44b6-8290-005a96315eba None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:15.552317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33aa2e-453a-44b6-8290-005a96315eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:15.579449 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-8c33aa2e-453a-44b6-8290-005a96315eba None None] MFA Rules not processed for user `56498a843c58474abe6bf8358c0143bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:15.580732 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8c33aa2e-453a-44b6-8290-005a96315eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:15.664520 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1283/2576] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:15.680633 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec9f0f-95a2-4265-8fb1-144ea652e980 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:15.682739 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-faec9f0f-95a2-4265-8fb1-144ea652e980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:15.750977 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec9f0f-95a2-4265-8fb1-144ea652e980 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:15.754847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2beb3-41fe-4b54-948a-6321ce7b5ba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:15.755510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2beb3-41fe-4b54-948a-6321ce7b5ba6 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:15.755981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2beb3-41fe-4b54-948a-6321ce7b5ba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:15.756258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2beb3-41fe-4b54-948a-6321ce7b5ba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:15.768257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2beb3-41fe-4b54-948a-6321ce7b5ba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:15.769712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2beb3-41fe-4b54-948a-6321ce7b5ba6 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:15.781230 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1294/2577] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:15.843251 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33aa2e-453a-44b6-8290-005a96315eba None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:15.844664 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8c33aa2e-453a-44b6-8290-005a96315eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:15.858887 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33aa2e-453a-44b6-8290-005a96315eba None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:15.862939 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce29f8-8733-48e9-b07b-84dc7650c295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:15.863783 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce29f8-8733-48e9-b07b-84dc7650c295 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:15.864277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce29f8-8733-48e9-b07b-84dc7650c295 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:15.864783 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce29f8-8733-48e9-b07b-84dc7650c295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:15.931669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce29f8-8733-48e9-b07b-84dc7650c295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:15.934039 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce29f8-8733-48e9-b07b-84dc7650c295 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:15.945353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1284/2578] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:19.109624 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598ba2e-a2ec-4386-a9e4-c583784cd93e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:19.110221 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598ba2e-a2ec-4386-a9e4-c583784cd93e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:19.110221 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598ba2e-a2ec-4386-a9e4-c583784cd93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:19.135859 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d598ba2e-a2ec-4386-a9e4-c583784cd93e None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:19.137258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d598ba2e-a2ec-4386-a9e4-c583784cd93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:19.201869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1295/2579] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 5 15:49:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:19.214028 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce29f8-8733-48e9-b07b-84dc7650c295 service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:19.215558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-07ce29f8-8733-48e9-b07b-84dc7650c295 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:19.284860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce29f8-8733-48e9-b07b-84dc7650c295 service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:19.290212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936a6c3-73f7-4cfe-83bf-ba88e5dfa850 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:19.290868 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936a6c3-73f7-4cfe-83bf-ba88e5dfa850 service swift] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:19.291181 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936a6c3-73f7-4cfe-83bf-ba88e5dfa850 service swift] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:19.291995 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936a6c3-73f7-4cfe-83bf-ba88e5dfa850 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:19.300324 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936a6c3-73f7-4cfe-83bf-ba88e5dfa850 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:19.301895 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936a6c3-73f7-4cfe-83bf-ba88e5dfa850 service swift] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:19.310832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1285/2580] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:49:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:49:19.435320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598ba2e-a2ec-4386-a9e4-c583784cd93e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:19.529638 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598ba2e-a2ec-4386-a9e4-c583784cd93e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:19.534954 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ebb39-7270-40b7-b6ae-89a5e04a7cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:19.536027 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ebb39-7270-40b7-b6ae-89a5e04a7cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:19.536340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ebb39-7270-40b7-b6ae-89a5e04a7cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:19.536671 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ebb39-7270-40b7-b6ae-89a5e04a7cba admin admin] PATH_INFO: `/v3/users/4d909446828b41ea8c567d3d6fa702f5` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:19.538003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ebb39-7270-40b7-b6ae-89a5e04a7cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d909446828b41ea8c567d3d6fa702f5)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:19.540388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ebb39-7270-40b7-b6ae-89a5e04a7cba admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:19.599889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-018ebb39-7270-40b7-b6ae-89a5e04a7cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d909446828b41ea8c567d3d6fa702f5'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:19.607979 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-018ebb39-7270-40b7-b6ae-89a5e04a7cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d909446828b41ea8c567d3d6fa702f5'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:19.608785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-018ebb39-7270-40b7-b6ae-89a5e04a7cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d909446828b41ea8c567d3d6fa702f5'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:19.609638 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-018ebb39-7270-40b7-b6ae-89a5e04a7cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d909446828b41ea8c567d3d6fa702f5'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:19.624793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-018ebb39-7270-40b7-b6ae-89a5e04a7cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d909446828b41ea8c567d3d6fa702f5'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:19.648891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1296/2581] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:19 2022] DELETE /identity/v3/users/4d909446828b41ea8c567d3d6fa702f5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:19.653978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3906a1-4c61-4c73-8baa-eae2919c125f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:19.654329 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3906a1-4c61-4c73-8baa-eae2919c125f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:19.654610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3906a1-4c61-4c73-8baa-eae2919c125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:19.678455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-3b3906a1-4c61-4c73-8baa-eae2919c125f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:19.680175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-3b3906a1-4c61-4c73-8baa-eae2919c125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:19.769430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1286/2582] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:19.779584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ebb39-7270-40b7-b6ae-89a5e04a7cba admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:19.780984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-018ebb39-7270-40b7-b6ae-89a5e04a7cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:19.847685 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ebb39-7270-40b7-b6ae-89a5e04a7cba admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:19.851249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fe4c9-07a2-4335-b526-a9a841202c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:19.851893 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fe4c9-07a2-4335-b526-a9a841202c5a service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:19.852172 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fe4c9-07a2-4335-b526-a9a841202c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:19.852444 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fe4c9-07a2-4335-b526-a9a841202c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:19.862074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fe4c9-07a2-4335-b526-a9a841202c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:19.863532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fe4c9-07a2-4335-b526-a9a841202c5a service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:19.874386 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1297/2583] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:20.318804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3906a1-4c61-4c73-8baa-eae2919c125f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:20.320413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-3b3906a1-4c61-4c73-8baa-eae2919c125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:20.340583 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3906a1-4c61-4c73-8baa-eae2919c125f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:20.351350 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee439de-fbdb-4420-9321-179bb4b6c240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:20.352186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee439de-fbdb-4420-9321-179bb4b6c240 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:20.352479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee439de-fbdb-4420-9321-179bb4b6c240 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:20.352760 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee439de-fbdb-4420-9321-179bb4b6c240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:20.355129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8ee439de-fbdb-4420-9321-179bb4b6c240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:20.380801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fe4c9-07a2-4335-b526-a9a841202c5a service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:20.383297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ab6fe4c9-07a2-4335-b526-a9a841202c5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:20.390431 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee439de-fbdb-4420-9321-179bb4b6c240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:20.392316 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee439de-fbdb-4420-9321-179bb4b6c240 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:20.403083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fe4c9-07a2-4335-b526-a9a841202c5a service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:20.408412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26162a53-d2c1-421c-8b2a-985f337f6019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:20.409447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26162a53-d2c1-421c-8b2a-985f337f6019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:20.409813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26162a53-d2c1-421c-8b2a-985f337f6019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:20.410212 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26162a53-d2c1-421c-8b2a-985f337f6019 admin admin] PATH_INFO: `/v3/projects/688a433e55334f6d8f40dad5739bf5ac` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:20.411453 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26162a53-d2c1-421c-8b2a-985f337f6019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=688a433e55334f6d8f40dad5739bf5ac)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:20.413416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26162a53-d2c1-421c-8b2a-985f337f6019 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:20.430002 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1287/2584] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:20.470907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-26162a53-d2c1-421c-8b2a-985f337f6019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688a433e55334f6d8f40dad5739bf5ac', 'request_id': 'req-26162a53-d2c1-421c-8b2a-985f337f6019'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:20.495071 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-26162a53-d2c1-421c-8b2a-985f337f6019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688a433e55334f6d8f40dad5739bf5ac', 'request_id': 'req-26162a53-d2c1-421c-8b2a-985f337f6019'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:20.513204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-26162a53-d2c1-421c-8b2a-985f337f6019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688a433e55334f6d8f40dad5739bf5ac', 'request_id': 'req-26162a53-d2c1-421c-8b2a-985f337f6019'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:20.534291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-26162a53-d2c1-421c-8b2a-985f337f6019 admin admin] The token cache is being invalidate because project 688a433e55334f6d8f40dad5739bf5ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:20.534618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-26162a53-d2c1-421c-8b2a-985f337f6019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:20.535715 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-26162a53-d2c1-421c-8b2a-985f337f6019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:20.537556 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1298/2585] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:20 2022] DELETE /identity/v3/projects/688a433e55334f6d8f40dad5739bf5ac => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:20.542314 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee439de-fbdb-4420-9321-179bb4b6c240 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:20.556396 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee439de-fbdb-4420-9321-179bb4b6c240 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:20.650135 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d83570-af8b-4aee-afcd-699cef986d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:20.655096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d83570-af8b-4aee-afcd-699cef986d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:20.655422 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d83570-af8b-4aee-afcd-699cef986d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:20.655657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d83570-af8b-4aee-afcd-699cef986d68 admin admin] PATH_INFO: `/v3/users/56498a843c58474abe6bf8358c0143bf` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:20.657012 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d83570-af8b-4aee-afcd-699cef986d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56498a843c58474abe6bf8358c0143bf)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:20.659021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d83570-af8b-4aee-afcd-699cef986d68 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:20.735586 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f5d83570-af8b-4aee-afcd-699cef986d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56498a843c58474abe6bf8358c0143bf'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:20.736552 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f5d83570-af8b-4aee-afcd-699cef986d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56498a843c58474abe6bf8358c0143bf'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:20.746732 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f5d83570-af8b-4aee-afcd-699cef986d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56498a843c58474abe6bf8358c0143bf'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:20.754234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f5d83570-af8b-4aee-afcd-699cef986d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56498a843c58474abe6bf8358c0143bf'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:20.754901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f5d83570-af8b-4aee-afcd-699cef986d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56498a843c58474abe6bf8358c0143bf'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:20.773256 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1288/2586] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:20 2022] DELETE /identity/v3/users/56498a843c58474abe6bf8358c0143bf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:21.745766 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26162a53-d2c1-421c-8b2a-985f337f6019 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:21.747343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-26162a53-d2c1-421c-8b2a-985f337f6019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:21.776706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26162a53-d2c1-421c-8b2a-985f337f6019 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:21.883014 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05614cfa-5f53-4bd9-b1f7-c52b53be3fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:21.884017 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05614cfa-5f53-4bd9-b1f7-c52b53be3fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:21.884302 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05614cfa-5f53-4bd9-b1f7-c52b53be3fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:21.884659 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05614cfa-5f53-4bd9-b1f7-c52b53be3fff admin admin] PATH_INFO: `/v3/projects/caf25ce3da3b479e8be0087a40d808af` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:21.887885 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05614cfa-5f53-4bd9-b1f7-c52b53be3fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf25ce3da3b479e8be0087a40d808af)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:21.891258 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05614cfa-5f53-4bd9-b1f7-c52b53be3fff admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:21.992172 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-05614cfa-5f53-4bd9-b1f7-c52b53be3fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf25ce3da3b479e8be0087a40d808af', 'request_id': 'req-05614cfa-5f53-4bd9-b1f7-c52b53be3fff'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:21.999055 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-05614cfa-5f53-4bd9-b1f7-c52b53be3fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf25ce3da3b479e8be0087a40d808af', 'request_id': 'req-05614cfa-5f53-4bd9-b1f7-c52b53be3fff'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:22.014812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-05614cfa-5f53-4bd9-b1f7-c52b53be3fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf25ce3da3b479e8be0087a40d808af', 'request_id': 'req-05614cfa-5f53-4bd9-b1f7-c52b53be3fff'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:22.035438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-05614cfa-5f53-4bd9-b1f7-c52b53be3fff admin admin] The token cache is being invalidate because project caf25ce3da3b479e8be0087a40d808af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:22.037299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-05614cfa-5f53-4bd9-b1f7-c52b53be3fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:22.039061 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-05614cfa-5f53-4bd9-b1f7-c52b53be3fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:22.043574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1299/2587] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:21 2022] DELETE /identity/v3/projects/caf25ce3da3b479e8be0087a40d808af => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:22.048472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfcec1-ad6d-4176-a597-4f28488488d5 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:22.048971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfcec1-ad6d-4176-a597-4f28488488d5 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:22.049144 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfcec1-ad6d-4176-a597-4f28488488d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:22.079676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-f2dfcec1-ad6d-4176-a597-4f28488488d5 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:22.080901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-f2dfcec1-ad6d-4176-a597-4f28488488d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:22.197160 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1289/2588] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:22.206431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea7761-d629-47f0-b8e9-286585599e73 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:22.206968 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea7761-d629-47f0-b8e9-286585599e73 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:22.207246 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea7761-d629-47f0-b8e9-286585599e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:22.243764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-18ea7761-d629-47f0-b8e9-286585599e73 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:22.245043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-18ea7761-d629-47f0-b8e9-286585599e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:22.271226 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1300/2589] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:22.277018 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfcec1-ad6d-4176-a597-4f28488488d5 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:22.307724 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfcec1-ad6d-4176-a597-4f28488488d5 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:22.316750 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473a971-16cf-4877-8a50-e94c0bf00170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:22.317431 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473a971-16cf-4877-8a50-e94c0bf00170 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:22.317714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473a971-16cf-4877-8a50-e94c0bf00170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:22.317989 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473a971-16cf-4877-8a50-e94c0bf00170 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:22.318764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473a971-16cf-4877-8a50-e94c0bf00170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:49:22.319069 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473a971-16cf-4877-8a50-e94c0bf00170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:22.320662 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473a971-16cf-4877-8a50-e94c0bf00170 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:22.339957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1290/2590] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:49:22.345504 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea7761-d629-47f0-b8e9-286585599e73 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:22.360994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea7761-d629-47f0-b8e9-286585599e73 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:22.367236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cecc3d-f511-4071-8887-2a12c2ccdd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:22.368194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cecc3d-f511-4071-8887-2a12c2ccdd52 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:22.368681 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cecc3d-f511-4071-8887-2a12c2ccdd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:22.369163 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cecc3d-f511-4071-8887-2a12c2ccdd52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:22.371023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cecc3d-f511-4071-8887-2a12c2ccdd52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:22.373177 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cecc3d-f511-4071-8887-2a12c2ccdd52 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:22.439503 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1301/2591] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:49:22 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:22.443463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473a971-16cf-4877-8a50-e94c0bf00170 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:22.459617 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473a971-16cf-4877-8a50-e94c0bf00170 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:22.553016 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2370d-b9ec-4043-ae95-8829fd93d457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:22.553993 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2370d-b9ec-4043-ae95-8829fd93d457 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:22.554525 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2370d-b9ec-4043-ae95-8829fd93d457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:22.555024 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2370d-b9ec-4043-ae95-8829fd93d457 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:22.555968 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2370d-b9ec-4043-ae95-8829fd93d457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:22.558915 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2370d-b9ec-4043-ae95-8829fd93d457 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:22.595019 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1291/2592] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:49:22 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:49:22.596472 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cecc3d-f511-4071-8887-2a12c2ccdd52 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:22.616489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cecc3d-f511-4071-8887-2a12c2ccdd52 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:22.624641 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1647646-b43e-4c51-bcc7-b12a86ecbdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:22.625476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1647646-b43e-4c51-bcc7-b12a86ecbdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:22.626003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1647646-b43e-4c51-bcc7-b12a86ecbdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:22.626795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1647646-b43e-4c51-bcc7-b12a86ecbdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:22.628984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1647646-b43e-4c51-bcc7-b12a86ecbdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:22.632668 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1647646-b43e-4c51-bcc7-b12a86ecbdd9 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:22.664193 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1302/2593] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:22.668393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2370d-b9ec-4043-ae95-8829fd93d457 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:22.680414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2370d-b9ec-4043-ae95-8829fd93d457 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:22.685852 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8a584-26f4-47a7-96da-37f073cb98ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:22.686624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8a584-26f4-47a7-96da-37f073cb98ae admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:22.686975 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8a584-26f4-47a7-96da-37f073cb98ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:22.687468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8a584-26f4-47a7-96da-37f073cb98ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:22.688486 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8a584-26f4-47a7-96da-37f073cb98ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:22.690088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8a584-26f4-47a7-96da-37f073cb98ae admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:22.703461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1292/2594] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:22.707619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1647646-b43e-4c51-bcc7-b12a86ecbdd9 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:22.719772 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1647646-b43e-4c51-bcc7-b12a86ecbdd9 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:22.724825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d3d64-5cb0-49bf-8d04-d8d939b72ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:22.725726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d3d64-5cb0-49bf-8d04-d8d939b72ade admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:22.725998 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d3d64-5cb0-49bf-8d04-d8d939b72ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:22.726304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d3d64-5cb0-49bf-8d04-d8d939b72ade admin admin] PATH_INFO: `/v3/projects/25c4c89a279f4fabbafa1681130a3e38/users/5489abde0b874c5b918e7e96172129f3/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:22.742926 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d3d64-5cb0-49bf-8d04-d8d939b72ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c4c89a279f4fabbafa1681130a3e38, user_id=5489abde0b874c5b918e7e96172129f3, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:22.747361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d3d64-5cb0-49bf-8d04-d8d939b72ade admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:22.775020 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1303/2595] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:22 2022] PUT /identity/v3/projects/25c4c89a279f4fabbafa1681130a3e38/users/5489abde0b874c5b918e7e96172129f3/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:49:22.777328 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278a5e9-ab98-47d1-b967-432214c71ac1 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:22.777620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278a5e9-ab98-47d1-b967-432214c71ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:22.777903 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278a5e9-ab98-47d1-b967-432214c71ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:22.814017 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-2278a5e9-ab98-47d1-b967-432214c71ac1 None None] MFA Rules not processed for user `5489abde0b874c5b918e7e96172129f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:22.815410 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-2278a5e9-ab98-47d1-b967-432214c71ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:22.928007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1293/2596] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:49:22.933023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d3d64-5cb0-49bf-8d04-d8d939b72ade admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:23.089645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d3d64-5cb0-49bf-8d04-d8d939b72ade admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:23.096072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044947c-1890-4215-8c94-28d411eb7500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:23.096974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044947c-1890-4215-8c94-28d411eb7500 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:23.097445 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044947c-1890-4215-8c94-28d411eb7500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:23.098331 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044947c-1890-4215-8c94-28d411eb7500 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:23.099964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044947c-1890-4215-8c94-28d411eb7500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:23.104628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044947c-1890-4215-8c94-28d411eb7500 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:23.143971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1304/2597] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:49:22 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:23.149183 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278a5e9-ab98-47d1-b967-432214c71ac1 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:23.173303 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278a5e9-ab98-47d1-b967-432214c71ac1 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:23.296546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f28e4-973c-4467-81a1-a7f45dd9b1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:23.297717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f28e4-973c-4467-81a1-a7f45dd9b1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:23.298237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f28e4-973c-4467-81a1-a7f45dd9b1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:23.298734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f28e4-973c-4467-81a1-a7f45dd9b1b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:23.299603 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f28e4-973c-4467-81a1-a7f45dd9b1b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:23.301776 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f28e4-973c-4467-81a1-a7f45dd9b1b0 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:23.377427 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1294/2598] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:49:23 2022] POST /identity/v3/users => generated 300 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:23.381071 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044947c-1890-4215-8c94-28d411eb7500 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:23.398933 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044947c-1890-4215-8c94-28d411eb7500 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:23.422238 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed0d1f-c796-4c09-adca-e4fc34b9078a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:23.423082 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed0d1f-c796-4c09-adca-e4fc34b9078a admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:23.423462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed0d1f-c796-4c09-adca-e4fc34b9078a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:23.423837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed0d1f-c796-4c09-adca-e4fc34b9078a admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:23.424881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed0d1f-c796-4c09-adca-e4fc34b9078a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:23.426621 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed0d1f-c796-4c09-adca-e4fc34b9078a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:23.447515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1305/2599] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:23.452576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f28e4-973c-4467-81a1-a7f45dd9b1b0 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:23.471290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f28e4-973c-4467-81a1-a7f45dd9b1b0 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:23.486665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c721b3f-1fa5-4db5-b0ed-2cb1f394fe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:23.487942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c721b3f-1fa5-4db5-b0ed-2cb1f394fe13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:23.488415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c721b3f-1fa5-4db5-b0ed-2cb1f394fe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:23.488849 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c721b3f-1fa5-4db5-b0ed-2cb1f394fe13 admin admin] PATH_INFO: `/v3/projects/8b540c0ab4fb48719317dd08fbf6f0db/users/7eb6e1de076641259f0c1748cad8791c/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:23.520915 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c721b3f-1fa5-4db5-b0ed-2cb1f394fe13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b540c0ab4fb48719317dd08fbf6f0db, user_id=7eb6e1de076641259f0c1748cad8791c, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:23.523651 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c721b3f-1fa5-4db5-b0ed-2cb1f394fe13 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:23.562832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1295/2600] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:23 2022] PUT /identity/v3/projects/8b540c0ab4fb48719317dd08fbf6f0db/users/7eb6e1de076641259f0c1748cad8791c/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:49:23.564413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed0d1f-c796-4c09-adca-e4fc34b9078a admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:23.580217 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed0d1f-c796-4c09-adca-e4fc34b9078a admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:23.671324 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6e270-c93f-4777-9c6b-22e806f8541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:23.672553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6e270-c93f-4777-9c6b-22e806f8541b admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:23.672846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6e270-c93f-4777-9c6b-22e806f8541b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:23.673116 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6e270-c93f-4777-9c6b-22e806f8541b admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:23.673928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6e270-c93f-4777-9c6b-22e806f8541b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:23.675798 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6e270-c93f-4777-9c6b-22e806f8541b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:23.692063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1306/2601] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:23.695880 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c721b3f-1fa5-4db5-b0ed-2cb1f394fe13 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:23.714269 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c721b3f-1fa5-4db5-b0ed-2cb1f394fe13 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:23.727902 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311f13a-b172-4afe-9a5f-6823d197d464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:23.728867 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311f13a-b172-4afe-9a5f-6823d197d464 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:23.729148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311f13a-b172-4afe-9a5f-6823d197d464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:23.729531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311f13a-b172-4afe-9a5f-6823d197d464 admin admin] PATH_INFO: `/v3/projects/8b540c0ab4fb48719317dd08fbf6f0db/users/7eb6e1de076641259f0c1748cad8791c/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:23.731922 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311f13a-b172-4afe-9a5f-6823d197d464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b540c0ab4fb48719317dd08fbf6f0db, user_id=7eb6e1de076641259f0c1748cad8791c, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:23.734929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311f13a-b172-4afe-9a5f-6823d197d464 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:23.773609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1296/2602] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:23 2022] PUT /identity/v3/projects/8b540c0ab4fb48719317dd08fbf6f0db/users/7eb6e1de076641259f0c1748cad8791c/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:23.775542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dc7b9-e22d-476d-9a74-dec183152f7c None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:23.776666 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dc7b9-e22d-476d-9a74-dec183152f7c None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:23.776666 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dc7b9-e22d-476d-9a74-dec183152f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:23.838828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-696dc7b9-e22d-476d-9a74-dec183152f7c None None] MFA Rules not processed for user `7eb6e1de076641259f0c1748cad8791c`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:23.840682 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-696dc7b9-e22d-476d-9a74-dec183152f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:24.001129 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1307/2603] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:24.009668 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311f13a-b172-4afe-9a5f-6823d197d464 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:24.012940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6311f13a-b172-4afe-9a5f-6823d197d464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:24.084737 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311f13a-b172-4afe-9a5f-6823d197d464 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:24.093665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56168e75-a267-4241-ad46-5d2b2ce89815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:24.094526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56168e75-a267-4241-ad46-5d2b2ce89815 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:24.094967 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56168e75-a267-4241-ad46-5d2b2ce89815 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:24.095344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56168e75-a267-4241-ad46-5d2b2ce89815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:24.107074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56168e75-a267-4241-ad46-5d2b2ce89815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:24.108938 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56168e75-a267-4241-ad46-5d2b2ce89815 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:24.136876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1297/2604] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:24.327355 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dc7b9-e22d-476d-9a74-dec183152f7c None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:24.445529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dc7b9-e22d-476d-9a74-dec183152f7c None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:24.450457 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4826fb4-273b-4912-b537-ff24b90d0c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:24.451475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4826fb4-273b-4912-b537-ff24b90d0c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:24.451774 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4826fb4-273b-4912-b537-ff24b90d0c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:24.452034 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4826fb4-273b-4912-b537-ff24b90d0c7b admin admin] PATH_INFO: `/v3/users/5489abde0b874c5b918e7e96172129f3` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:24.453697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4826fb4-273b-4912-b537-ff24b90d0c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5489abde0b874c5b918e7e96172129f3)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:24.456117 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4826fb4-273b-4912-b537-ff24b90d0c7b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:24.558234 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b4826fb4-273b-4912-b537-ff24b90d0c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5489abde0b874c5b918e7e96172129f3'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:24.568329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b4826fb4-273b-4912-b537-ff24b90d0c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5489abde0b874c5b918e7e96172129f3'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:24.569325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b4826fb4-273b-4912-b537-ff24b90d0c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5489abde0b874c5b918e7e96172129f3'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:24.570280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b4826fb4-273b-4912-b537-ff24b90d0c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5489abde0b874c5b918e7e96172129f3'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:24.585611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b4826fb4-273b-4912-b537-ff24b90d0c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5489abde0b874c5b918e7e96172129f3'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:24.607092 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1308/2605] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:24 2022] DELETE /identity/v3/users/5489abde0b874c5b918e7e96172129f3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:24.612016 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb39cb-7781-4716-9dae-8f3ec1c73bf0 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:24.612517 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb39cb-7781-4716-9dae-8f3ec1c73bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:24.612610 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb39cb-7781-4716-9dae-8f3ec1c73bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:24.673116 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-8cfb39cb-7781-4716-9dae-8f3ec1c73bf0 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:24.679033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8cfb39cb-7781-4716-9dae-8f3ec1c73bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:24.801265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1298/2606] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:24.812948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4826fb4-273b-4912-b537-ff24b90d0c7b admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:24.814440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b4826fb4-273b-4912-b537-ff24b90d0c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:24.916733 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4826fb4-273b-4912-b537-ff24b90d0c7b admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:24.929197 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98192af-ff15-40a1-bd07-103cdb807dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:24.930253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98192af-ff15-40a1-bd07-103cdb807dac service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:24.930792 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98192af-ff15-40a1-bd07-103cdb807dac service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:24.932324 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98192af-ff15-40a1-bd07-103cdb807dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:24.944602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98192af-ff15-40a1-bd07-103cdb807dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:24.946094 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98192af-ff15-40a1-bd07-103cdb807dac service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:24.957730 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1309/2607] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:25.464790 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb39cb-7781-4716-9dae-8f3ec1c73bf0 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:25.466529 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8cfb39cb-7781-4716-9dae-8f3ec1c73bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:25.502862 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb39cb-7781-4716-9dae-8f3ec1c73bf0 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:25.521440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da54440-868e-46c1-8a39-0329659ee0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:25.524270 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da54440-868e-46c1-8a39-0329659ee0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:25.524726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da54440-868e-46c1-8a39-0329659ee0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:25.525102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da54440-868e-46c1-8a39-0329659ee0ff admin admin] PATH_INFO: `/v3/projects/25c4c89a279f4fabbafa1681130a3e38` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:25.527636 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da54440-868e-46c1-8a39-0329659ee0ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=25c4c89a279f4fabbafa1681130a3e38)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:25.530761 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da54440-868e-46c1-8a39-0329659ee0ff admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:25.623660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7da54440-868e-46c1-8a39-0329659ee0ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25c4c89a279f4fabbafa1681130a3e38', 'request_id': 'req-7da54440-868e-46c1-8a39-0329659ee0ff'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:25.633369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7da54440-868e-46c1-8a39-0329659ee0ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25c4c89a279f4fabbafa1681130a3e38', 'request_id': 'req-7da54440-868e-46c1-8a39-0329659ee0ff'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:25.644177 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7da54440-868e-46c1-8a39-0329659ee0ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25c4c89a279f4fabbafa1681130a3e38', 'request_id': 'req-7da54440-868e-46c1-8a39-0329659ee0ff'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:25.681132 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7da54440-868e-46c1-8a39-0329659ee0ff admin admin] The token cache is being invalidate because project 25c4c89a279f4fabbafa1681130a3e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:25.682464 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7da54440-868e-46c1-8a39-0329659ee0ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:25.684972 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-7da54440-868e-46c1-8a39-0329659ee0ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:25.696880 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1299/2608] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:25 2022] DELETE /identity/v3/projects/25c4c89a279f4fabbafa1681130a3e38 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:25.701828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98192af-ff15-40a1-bd07-103cdb807dac service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:25.728771 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98192af-ff15-40a1-bd07-103cdb807dac service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:25.835674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84152965-9ff2-46df-8564-3f89930db4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:25.837168 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84152965-9ff2-46df-8564-3f89930db4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:25.837445 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84152965-9ff2-46df-8564-3f89930db4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:25.838246 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84152965-9ff2-46df-8564-3f89930db4f1 admin admin] PATH_INFO: `/v3/users/7eb6e1de076641259f0c1748cad8791c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:25.839707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84152965-9ff2-46df-8564-3f89930db4f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb6e1de076641259f0c1748cad8791c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:25.842050 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84152965-9ff2-46df-8564-3f89930db4f1 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:25.975599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-84152965-9ff2-46df-8564-3f89930db4f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb6e1de076641259f0c1748cad8791c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:25.988126 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-84152965-9ff2-46df-8564-3f89930db4f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb6e1de076641259f0c1748cad8791c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:25.989005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-84152965-9ff2-46df-8564-3f89930db4f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb6e1de076641259f0c1748cad8791c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:25.989803 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-84152965-9ff2-46df-8564-3f89930db4f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb6e1de076641259f0c1748cad8791c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:26.006740 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-84152965-9ff2-46df-8564-3f89930db4f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb6e1de076641259f0c1748cad8791c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:26.046468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1310/2609] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:25 2022] DELETE /identity/v3/users/7eb6e1de076641259f0c1748cad8791c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:26.477115 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da54440-868e-46c1-8a39-0329659ee0ff admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:26.479538 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7da54440-868e-46c1-8a39-0329659ee0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:26.504122 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da54440-868e-46c1-8a39-0329659ee0ff admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:26.594702 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a6fe4-8af8-4e5c-8460-1a7108e46872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:26.595553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a6fe4-8af8-4e5c-8460-1a7108e46872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:26.595834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a6fe4-8af8-4e5c-8460-1a7108e46872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:26.596124 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a6fe4-8af8-4e5c-8460-1a7108e46872 admin admin] PATH_INFO: `/v3/projects/8b540c0ab4fb48719317dd08fbf6f0db` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:26.597297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a6fe4-8af8-4e5c-8460-1a7108e46872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b540c0ab4fb48719317dd08fbf6f0db)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:26.599218 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a6fe4-8af8-4e5c-8460-1a7108e46872 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:26.658146 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-849a6fe4-8af8-4e5c-8460-1a7108e46872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b540c0ab4fb48719317dd08fbf6f0db', 'request_id': 'req-849a6fe4-8af8-4e5c-8460-1a7108e46872'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:26.664143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-849a6fe4-8af8-4e5c-8460-1a7108e46872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b540c0ab4fb48719317dd08fbf6f0db', 'request_id': 'req-849a6fe4-8af8-4e5c-8460-1a7108e46872'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:26.672101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-849a6fe4-8af8-4e5c-8460-1a7108e46872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b540c0ab4fb48719317dd08fbf6f0db', 'request_id': 'req-849a6fe4-8af8-4e5c-8460-1a7108e46872'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:26.692569 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-849a6fe4-8af8-4e5c-8460-1a7108e46872 admin admin] The token cache is being invalidate because project 8b540c0ab4fb48719317dd08fbf6f0db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:26.692836 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-849a6fe4-8af8-4e5c-8460-1a7108e46872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:26.693591 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-849a6fe4-8af8-4e5c-8460-1a7108e46872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:26.696236 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1300/2610] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:26 2022] DELETE /identity/v3/projects/8b540c0ab4fb48719317dd08fbf6f0db => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:26.702011 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d612634-abbb-432f-a5e1-01c844f06c5e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:26.702392 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d612634-abbb-432f-a5e1-01c844f06c5e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:26.702661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d612634-abbb-432f-a5e1-01c844f06c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:26.747412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-3d612634-abbb-432f-a5e1-01c844f06c5e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:26.750422 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3d612634-abbb-432f-a5e1-01c844f06c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:26.852537 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1311/2611] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:26.865792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49db236-c364-4db7-9ed0-13d555cd3982 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:26.866436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49db236-c364-4db7-9ed0-13d555cd3982 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:26.866938 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49db236-c364-4db7-9ed0-13d555cd3982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:26.914000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-a49db236-c364-4db7-9ed0-13d555cd3982 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:26.917162 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-a49db236-c364-4db7-9ed0-13d555cd3982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:26.931821 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1301/2612] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:26.936348 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d612634-abbb-432f-a5e1-01c844f06c5e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:26.953172 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d612634-abbb-432f-a5e1-01c844f06c5e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:26.962465 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820fd82-97c8-443d-9589-16bc3b8c12bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:26.964290 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820fd82-97c8-443d-9589-16bc3b8c12bf admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:26.964830 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820fd82-97c8-443d-9589-16bc3b8c12bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:26.965377 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820fd82-97c8-443d-9589-16bc3b8c12bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:26.966789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820fd82-97c8-443d-9589-16bc3b8c12bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:49:26.967404 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820fd82-97c8-443d-9589-16bc3b8c12bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:26.970601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820fd82-97c8-443d-9589-16bc3b8c12bf admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:26.991310 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1312/2613] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:49:26.995669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49db236-c364-4db7-9ed0-13d555cd3982 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:27.005559 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49db236-c364-4db7-9ed0-13d555cd3982 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:27.017946 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efca3c-1c2b-439d-b776-6c195e72c7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:27.018649 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efca3c-1c2b-439d-b776-6c195e72c7ca admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:27.018935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efca3c-1c2b-439d-b776-6c195e72c7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:27.019233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efca3c-1c2b-439d-b776-6c195e72c7ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:27.023236 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efca3c-1c2b-439d-b776-6c195e72c7ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:27.026138 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efca3c-1c2b-439d-b776-6c195e72c7ca admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:27.076053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1302/2614] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:49:26 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:27.080255 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820fd82-97c8-443d-9589-16bc3b8c12bf admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:27.097230 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820fd82-97c8-443d-9589-16bc3b8c12bf admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:27.181075 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0942e-82fa-406a-a352-893273cef572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:27.183141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0942e-82fa-406a-a352-893273cef572 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:27.183599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0942e-82fa-406a-a352-893273cef572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:27.184141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0942e-82fa-406a-a352-893273cef572 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:27.185015 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0942e-82fa-406a-a352-893273cef572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:27.187451 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0942e-82fa-406a-a352-893273cef572 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:27.229792 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1313/2615] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:49:27 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:49:27.231131 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efca3c-1c2b-439d-b776-6c195e72c7ca admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:27.250322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efca3c-1c2b-439d-b776-6c195e72c7ca admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:27.256237 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980d465-aaa7-4bdb-8ce7-59c461d60e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:27.257090 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980d465-aaa7-4bdb-8ce7-59c461d60e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:27.257480 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980d465-aaa7-4bdb-8ce7-59c461d60e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:27.257851 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980d465-aaa7-4bdb-8ce7-59c461d60e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:27.258713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980d465-aaa7-4bdb-8ce7-59c461d60e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:27.261122 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980d465-aaa7-4bdb-8ce7-59c461d60e77 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:27.276350 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1303/2616] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:27.277610 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0942e-82fa-406a-a352-893273cef572 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:27.287881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0942e-82fa-406a-a352-893273cef572 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:27.295437 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81055e2-87ff-4e62-a1aa-47354a83f02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:27.296308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81055e2-87ff-4e62-a1aa-47354a83f02e admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:27.296698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81055e2-87ff-4e62-a1aa-47354a83f02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:27.297138 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81055e2-87ff-4e62-a1aa-47354a83f02e admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:27.297953 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81055e2-87ff-4e62-a1aa-47354a83f02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:27.300036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81055e2-87ff-4e62-a1aa-47354a83f02e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:27.314344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1314/2617] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:27.317446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980d465-aaa7-4bdb-8ce7-59c461d60e77 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:27.333229 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980d465-aaa7-4bdb-8ce7-59c461d60e77 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:27.341106 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994faeb8-3bff-4bf5-b47c-f242eb48cd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:27.342071 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994faeb8-3bff-4bf5-b47c-f242eb48cd19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:27.342445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994faeb8-3bff-4bf5-b47c-f242eb48cd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:27.342782 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994faeb8-3bff-4bf5-b47c-f242eb48cd19 admin admin] PATH_INFO: `/v3/projects/70af902746ff4d75b9b42524549beedd/users/0649bfeed1554bf1bbd4c83ea7b33ca8/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:27.361671 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994faeb8-3bff-4bf5-b47c-f242eb48cd19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70af902746ff4d75b9b42524549beedd, user_id=0649bfeed1554bf1bbd4c83ea7b33ca8, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:27.364373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994faeb8-3bff-4bf5-b47c-f242eb48cd19 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:27.391837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1304/2618] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:27 2022] PUT /identity/v3/projects/70af902746ff4d75b9b42524549beedd/users/0649bfeed1554bf1bbd4c83ea7b33ca8/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:49:27.403992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c4c7d-7220-4d0e-a7ee-542b8ca2b5de None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:27.404280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c4c7d-7220-4d0e-a7ee-542b8ca2b5de None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:27.404563 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c4c7d-7220-4d0e-a7ee-542b8ca2b5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:27.434291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-0f6c4c7d-7220-4d0e-a7ee-542b8ca2b5de None None] MFA Rules not processed for user `0649bfeed1554bf1bbd4c83ea7b33ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:27.435643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0f6c4c7d-7220-4d0e-a7ee-542b8ca2b5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:27.517093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1315/2619] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:27.521258 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994faeb8-3bff-4bf5-b47c-f242eb48cd19 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:27.587417 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994faeb8-3bff-4bf5-b47c-f242eb48cd19 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:27.592862 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ca7b5-cc46-4804-9420-58168b19996d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:27.593526 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ca7b5-cc46-4804-9420-58168b19996d admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:27.593809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ca7b5-cc46-4804-9420-58168b19996d admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:27.594086 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ca7b5-cc46-4804-9420-58168b19996d admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:27.594805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ca7b5-cc46-4804-9420-58168b19996d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:27.596708 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ca7b5-cc46-4804-9420-58168b19996d admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:27.624811 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1305/2620] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:49:27 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:27.626279 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c4c7d-7220-4d0e-a7ee-542b8ca2b5de None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:27.637476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c4c7d-7220-4d0e-a7ee-542b8ca2b5de None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:27.699145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246356e-ff5f-43ca-a4d9-da7b87242d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:27.699819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246356e-ff5f-43ca-a4d9-da7b87242d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:27.700100 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246356e-ff5f-43ca-a4d9-da7b87242d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:27.700376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246356e-ff5f-43ca-a4d9-da7b87242d37 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:27.701078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246356e-ff5f-43ca-a4d9-da7b87242d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:27.703001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246356e-ff5f-43ca-a4d9-da7b87242d37 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:27.726636 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1316/2621] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:49:27 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:27.727812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ca7b5-cc46-4804-9420-58168b19996d admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:27.738290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ca7b5-cc46-4804-9420-58168b19996d admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:27.742998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba053220-232f-41f7-84a6-a4789239870a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:27.743652 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba053220-232f-41f7-84a6-a4789239870a admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:27.743991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba053220-232f-41f7-84a6-a4789239870a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:27.744417 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba053220-232f-41f7-84a6-a4789239870a admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:27.745386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba053220-232f-41f7-84a6-a4789239870a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:27.746914 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba053220-232f-41f7-84a6-a4789239870a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:27.758317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1306/2622] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:27.763173 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246356e-ff5f-43ca-a4d9-da7b87242d37 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:27.774342 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246356e-ff5f-43ca-a4d9-da7b87242d37 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:27.778986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db27ec9-b05c-4883-842f-d5aa09c8ac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:27.779861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27ec9-b05c-4883-842f-d5aa09c8ac07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:27.780142 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27ec9-b05c-4883-842f-d5aa09c8ac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:27.780451 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27ec9-b05c-4883-842f-d5aa09c8ac07 admin admin] PATH_INFO: `/v3/projects/ba24ff3ae2594190bac00dee3ecc3497/users/deea704fb6514ee1a821ae009902f7ca/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:27.794875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db27ec9-b05c-4883-842f-d5aa09c8ac07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba24ff3ae2594190bac00dee3ecc3497, user_id=deea704fb6514ee1a821ae009902f7ca, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:27.797497 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db27ec9-b05c-4883-842f-d5aa09c8ac07 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:27.813218 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1317/2623] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:27 2022] PUT /identity/v3/projects/ba24ff3ae2594190bac00dee3ecc3497/users/deea704fb6514ee1a821ae009902f7ca/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:27.816495 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba053220-232f-41f7-84a6-a4789239870a admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:27.827025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba053220-232f-41f7-84a6-a4789239870a admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:27.886402 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e152148-7768-44a7-b03f-f58b72d92d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:27.886958 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e152148-7768-44a7-b03f-f58b72d92d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:27.888404 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e152148-7768-44a7-b03f-f58b72d92d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:27.888404 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e152148-7768-44a7-b03f-f58b72d92d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:27.888404 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e152148-7768-44a7-b03f-f58b72d92d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:27.889858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e152148-7768-44a7-b03f-f58b72d92d46 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:27.907835 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1307/2624] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:27.912798 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db27ec9-b05c-4883-842f-d5aa09c8ac07 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:27.925664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db27ec9-b05c-4883-842f-d5aa09c8ac07 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:27.930684 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ac17e-0b74-4dad-9e15-3649b91fab55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:27.932186 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ac17e-0b74-4dad-9e15-3649b91fab55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:27.932593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ac17e-0b74-4dad-9e15-3649b91fab55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:27.933053 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ac17e-0b74-4dad-9e15-3649b91fab55 admin admin] PATH_INFO: `/v3/projects/ba24ff3ae2594190bac00dee3ecc3497/users/deea704fb6514ee1a821ae009902f7ca/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:27.937150 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ac17e-0b74-4dad-9e15-3649b91fab55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba24ff3ae2594190bac00dee3ecc3497, user_id=deea704fb6514ee1a821ae009902f7ca, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:27.939841 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ac17e-0b74-4dad-9e15-3649b91fab55 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:27.951573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1318/2625] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:27 2022] PUT /identity/v3/projects/ba24ff3ae2594190bac00dee3ecc3497/users/deea704fb6514ee1a821ae009902f7ca/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:27.962214 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280c15b-939a-471b-9fc5-dbdacf08418f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:27.962522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280c15b-939a-471b-9fc5-dbdacf08418f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:27.962837 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280c15b-939a-471b-9fc5-dbdacf08418f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:27.991522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-5280c15b-939a-471b-9fc5-dbdacf08418f None None] MFA Rules not processed for user `deea704fb6514ee1a821ae009902f7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:27.992398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-5280c15b-939a-471b-9fc5-dbdacf08418f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:28.068513 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1308/2626] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:28.080858 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ac17e-0b74-4dad-9e15-3649b91fab55 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:28.082901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-418ac17e-0b74-4dad-9e15-3649b91fab55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:28.144074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ac17e-0b74-4dad-9e15-3649b91fab55 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:28.149475 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789754af-c8a0-4e23-b387-4d72d6f41593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:28.150501 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789754af-c8a0-4e23-b387-4d72d6f41593 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:28.151706 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789754af-c8a0-4e23-b387-4d72d6f41593 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:28.152153 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789754af-c8a0-4e23-b387-4d72d6f41593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:28.164373 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789754af-c8a0-4e23-b387-4d72d6f41593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:28.166873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789754af-c8a0-4e23-b387-4d72d6f41593 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:28.178040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1319/2627] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:28.272036 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280c15b-939a-471b-9fc5-dbdacf08418f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:28.284060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280c15b-939a-471b-9fc5-dbdacf08418f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:28.287850 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c9678-bd30-4b03-897d-ef67f3f467d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:28.288493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c9678-bd30-4b03-897d-ef67f3f467d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:28.289092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c9678-bd30-4b03-897d-ef67f3f467d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:28.289092 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c9678-bd30-4b03-897d-ef67f3f467d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:28.363281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c9678-bd30-4b03-897d-ef67f3f467d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:28.364942 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c9678-bd30-4b03-897d-ef67f3f467d8 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:28.377316 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1309/2628] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:29.842811 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789754af-c8a0-4e23-b387-4d72d6f41593 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:29.845250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-789754af-c8a0-4e23-b387-4d72d6f41593 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:29.921368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789754af-c8a0-4e23-b387-4d72d6f41593 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:29.925934 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e5c31-ea75-4d7b-963b-be50249acd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:29.926835 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e5c31-ea75-4d7b-963b-be50249acd6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:29.927256 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e5c31-ea75-4d7b-963b-be50249acd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:29.928043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e5c31-ea75-4d7b-963b-be50249acd6c admin admin] PATH_INFO: `/v3/users/5953ab291e2844b297285ae3bb92be85` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:29.929379 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e5c31-ea75-4d7b-963b-be50249acd6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5953ab291e2844b297285ae3bb92be85)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:29.931376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e5c31-ea75-4d7b-963b-be50249acd6c admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:29.997359 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-486e5c31-ea75-4d7b-963b-be50249acd6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5953ab291e2844b297285ae3bb92be85'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.004939 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-486e5c31-ea75-4d7b-963b-be50249acd6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5953ab291e2844b297285ae3bb92be85'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.005573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-486e5c31-ea75-4d7b-963b-be50249acd6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5953ab291e2844b297285ae3bb92be85'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.006201 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-486e5c31-ea75-4d7b-963b-be50249acd6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5953ab291e2844b297285ae3bb92be85'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.020319 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-486e5c31-ea75-4d7b-963b-be50249acd6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5953ab291e2844b297285ae3bb92be85'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.038256 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1320/2629] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:29 2022] DELETE /identity/v3/users/5953ab291e2844b297285ae3bb92be85 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:30.217131 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c9678-bd30-4b03-897d-ef67f3f467d8 service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:30.228693 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c9678-bd30-4b03-897d-ef67f3f467d8 service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:30.284789 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75434568-62b3-4dfa-968f-3e10b4c4bb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:30.285689 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75434568-62b3-4dfa-968f-3e10b4c4bb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:30.286001 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75434568-62b3-4dfa-968f-3e10b4c4bb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:30.286316 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75434568-62b3-4dfa-968f-3e10b4c4bb87 admin admin] PATH_INFO: `/v3/projects/89fca92b565f42ffba33b22f01fbc248` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:30.287500 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75434568-62b3-4dfa-968f-3e10b4c4bb87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89fca92b565f42ffba33b22f01fbc248)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:30.289438 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75434568-62b3-4dfa-968f-3e10b4c4bb87 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:30.336050 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-75434568-62b3-4dfa-968f-3e10b4c4bb87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89fca92b565f42ffba33b22f01fbc248', 'request_id': 'req-75434568-62b3-4dfa-968f-3e10b4c4bb87'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.341400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-75434568-62b3-4dfa-968f-3e10b4c4bb87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89fca92b565f42ffba33b22f01fbc248', 'request_id': 'req-75434568-62b3-4dfa-968f-3e10b4c4bb87'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.347295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-75434568-62b3-4dfa-968f-3e10b4c4bb87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89fca92b565f42ffba33b22f01fbc248', 'request_id': 'req-75434568-62b3-4dfa-968f-3e10b4c4bb87'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.358812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-75434568-62b3-4dfa-968f-3e10b4c4bb87 admin admin] The token cache is being invalidate because project 89fca92b565f42ffba33b22f01fbc248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:30.359095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-75434568-62b3-4dfa-968f-3e10b4c4bb87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.359704 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-75434568-62b3-4dfa-968f-3e10b4c4bb87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.361227 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1310/2630] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:30 2022] DELETE /identity/v3/projects/89fca92b565f42ffba33b22f01fbc248 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:30.365283 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e5c31-ea75-4d7b-963b-be50249acd6c admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:30.366765 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-486e5c31-ea75-4d7b-963b-be50249acd6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:30.380553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e5c31-ea75-4d7b-963b-be50249acd6c admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:30.436204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad575a-9500-424f-bff2-833c51044faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:30.436996 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad575a-9500-424f-bff2-833c51044faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:30.437280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad575a-9500-424f-bff2-833c51044faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:30.437553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad575a-9500-424f-bff2-833c51044faf admin admin] PATH_INFO: `/v3/users/fd63ddcbb387417ab4fe5863e6777bde` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:30.438748 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad575a-9500-424f-bff2-833c51044faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd63ddcbb387417ab4fe5863e6777bde)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:30.440629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad575a-9500-424f-bff2-833c51044faf admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:30.484947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-cdad575a-9500-424f-bff2-833c51044faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd63ddcbb387417ab4fe5863e6777bde'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.491417 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-cdad575a-9500-424f-bff2-833c51044faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd63ddcbb387417ab4fe5863e6777bde'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.492077 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-cdad575a-9500-424f-bff2-833c51044faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd63ddcbb387417ab4fe5863e6777bde'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.492683 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-cdad575a-9500-424f-bff2-833c51044faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd63ddcbb387417ab4fe5863e6777bde'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.504568 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-cdad575a-9500-424f-bff2-833c51044faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd63ddcbb387417ab4fe5863e6777bde'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.518284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1321/2631] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:30 2022] DELETE /identity/v3/users/fd63ddcbb387417ab4fe5863e6777bde => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:30.688709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75434568-62b3-4dfa-968f-3e10b4c4bb87 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:30.690043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-75434568-62b3-4dfa-968f-3e10b4c4bb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:30.703423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75434568-62b3-4dfa-968f-3e10b4c4bb87 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:30.763116 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59a15f-3db3-4b31-8b1b-a88feb1d2813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:30.763985 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59a15f-3db3-4b31-8b1b-a88feb1d2813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:30.764261 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59a15f-3db3-4b31-8b1b-a88feb1d2813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:30.764529 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59a15f-3db3-4b31-8b1b-a88feb1d2813 admin admin] PATH_INFO: `/v3/projects/ebeee4150d6e4e46b82b1c0e8449d0f7` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:30.765694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59a15f-3db3-4b31-8b1b-a88feb1d2813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebeee4150d6e4e46b82b1c0e8449d0f7)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:30.767599 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59a15f-3db3-4b31-8b1b-a88feb1d2813 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:30.811970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-4d59a15f-3db3-4b31-8b1b-a88feb1d2813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebeee4150d6e4e46b82b1c0e8449d0f7', 'request_id': 'req-4d59a15f-3db3-4b31-8b1b-a88feb1d2813'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.817088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-4d59a15f-3db3-4b31-8b1b-a88feb1d2813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebeee4150d6e4e46b82b1c0e8449d0f7', 'request_id': 'req-4d59a15f-3db3-4b31-8b1b-a88feb1d2813'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.823020 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-4d59a15f-3db3-4b31-8b1b-a88feb1d2813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebeee4150d6e4e46b82b1c0e8449d0f7', 'request_id': 'req-4d59a15f-3db3-4b31-8b1b-a88feb1d2813'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.834756 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-4d59a15f-3db3-4b31-8b1b-a88feb1d2813 admin admin] The token cache is being invalidate because project ebeee4150d6e4e46b82b1c0e8449d0f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:30.835035 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-4d59a15f-3db3-4b31-8b1b-a88feb1d2813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.835637 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-4d59a15f-3db3-4b31-8b1b-a88feb1d2813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:30.837171 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1311/2632] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:30 2022] DELETE /identity/v3/projects/ebeee4150d6e4e46b82b1c0e8449d0f7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:33.090705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad575a-9500-424f-bff2-833c51044faf admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:33.092192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-cdad575a-9500-424f-bff2-833c51044faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:33.105286 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad575a-9500-424f-bff2-833c51044faf admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:33.158427 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21980d-f7b2-492d-8ebd-764643091996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:33.159309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21980d-f7b2-492d-8ebd-764643091996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:33.159572 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21980d-f7b2-492d-8ebd-764643091996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:33.159843 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21980d-f7b2-492d-8ebd-764643091996 admin admin] PATH_INFO: `/v3/users/0649bfeed1554bf1bbd4c83ea7b33ca8` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:33.161003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21980d-f7b2-492d-8ebd-764643091996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0649bfeed1554bf1bbd4c83ea7b33ca8)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:33.162925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21980d-f7b2-492d-8ebd-764643091996 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:33.206017 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-fc21980d-f7b2-492d-8ebd-764643091996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0649bfeed1554bf1bbd4c83ea7b33ca8'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:33.213308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-fc21980d-f7b2-492d-8ebd-764643091996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0649bfeed1554bf1bbd4c83ea7b33ca8'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:33.213956 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-fc21980d-f7b2-492d-8ebd-764643091996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0649bfeed1554bf1bbd4c83ea7b33ca8'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:33.214573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-fc21980d-f7b2-492d-8ebd-764643091996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0649bfeed1554bf1bbd4c83ea7b33ca8'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:33.225667 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-fc21980d-f7b2-492d-8ebd-764643091996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0649bfeed1554bf1bbd4c83ea7b33ca8'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:33.238789 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1322/2633] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:33 2022] DELETE /identity/v3/users/0649bfeed1554bf1bbd4c83ea7b33ca8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:33.243393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79319070-da38-4de3-88b3-2c5d6870f6df None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:33.243910 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79319070-da38-4de3-88b3-2c5d6870f6df None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:33.244008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79319070-da38-4de3-88b3-2c5d6870f6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:33.261256 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-79319070-da38-4de3-88b3-2c5d6870f6df None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:33.262465 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-79319070-da38-4de3-88b3-2c5d6870f6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:33.320445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1312/2634] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:33.331391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21980d-f7b2-492d-8ebd-764643091996 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:33.332812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-fc21980d-f7b2-492d-8ebd-764643091996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:33.392038 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21980d-f7b2-492d-8ebd-764643091996 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:33.395790 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d943ad6-add5-49a3-81b3-794a52b55adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:33.396431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d943ad6-add5-49a3-81b3-794a52b55adb service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:33.396710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d943ad6-add5-49a3-81b3-794a52b55adb service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:33.396983 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d943ad6-add5-49a3-81b3-794a52b55adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:33.406262 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d943ad6-add5-49a3-81b3-794a52b55adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:33.407672 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d943ad6-add5-49a3-81b3-794a52b55adb service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:33.416949 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1323/2635] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:33.733944 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79319070-da38-4de3-88b3-2c5d6870f6df None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:33.735367 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-79319070-da38-4de3-88b3-2c5d6870f6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:33.747897 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79319070-da38-4de3-88b3-2c5d6870f6df None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:33.752836 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83974dd8-bb85-4419-bf12-94e79729c184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:33.753886 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83974dd8-bb85-4419-bf12-94e79729c184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:33.754177 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83974dd8-bb85-4419-bf12-94e79729c184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:33.754461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83974dd8-bb85-4419-bf12-94e79729c184 admin admin] PATH_INFO: `/v3/projects/70af902746ff4d75b9b42524549beedd` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:33.756318 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83974dd8-bb85-4419-bf12-94e79729c184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70af902746ff4d75b9b42524549beedd)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:33.758415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83974dd8-bb85-4419-bf12-94e79729c184 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:33.805044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-83974dd8-bb85-4419-bf12-94e79729c184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70af902746ff4d75b9b42524549beedd', 'request_id': 'req-83974dd8-bb85-4419-bf12-94e79729c184'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:33.810687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-83974dd8-bb85-4419-bf12-94e79729c184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70af902746ff4d75b9b42524549beedd', 'request_id': 'req-83974dd8-bb85-4419-bf12-94e79729c184'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:33.816611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-83974dd8-bb85-4419-bf12-94e79729c184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70af902746ff4d75b9b42524549beedd', 'request_id': 'req-83974dd8-bb85-4419-bf12-94e79729c184'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:33.829257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-83974dd8-bb85-4419-bf12-94e79729c184 admin admin] The token cache is being invalidate because project 70af902746ff4d75b9b42524549beedd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:33.829541 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-83974dd8-bb85-4419-bf12-94e79729c184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:33.830146 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-83974dd8-bb85-4419-bf12-94e79729c184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:33.831953 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1313/2636] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:33 2022] DELETE /identity/v3/projects/70af902746ff4d75b9b42524549beedd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:33.835921 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d943ad6-add5-49a3-81b3-794a52b55adb service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:33.845473 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d943ad6-add5-49a3-81b3-794a52b55adb service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:33.899929 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47480b-02d0-48f6-9325-55f3323f71c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:33.900861 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47480b-02d0-48f6-9325-55f3323f71c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:33.901137 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47480b-02d0-48f6-9325-55f3323f71c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:33.901405 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47480b-02d0-48f6-9325-55f3323f71c3 admin admin] PATH_INFO: `/v3/users/deea704fb6514ee1a821ae009902f7ca` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:33.902642 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47480b-02d0-48f6-9325-55f3323f71c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deea704fb6514ee1a821ae009902f7ca)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:33.904531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47480b-02d0-48f6-9325-55f3323f71c3 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:33.948529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0c47480b-02d0-48f6-9325-55f3323f71c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deea704fb6514ee1a821ae009902f7ca'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:33.955242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0c47480b-02d0-48f6-9325-55f3323f71c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deea704fb6514ee1a821ae009902f7ca'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:33.955893 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0c47480b-02d0-48f6-9325-55f3323f71c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deea704fb6514ee1a821ae009902f7ca'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:33.956749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0c47480b-02d0-48f6-9325-55f3323f71c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deea704fb6514ee1a821ae009902f7ca'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:33.968052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0c47480b-02d0-48f6-9325-55f3323f71c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deea704fb6514ee1a821ae009902f7ca'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:33.980351 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1324/2637] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:33 2022] DELETE /identity/v3/users/deea704fb6514ee1a821ae009902f7ca => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:49:34.246742 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83974dd8-bb85-4419-bf12-94e79729c184 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:34.248165 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-83974dd8-bb85-4419-bf12-94e79729c184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:34.262060 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83974dd8-bb85-4419-bf12-94e79729c184 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:34.318331 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62fb9d-23c9-4233-a9b5-5fa9c16dc9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:34.319186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62fb9d-23c9-4233-a9b5-5fa9c16dc9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:34.319497 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62fb9d-23c9-4233-a9b5-5fa9c16dc9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:34.319770 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62fb9d-23c9-4233-a9b5-5fa9c16dc9e7 admin admin] PATH_INFO: `/v3/projects/ba24ff3ae2594190bac00dee3ecc3497` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:34.320934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62fb9d-23c9-4233-a9b5-5fa9c16dc9e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba24ff3ae2594190bac00dee3ecc3497)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:34.323102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62fb9d-23c9-4233-a9b5-5fa9c16dc9e7 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:34.366976 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-3b62fb9d-23c9-4233-a9b5-5fa9c16dc9e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba24ff3ae2594190bac00dee3ecc3497', 'request_id': 'req-3b62fb9d-23c9-4233-a9b5-5fa9c16dc9e7'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:34.372777 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-3b62fb9d-23c9-4233-a9b5-5fa9c16dc9e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba24ff3ae2594190bac00dee3ecc3497', 'request_id': 'req-3b62fb9d-23c9-4233-a9b5-5fa9c16dc9e7'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:34.378726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-3b62fb9d-23c9-4233-a9b5-5fa9c16dc9e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba24ff3ae2594190bac00dee3ecc3497', 'request_id': 'req-3b62fb9d-23c9-4233-a9b5-5fa9c16dc9e7'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:34.390658 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-3b62fb9d-23c9-4233-a9b5-5fa9c16dc9e7 admin admin] The token cache is being invalidate because project ba24ff3ae2594190bac00dee3ecc3497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:34.390943 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-3b62fb9d-23c9-4233-a9b5-5fa9c16dc9e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:34.391553 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-3b62fb9d-23c9-4233-a9b5-5fa9c16dc9e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:34.393079 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1314/2638] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:34 2022] DELETE /identity/v3/projects/ba24ff3ae2594190bac00dee3ecc3497 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:34.397979 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e2993-516c-4742-ad7d-84df0e5deeb0 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:34.398476 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e2993-516c-4742-ad7d-84df0e5deeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:34.398601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e2993-516c-4742-ad7d-84df0e5deeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:34.416072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ac4e2993-516c-4742-ad7d-84df0e5deeb0 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:34.417237 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ac4e2993-516c-4742-ad7d-84df0e5deeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:34.473263 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1325/2639] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:49:34.482799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a6e58-b6e3-4c20-a6d2-7568babc2106 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:34.483082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a6e58-b6e3-4c20-a6d2-7568babc2106 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:34.483361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a6e58-b6e3-4c20-a6d2-7568babc2106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:34.501695 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-553a6e58-b6e3-4c20-a6d2-7568babc2106 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:34.502907 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-553a6e58-b6e3-4c20-a6d2-7568babc2106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:34.511487 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1315/2640] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:34.515778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e2993-516c-4742-ad7d-84df0e5deeb0 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:34.525898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e2993-516c-4742-ad7d-84df0e5deeb0 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:34.530612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae6ddd-2ad9-474e-89a9-4e58d3670db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:34.531263 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae6ddd-2ad9-474e-89a9-4e58d3670db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:34.531549 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae6ddd-2ad9-474e-89a9-4e58d3670db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:34.531867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae6ddd-2ad9-474e-89a9-4e58d3670db8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:34.532587 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae6ddd-2ad9-474e-89a9-4e58d3670db8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:49:34.532892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae6ddd-2ad9-474e-89a9-4e58d3670db8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:34.534560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae6ddd-2ad9-474e-89a9-4e58d3670db8 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:34.546547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1326/2641] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:49:34.551055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a6e58-b6e3-4c20-a6d2-7568babc2106 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:34.560606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a6e58-b6e3-4c20-a6d2-7568babc2106 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:34.565136 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119cecf-6174-4546-a6b6-252b0f50a38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:34.565776 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119cecf-6174-4546-a6b6-252b0f50a38b admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:34.566064 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119cecf-6174-4546-a6b6-252b0f50a38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:34.566371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119cecf-6174-4546-a6b6-252b0f50a38b admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:34.567105 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119cecf-6174-4546-a6b6-252b0f50a38b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:34.568977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119cecf-6174-4546-a6b6-252b0f50a38b admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:34.594140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1316/2642] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:49:34 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:49:34.598296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae6ddd-2ad9-474e-89a9-4e58d3670db8 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:34.608531 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae6ddd-2ad9-474e-89a9-4e58d3670db8 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:34.661968 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dde54-1e99-4496-99db-c71b427907b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:34.662586 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dde54-1e99-4496-99db-c71b427907b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:34.662869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dde54-1e99-4496-99db-c71b427907b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:34.663152 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dde54-1e99-4496-99db-c71b427907b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:34.663833 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dde54-1e99-4496-99db-c71b427907b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:34.666413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dde54-1e99-4496-99db-c71b427907b0 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:34.686561 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1327/2643] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:49:34 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:34.690744 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119cecf-6174-4546-a6b6-252b0f50a38b admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:34.701428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119cecf-6174-4546-a6b6-252b0f50a38b admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:34.710686 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225dd201-c376-4655-bfdd-704b8e4258ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:34.711481 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dd201-c376-4655-bfdd-704b8e4258ee admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:34.711934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dd201-c376-4655-bfdd-704b8e4258ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:34.712807 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dd201-c376-4655-bfdd-704b8e4258ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:34.713687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225dd201-c376-4655-bfdd-704b8e4258ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:34.715500 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225dd201-c376-4655-bfdd-704b8e4258ee admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:34.726130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1317/2644] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:34.730823 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dde54-1e99-4496-99db-c71b427907b0 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:34.740847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dde54-1e99-4496-99db-c71b427907b0 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:34.746247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fe188-b2e8-432e-8ac4-9d02cac7ef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:34.746920 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fe188-b2e8-432e-8ac4-9d02cac7ef98 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:34.747215 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fe188-b2e8-432e-8ac4-9d02cac7ef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:34.747496 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fe188-b2e8-432e-8ac4-9d02cac7ef98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:34.748217 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fe188-b2e8-432e-8ac4-9d02cac7ef98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:34.749803 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fe188-b2e8-432e-8ac4-9d02cac7ef98 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:34.759859 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1328/2645] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:34.764063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225dd201-c376-4655-bfdd-704b8e4258ee admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:34.774376 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225dd201-c376-4655-bfdd-704b8e4258ee admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:34.780561 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cebcaa-6dde-4c62-a498-55ca7f9be5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:34.781448 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cebcaa-6dde-4c62-a498-55ca7f9be5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:34.781735 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cebcaa-6dde-4c62-a498-55ca7f9be5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:34.781998 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cebcaa-6dde-4c62-a498-55ca7f9be5c6 admin admin] PATH_INFO: `/v3/projects/54542de96a0b43039898c803881e3137/users/8843994f6955420fbd5f173a9441e2b7/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:34.796798 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cebcaa-6dde-4c62-a498-55ca7f9be5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54542de96a0b43039898c803881e3137, user_id=8843994f6955420fbd5f173a9441e2b7, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:34.799487 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cebcaa-6dde-4c62-a498-55ca7f9be5c6 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:34.813316 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1318/2646] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:34 2022] PUT /identity/v3/projects/54542de96a0b43039898c803881e3137/users/8843994f6955420fbd5f173a9441e2b7/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:34.823838 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff55a3-78e8-4921-bc8e-9ad3f03630d6 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:34.824171 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff55a3-78e8-4921-bc8e-9ad3f03630d6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:34.824400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff55a3-78e8-4921-bc8e-9ad3f03630d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:34.850898 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-c3ff55a3-78e8-4921-bc8e-9ad3f03630d6 None None] MFA Rules not processed for user `8843994f6955420fbd5f173a9441e2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:34.852083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c3ff55a3-78e8-4921-bc8e-9ad3f03630d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:34.913691 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1329/2647] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:34.924661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cebcaa-6dde-4c62-a498-55ca7f9be5c6 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:34.926339 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-68cebcaa-6dde-4c62-a498-55ca7f9be5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:34.980953 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cebcaa-6dde-4c62-a498-55ca7f9be5c6 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:34.984533 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7df340-03d7-460a-aed1-96bfa92fe785 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:34.985167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7df340-03d7-460a-aed1-96bfa92fe785 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:34.985442 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7df340-03d7-460a-aed1-96bfa92fe785 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:34.985714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7df340-03d7-460a-aed1-96bfa92fe785 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:34.993795 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7df340-03d7-460a-aed1-96bfa92fe785 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:34.995241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7df340-03d7-460a-aed1-96bfa92fe785 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:35.003733 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1319/2648] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:35.022874 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff55a3-78e8-4921-bc8e-9ad3f03630d6 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:35.082864 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff55a3-78e8-4921-bc8e-9ad3f03630d6 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:35.088451 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ce6d6-99b1-4423-8b8c-a89679a768e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:35.089324 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ce6d6-99b1-4423-8b8c-a89679a768e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:35.089612 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ce6d6-99b1-4423-8b8c-a89679a768e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:35.089895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ce6d6-99b1-4423-8b8c-a89679a768e8 admin admin] PATH_INFO: `/v3/users/8843994f6955420fbd5f173a9441e2b7` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:35.091145 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ce6d6-99b1-4423-8b8c-a89679a768e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8843994f6955420fbd5f173a9441e2b7)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:35.093058 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ce6d6-99b1-4423-8b8c-a89679a768e8 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:35.137089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-de0ce6d6-99b1-4423-8b8c-a89679a768e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8843994f6955420fbd5f173a9441e2b7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:35.143731 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-de0ce6d6-99b1-4423-8b8c-a89679a768e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8843994f6955420fbd5f173a9441e2b7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:35.144404 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-de0ce6d6-99b1-4423-8b8c-a89679a768e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8843994f6955420fbd5f173a9441e2b7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:35.145040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-de0ce6d6-99b1-4423-8b8c-a89679a768e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8843994f6955420fbd5f173a9441e2b7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:35.156960 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-de0ce6d6-99b1-4423-8b8c-a89679a768e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8843994f6955420fbd5f173a9441e2b7'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:35.169919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1330/2649] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:35 2022] DELETE /identity/v3/users/8843994f6955420fbd5f173a9441e2b7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:35.174455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e88a3-37b0-49ef-af61-073315074f3a None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:35.174743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e88a3-37b0-49ef-af61-073315074f3a None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:35.175021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e88a3-37b0-49ef-af61-073315074f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:35.191474 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-7e9e88a3-37b0-49ef-af61-073315074f3a None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:35.192643 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7e9e88a3-37b0-49ef-af61-073315074f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:35.251386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1320/2650] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:35.261858 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ce6d6-99b1-4423-8b8c-a89679a768e8 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:35.263267 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-de0ce6d6-99b1-4423-8b8c-a89679a768e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:35.318384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ce6d6-99b1-4423-8b8c-a89679a768e8 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:35.322627 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb5665-ada7-4d4e-8af9-80eab351fcca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:35.323263 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb5665-ada7-4d4e-8af9-80eab351fcca service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:35.323542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb5665-ada7-4d4e-8af9-80eab351fcca service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:35.323814 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb5665-ada7-4d4e-8af9-80eab351fcca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:35.333638 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb5665-ada7-4d4e-8af9-80eab351fcca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:35.335111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb5665-ada7-4d4e-8af9-80eab351fcca service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:35.344678 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1331/2651] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:35.601957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e88a3-37b0-49ef-af61-073315074f3a None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:35.603425 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7e9e88a3-37b0-49ef-af61-073315074f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:35.615374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e88a3-37b0-49ef-af61-073315074f3a None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:35.620455 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29572d-e59e-4b1c-934e-6b8796351183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:35.621514 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29572d-e59e-4b1c-934e-6b8796351183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:35.621746 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29572d-e59e-4b1c-934e-6b8796351183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:35.621982 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29572d-e59e-4b1c-934e-6b8796351183 admin admin] PATH_INFO: `/v3/projects/54542de96a0b43039898c803881e3137` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:35.623231 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29572d-e59e-4b1c-934e-6b8796351183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54542de96a0b43039898c803881e3137)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:35.625126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29572d-e59e-4b1c-934e-6b8796351183 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:35.670334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-ec29572d-e59e-4b1c-934e-6b8796351183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54542de96a0b43039898c803881e3137', 'request_id': 'req-ec29572d-e59e-4b1c-934e-6b8796351183'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:35.675549 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-ec29572d-e59e-4b1c-934e-6b8796351183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54542de96a0b43039898c803881e3137', 'request_id': 'req-ec29572d-e59e-4b1c-934e-6b8796351183'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:35.682033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-ec29572d-e59e-4b1c-934e-6b8796351183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54542de96a0b43039898c803881e3137', 'request_id': 'req-ec29572d-e59e-4b1c-934e-6b8796351183'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:35.692945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-ec29572d-e59e-4b1c-934e-6b8796351183 admin admin] The token cache is being invalidate because project 54542de96a0b43039898c803881e3137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:35.693163 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-ec29572d-e59e-4b1c-934e-6b8796351183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:35.693774 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-ec29572d-e59e-4b1c-934e-6b8796351183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:35.695357 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1321/2652] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:35 2022] DELETE /identity/v3/projects/54542de96a0b43039898c803881e3137 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:35.700218 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabb324-3063-4c4c-9446-90430d9cca4e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:35.700719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabb324-3063-4c4c-9446-90430d9cca4e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:35.700831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabb324-3063-4c4c-9446-90430d9cca4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:35.717944 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-2fabb324-3063-4c4c-9446-90430d9cca4e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:35.719184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-2fabb324-3063-4c4c-9446-90430d9cca4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:35.776782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1332/2653] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:35.784685 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88d5f8-bdfb-4ac2-9c41-7cf81c206e79 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:35.784973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88d5f8-bdfb-4ac2-9c41-7cf81c206e79 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:35.785249 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88d5f8-bdfb-4ac2-9c41-7cf81c206e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:35.803459 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-2f88d5f8-bdfb-4ac2-9c41-7cf81c206e79 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:35.804629 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-2f88d5f8-bdfb-4ac2-9c41-7cf81c206e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:35.814701 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1322/2654] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:35.818890 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabb324-3063-4c4c-9446-90430d9cca4e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:35.828470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabb324-3063-4c4c-9446-90430d9cca4e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:35.833482 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64545937-2f71-460f-aedc-91bf145551b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:35.834141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64545937-2f71-460f-aedc-91bf145551b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:35.834463 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64545937-2f71-460f-aedc-91bf145551b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:35.834771 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64545937-2f71-460f-aedc-91bf145551b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:35.835510 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64545937-2f71-460f-aedc-91bf145551b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:49:35.835826 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64545937-2f71-460f-aedc-91bf145551b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:35.837497 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64545937-2f71-460f-aedc-91bf145551b4 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:35.849542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1333/2655] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:49:35.854351 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88d5f8-bdfb-4ac2-9c41-7cf81c206e79 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:35.863527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88d5f8-bdfb-4ac2-9c41-7cf81c206e79 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:35.868102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0539db1-bebc-486b-ba90-749b7a53c50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:35.869369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0539db1-bebc-486b-ba90-749b7a53c50e admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:35.869649 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0539db1-bebc-486b-ba90-749b7a53c50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:35.869920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0539db1-bebc-486b-ba90-749b7a53c50e admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:35.870635 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0539db1-bebc-486b-ba90-749b7a53c50e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:35.872521 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0539db1-bebc-486b-ba90-749b7a53c50e admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:35.900699 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1323/2656] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:49:35 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:35.901937 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64545937-2f71-460f-aedc-91bf145551b4 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:35.911911 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64545937-2f71-460f-aedc-91bf145551b4 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:35.968023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d71b3-5046-45e3-b26a-76f3a9d5cfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:35.969144 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d71b3-5046-45e3-b26a-76f3a9d5cfd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:35.969438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d71b3-5046-45e3-b26a-76f3a9d5cfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:35.969717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d71b3-5046-45e3-b26a-76f3a9d5cfd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:35.970456 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d71b3-5046-45e3-b26a-76f3a9d5cfd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:35.972421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d71b3-5046-45e3-b26a-76f3a9d5cfd0 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:35.994199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1334/2657] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:49:35 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:35.998613 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0539db1-bebc-486b-ba90-749b7a53c50e admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:36.008823 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0539db1-bebc-486b-ba90-749b7a53c50e admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:36.013453 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d59ec7-bac5-4309-8ba5-9fabbf64975a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:36.014109 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d59ec7-bac5-4309-8ba5-9fabbf64975a admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:36.014423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d59ec7-bac5-4309-8ba5-9fabbf64975a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:36.014704 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d59ec7-bac5-4309-8ba5-9fabbf64975a admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:36.015424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d59ec7-bac5-4309-8ba5-9fabbf64975a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:36.017014 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d59ec7-bac5-4309-8ba5-9fabbf64975a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:36.027698 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1324/2658] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:36.031527 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d71b3-5046-45e3-b26a-76f3a9d5cfd0 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:36.041988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d71b3-5046-45e3-b26a-76f3a9d5cfd0 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:36.046611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e32796-e5dc-4319-8a20-c58c6855f7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:36.047284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e32796-e5dc-4319-8a20-c58c6855f7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:36.047566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e32796-e5dc-4319-8a20-c58c6855f7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:36.047863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e32796-e5dc-4319-8a20-c58c6855f7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:36.048573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e32796-e5dc-4319-8a20-c58c6855f7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:36.050146 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e32796-e5dc-4319-8a20-c58c6855f7f2 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:36.061693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1335/2659] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:36.065719 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d59ec7-bac5-4309-8ba5-9fabbf64975a admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:36.075709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d59ec7-bac5-4309-8ba5-9fabbf64975a admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:36.080654 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f51e5-a9c2-457d-9756-75c2ba6dad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:36.081803 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f51e5-a9c2-457d-9756-75c2ba6dad0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:36.082083 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f51e5-a9c2-457d-9756-75c2ba6dad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:36.082389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f51e5-a9c2-457d-9756-75c2ba6dad0c admin admin] PATH_INFO: `/v3/projects/7c02b6eb035541b5b6cc9cb67eab763b/users/676443298d7942d9a2511aaa76de4000/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:36.097324 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f51e5-a9c2-457d-9756-75c2ba6dad0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c02b6eb035541b5b6cc9cb67eab763b, user_id=676443298d7942d9a2511aaa76de4000, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:36.099993 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f51e5-a9c2-457d-9756-75c2ba6dad0c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:36.112977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1325/2660] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:36 2022] PUT /identity/v3/projects/7c02b6eb035541b5b6cc9cb67eab763b/users/676443298d7942d9a2511aaa76de4000/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:36.123931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6c0f5-0218-4b7b-beb4-ab4bdc4d642a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:36.124240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6c0f5-0218-4b7b-beb4-ab4bdc4d642a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:36.124516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6c0f5-0218-4b7b-beb4-ab4bdc4d642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:36.150044 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-66d6c0f5-0218-4b7b-beb4-ab4bdc4d642a None None] MFA Rules not processed for user `676443298d7942d9a2511aaa76de4000`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:36.151392 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-66d6c0f5-0218-4b7b-beb4-ab4bdc4d642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:36.213341 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1336/2661] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:36.223934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f51e5-a9c2-457d-9756-75c2ba6dad0c admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:36.225616 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7c0f51e5-a9c2-457d-9756-75c2ba6dad0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:36.280822 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f51e5-a9c2-457d-9756-75c2ba6dad0c admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:36.284485 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452763f4-49ab-43d7-907c-35ce6929e761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:36.285127 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452763f4-49ab-43d7-907c-35ce6929e761 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:36.285410 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452763f4-49ab-43d7-907c-35ce6929e761 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:36.285688 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452763f4-49ab-43d7-907c-35ce6929e761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:36.294291 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452763f4-49ab-43d7-907c-35ce6929e761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:36.295726 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452763f4-49ab-43d7-907c-35ce6929e761 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:36.304457 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1326/2662] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:39.271537 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6c0f5-0218-4b7b-beb4-ab4bdc4d642a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:39.333593 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6c0f5-0218-4b7b-beb4-ab4bdc4d642a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:39.338709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09606d-14da-4423-87fe-902052e0fabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:39.339587 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09606d-14da-4423-87fe-902052e0fabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:39.339866 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09606d-14da-4423-87fe-902052e0fabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:39.340137 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09606d-14da-4423-87fe-902052e0fabe admin admin] PATH_INFO: `/v3/users/676443298d7942d9a2511aaa76de4000` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:39.341301 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09606d-14da-4423-87fe-902052e0fabe admin admin] RBAC: Authorizing `identity:delete_user(user_id=676443298d7942d9a2511aaa76de4000)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:39.343212 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09606d-14da-4423-87fe-902052e0fabe admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:39.390693 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-bd09606d-14da-4423-87fe-902052e0fabe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '676443298d7942d9a2511aaa76de4000'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:39.397181 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-bd09606d-14da-4423-87fe-902052e0fabe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '676443298d7942d9a2511aaa76de4000'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:39.397843 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-bd09606d-14da-4423-87fe-902052e0fabe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '676443298d7942d9a2511aaa76de4000'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:39.398465 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-bd09606d-14da-4423-87fe-902052e0fabe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '676443298d7942d9a2511aaa76de4000'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:39.409957 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-bd09606d-14da-4423-87fe-902052e0fabe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '676443298d7942d9a2511aaa76de4000'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:39.423204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1337/2663] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:39 2022] DELETE /identity/v3/users/676443298d7942d9a2511aaa76de4000 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:39.427731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984cfc8-ee1c-42ee-807f-844b10f1f040 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:39.428220 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984cfc8-ee1c-42ee-807f-844b10f1f040 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:39.428452 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984cfc8-ee1c-42ee-807f-844b10f1f040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:39.445840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-1984cfc8-ee1c-42ee-807f-844b10f1f040 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:39.447131 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-1984cfc8-ee1c-42ee-807f-844b10f1f040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:39.515139 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1327/2664] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:39.516943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09606d-14da-4423-87fe-902052e0fabe admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:39.518371 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-bd09606d-14da-4423-87fe-902052e0fabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:39.574839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09606d-14da-4423-87fe-902052e0fabe admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:39.578491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e022ab2-2326-49dd-b1f0-7e9260149a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:39.579132 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e022ab2-2326-49dd-b1f0-7e9260149a44 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:39.579416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e022ab2-2326-49dd-b1f0-7e9260149a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:39.579805 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e022ab2-2326-49dd-b1f0-7e9260149a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:39.593153 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e022ab2-2326-49dd-b1f0-7e9260149a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:39.594617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e022ab2-2326-49dd-b1f0-7e9260149a44 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:39.604362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1338/2665] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:39.856508 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984cfc8-ee1c-42ee-807f-844b10f1f040 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:39.857970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-1984cfc8-ee1c-42ee-807f-844b10f1f040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:39.872007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984cfc8-ee1c-42ee-807f-844b10f1f040 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:39.877704 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab1705-919b-437d-970d-654be9c09143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:39.879326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab1705-919b-437d-970d-654be9c09143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:39.879633 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab1705-919b-437d-970d-654be9c09143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:39.879913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab1705-919b-437d-970d-654be9c09143 admin admin] PATH_INFO: `/v3/projects/7c02b6eb035541b5b6cc9cb67eab763b` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:39.881128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab1705-919b-437d-970d-654be9c09143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c02b6eb035541b5b6cc9cb67eab763b)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:39.883139 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab1705-919b-437d-970d-654be9c09143 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:39.929156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-3fab1705-919b-437d-970d-654be9c09143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c02b6eb035541b5b6cc9cb67eab763b', 'request_id': 'req-3fab1705-919b-437d-970d-654be9c09143'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:39.934436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-3fab1705-919b-437d-970d-654be9c09143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c02b6eb035541b5b6cc9cb67eab763b', 'request_id': 'req-3fab1705-919b-437d-970d-654be9c09143'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:39.940278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-3fab1705-919b-437d-970d-654be9c09143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c02b6eb035541b5b6cc9cb67eab763b', 'request_id': 'req-3fab1705-919b-437d-970d-654be9c09143'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:39.951888 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-3fab1705-919b-437d-970d-654be9c09143 admin admin] The token cache is being invalidate because project 7c02b6eb035541b5b6cc9cb67eab763b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:39.952169 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-3fab1705-919b-437d-970d-654be9c09143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:39.952775 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-3fab1705-919b-437d-970d-654be9c09143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:39.954317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1328/2666] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:39 2022] DELETE /identity/v3/projects/7c02b6eb035541b5b6cc9cb67eab763b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:39.959581 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ff41c-9c0f-4420-91d9-b20af468ad77 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:39.959869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ff41c-9c0f-4420-91d9-b20af468ad77 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:39.960148 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ff41c-9c0f-4420-91d9-b20af468ad77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:39.977974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b11ff41c-9c0f-4420-91d9-b20af468ad77 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:39.979790 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b11ff41c-9c0f-4420-91d9-b20af468ad77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:40.035477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1339/2667] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:40.043421 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c9b06-4bd2-4a77-aa8e-d84450722d2c None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.043716 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c9b06-4bd2-4a77-aa8e-d84450722d2c None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.043999 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c9b06-4bd2-4a77-aa8e-d84450722d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.062339 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-c09c9b06-4bd2-4a77-aa8e-d84450722d2c None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:40.063530 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c09c9b06-4bd2-4a77-aa8e-d84450722d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:40.071470 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1329/2668] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:40.076174 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ff41c-9c0f-4420-91d9-b20af468ad77 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:40.085723 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ff41c-9c0f-4420-91d9-b20af468ad77 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:40.091178 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e3ccd-04f7-4a16-9282-594bfceec430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:40.091838 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e3ccd-04f7-4a16-9282-594bfceec430 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.092118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e3ccd-04f7-4a16-9282-594bfceec430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.092515 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e3ccd-04f7-4a16-9282-594bfceec430 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.093245 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e3ccd-04f7-4a16-9282-594bfceec430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:49:40.093551 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e3ccd-04f7-4a16-9282-594bfceec430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:40.095519 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e3ccd-04f7-4a16-9282-594bfceec430 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:40.107629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1340/2669] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:49:40.111919 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c9b06-4bd2-4a77-aa8e-d84450722d2c None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:40.121704 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c9b06-4bd2-4a77-aa8e-d84450722d2c None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:40.126385 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba4683-2fc3-4278-a30d-8d27a770e1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:40.126965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba4683-2fc3-4278-a30d-8d27a770e1cd admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.127250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba4683-2fc3-4278-a30d-8d27a770e1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.127527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba4683-2fc3-4278-a30d-8d27a770e1cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.128217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba4683-2fc3-4278-a30d-8d27a770e1cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:40.130106 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba4683-2fc3-4278-a30d-8d27a770e1cd admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:40.154804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1330/2670] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:49:40 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:40.158886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e3ccd-04f7-4a16-9282-594bfceec430 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:40.169190 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e3ccd-04f7-4a16-9282-594bfceec430 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:40.225748 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653e688-4a0a-4f42-999f-822cfdb8a6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:40.226444 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653e688-4a0a-4f42-999f-822cfdb8a6ed admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.226725 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653e688-4a0a-4f42-999f-822cfdb8a6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.226997 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653e688-4a0a-4f42-999f-822cfdb8a6ed admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.227698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653e688-4a0a-4f42-999f-822cfdb8a6ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:40.230328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653e688-4a0a-4f42-999f-822cfdb8a6ed admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:40.251330 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1341/2671] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:49:40 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:49:40.255398 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba4683-2fc3-4278-a30d-8d27a770e1cd admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:40.265389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba4683-2fc3-4278-a30d-8d27a770e1cd admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:40.269834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892b5f-32d6-4265-b026-c62c1fc560af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:40.270511 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892b5f-32d6-4265-b026-c62c1fc560af admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.270790 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892b5f-32d6-4265-b026-c62c1fc560af admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.271063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892b5f-32d6-4265-b026-c62c1fc560af admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.271773 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4892b5f-32d6-4265-b026-c62c1fc560af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:40.273338 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4892b5f-32d6-4265-b026-c62c1fc560af admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:40.283413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1331/2672] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:40.287291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653e688-4a0a-4f42-999f-822cfdb8a6ed admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:40.298008 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653e688-4a0a-4f42-999f-822cfdb8a6ed admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:40.302628 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387da4ed-da44-4d87-9af4-35585bc10839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:40.303272 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387da4ed-da44-4d87-9af4-35585bc10839 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.303558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387da4ed-da44-4d87-9af4-35585bc10839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.303832 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387da4ed-da44-4d87-9af4-35585bc10839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.304545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387da4ed-da44-4d87-9af4-35585bc10839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:40.306125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387da4ed-da44-4d87-9af4-35585bc10839 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:40.316910 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1342/2673] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:40.320853 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892b5f-32d6-4265-b026-c62c1fc560af admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:40.330846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892b5f-32d6-4265-b026-c62c1fc560af admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:40.335706 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76804796-b346-4941-96cf-03b85eaf8832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:40.336570 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76804796-b346-4941-96cf-03b85eaf8832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.336853 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76804796-b346-4941-96cf-03b85eaf8832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.337129 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76804796-b346-4941-96cf-03b85eaf8832 admin admin] PATH_INFO: `/v3/projects/63cbcfd1628347f599e143eb79e5593f/users/7a809c0a2fcb4888ad0fb707eeed63e5/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.351265 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76804796-b346-4941-96cf-03b85eaf8832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cbcfd1628347f599e143eb79e5593f, user_id=7a809c0a2fcb4888ad0fb707eeed63e5, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:40.354724 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76804796-b346-4941-96cf-03b85eaf8832 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:40.366764 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1332/2674] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:40 2022] PUT /identity/v3/projects/63cbcfd1628347f599e143eb79e5593f/users/7a809c0a2fcb4888ad0fb707eeed63e5/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:40.377846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccb2f0-c028-404e-a2c1-c2fc95240d78 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.378075 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccb2f0-c028-404e-a2c1-c2fc95240d78 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.378483 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccb2f0-c028-404e-a2c1-c2fc95240d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.404415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d3ccb2f0-c028-404e-a2c1-c2fc95240d78 None None] MFA Rules not processed for user `7a809c0a2fcb4888ad0fb707eeed63e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:40.405619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d3ccb2f0-c028-404e-a2c1-c2fc95240d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:40.469832 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1343/2675] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:40.475585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76804796-b346-4941-96cf-03b85eaf8832 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:40.537945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76804796-b346-4941-96cf-03b85eaf8832 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:40.542978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9368fb-7464-4678-bd62-e53e1d7d2f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:40.543766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9368fb-7464-4678-bd62-e53e1d7d2f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.544051 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9368fb-7464-4678-bd62-e53e1d7d2f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.544332 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9368fb-7464-4678-bd62-e53e1d7d2f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.545087 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9368fb-7464-4678-bd62-e53e1d7d2f0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:40.547048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9368fb-7464-4678-bd62-e53e1d7d2f0b admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:40.577452 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1333/2676] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:49:40 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:49:40.581927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccb2f0-c028-404e-a2c1-c2fc95240d78 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:40.593867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccb2f0-c028-404e-a2c1-c2fc95240d78 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:40.614684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99419d9-2116-4243-8bf9-75df4f8f75ee None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.615178 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99419d9-2116-4243-8bf9-75df4f8f75ee None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.615860 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99419d9-2116-4243-8bf9-75df4f8f75ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.635876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-d99419d9-2116-4243-8bf9-75df4f8f75ee None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:40.637217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d99419d9-2116-4243-8bf9-75df4f8f75ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:40.660502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185d490-d73f-4626-a31d-96234ca284ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:40.661195 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185d490-d73f-4626-a31d-96234ca284ca admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.661461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185d490-d73f-4626-a31d-96234ca284ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.661825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185d490-d73f-4626-a31d-96234ca284ca admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.662560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185d490-d73f-4626-a31d-96234ca284ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:40.664466 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185d490-d73f-4626-a31d-96234ca284ca admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:40.690448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1344/2677] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:49:40 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:40.692771 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185d490-d73f-4626-a31d-96234ca284ca admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:40.697916 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1334/2678] 10.222.0.58 () {58 vars in 967 bytes} [Thu May 5 15:49:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:49:40.703236 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185d490-d73f-4626-a31d-96234ca284ca admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:40.708074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f8ec7-4913-40f1-a8b5-be0760bf84a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:40.708728 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f8ec7-4913-40f1-a8b5-be0760bf84a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.709008 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f8ec7-4913-40f1-a8b5-be0760bf84a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.709284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f8ec7-4913-40f1-a8b5-be0760bf84a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.710146 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f8ec7-4913-40f1-a8b5-be0760bf84a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:40.711323 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99419d9-2116-4243-8bf9-75df4f8f75ee None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:40.711776 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f8ec7-4913-40f1-a8b5-be0760bf84a5 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:40.712669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d99419d9-2116-4243-8bf9-75df4f8f75ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:40.723191 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1345/2679] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:49:40.726771 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f8ec7-4913-40f1-a8b5-be0760bf84a5 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:40.736099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f8ec7-4913-40f1-a8b5-be0760bf84a5 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:40.741472 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725f7f9-475d-491e-9414-4193fe510d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:40.742118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725f7f9-475d-491e-9414-4193fe510d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.742430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725f7f9-475d-491e-9414-4193fe510d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.742703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725f7f9-475d-491e-9414-4193fe510d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.743410 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725f7f9-475d-491e-9414-4193fe510d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:40.745535 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725f7f9-475d-491e-9414-4193fe510d2b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:40.755998 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1346/2680] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:49:40.760608 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725f7f9-475d-491e-9414-4193fe510d2b admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:40.769891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725f7f9-475d-491e-9414-4193fe510d2b admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:40.774419 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215dfa9-d486-4979-8dfc-434596b0edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:40.775269 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215dfa9-d486-4979-8dfc-434596b0edd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.776275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215dfa9-d486-4979-8dfc-434596b0edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.776553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215dfa9-d486-4979-8dfc-434596b0edd3 admin admin] PATH_INFO: `/v3/projects/7cefe112b3d7496fb4a1f48a85b71bcb/users/e7c2a8dfbe3f4834acb83e9a0ebf2490/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.780243 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99419d9-2116-4243-8bf9-75df4f8f75ee None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:40.785380 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f060a5-b0e6-4556-8563-fa75cc6193f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:40.786049 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f060a5-b0e6-4556-8563-fa75cc6193f8 service swift] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.786428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f060a5-b0e6-4556-8563-fa75cc6193f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.786700 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f060a5-b0e6-4556-8563-fa75cc6193f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.792461 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215dfa9-d486-4979-8dfc-434596b0edd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cefe112b3d7496fb4a1f48a85b71bcb, user_id=e7c2a8dfbe3f4834acb83e9a0ebf2490, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:40.795322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215dfa9-d486-4979-8dfc-434596b0edd3 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:40.795656 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f060a5-b0e6-4556-8563-fa75cc6193f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:40.797210 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f060a5-b0e6-4556-8563-fa75cc6193f8 service swift] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:40.805843 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1335/2681] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:49:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 05 15:49:40.808848 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1347/2682] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:40 2022] PUT /identity/v3/projects/7cefe112b3d7496fb4a1f48a85b71bcb/users/e7c2a8dfbe3f4834acb83e9a0ebf2490/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:49:40.819028 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6a442-f997-4177-8e82-57ee972032b8 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.819371 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6a442-f997-4177-8e82-57ee972032b8 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.819986 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6a442-f997-4177-8e82-57ee972032b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.850126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-14c6a442-f997-4177-8e82-57ee972032b8 None None] MFA Rules not processed for user `e7c2a8dfbe3f4834acb83e9a0ebf2490`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:40.851428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-14c6a442-f997-4177-8e82-57ee972032b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:40.919857 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1336/2683] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:49:40.924194 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215dfa9-d486-4979-8dfc-434596b0edd3 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:40.989522 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215dfa9-d486-4979-8dfc-434596b0edd3 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:40.994110 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2a880-1f3e-4d13-a64d-a05db247c1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:40.994931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2a880-1f3e-4d13-a64d-a05db247c1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:40.995209 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2a880-1f3e-4d13-a64d-a05db247c1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:40.995478 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2a880-1f3e-4d13-a64d-a05db247c1f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:40.996173 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2a880-1f3e-4d13-a64d-a05db247c1f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:40.998046 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2a880-1f3e-4d13-a64d-a05db247c1f9 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:41.023306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1348/2684] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:49:40 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:41.028106 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6a442-f997-4177-8e82-57ee972032b8 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:41.039182 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6a442-f997-4177-8e82-57ee972032b8 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:41.099940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2abb2-b92c-43b9-ad0c-0f926aa57699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:41.100759 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2abb2-b92c-43b9-ad0c-0f926aa57699 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:41.101135 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2abb2-b92c-43b9-ad0c-0f926aa57699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:41.101506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2abb2-b92c-43b9-ad0c-0f926aa57699 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:41.102235 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2abb2-b92c-43b9-ad0c-0f926aa57699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:41.104717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2abb2-b92c-43b9-ad0c-0f926aa57699 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:41.127674 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1337/2685] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:49:41 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:41.129034 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2a880-1f3e-4d13-a64d-a05db247c1f9 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:41.139587 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2a880-1f3e-4d13-a64d-a05db247c1f9 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:41.144157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e18828-1dc9-48f5-8200-c762931beea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:41.144815 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e18828-1dc9-48f5-8200-c762931beea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:41.145093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e18828-1dc9-48f5-8200-c762931beea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:41.145365 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e18828-1dc9-48f5-8200-c762931beea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:41.146084 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e18828-1dc9-48f5-8200-c762931beea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:41.147810 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e18828-1dc9-48f5-8200-c762931beea8 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:41.158427 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1349/2686] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:41.162684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2abb2-b92c-43b9-ad0c-0f926aa57699 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:41.173468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2abb2-b92c-43b9-ad0c-0f926aa57699 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:41.178272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0f0c-7b2e-4a30-b614-6bdc6330a710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:41.179233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0f0c-7b2e-4a30-b614-6bdc6330a710 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:41.179612 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0f0c-7b2e-4a30-b614-6bdc6330a710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:41.180009 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0f0c-7b2e-4a30-b614-6bdc6330a710 admin admin] PATH_INFO: `/v3/projects/e263c6175ce44e878fc832e0adfe009b/users/5a8e22c4fb804db6af1239bfdd339e1b/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:41.195416 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe0f0c-7b2e-4a30-b614-6bdc6330a710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e263c6175ce44e878fc832e0adfe009b, user_id=5a8e22c4fb804db6af1239bfdd339e1b, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:41.198080 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe0f0c-7b2e-4a30-b614-6bdc6330a710 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:41.211302 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1338/2687] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:41 2022] PUT /identity/v3/projects/e263c6175ce44e878fc832e0adfe009b/users/5a8e22c4fb804db6af1239bfdd339e1b/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:49:41.215757 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e18828-1dc9-48f5-8200-c762931beea8 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:41.225611 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e18828-1dc9-48f5-8200-c762931beea8 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:41.282413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637b898-cb72-4ef5-9bcd-7cc8c869860f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:41.283297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637b898-cb72-4ef5-9bcd-7cc8c869860f admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:41.283620 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637b898-cb72-4ef5-9bcd-7cc8c869860f admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:41.284023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637b898-cb72-4ef5-9bcd-7cc8c869860f admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:41.284979 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637b898-cb72-4ef5-9bcd-7cc8c869860f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:41.286901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637b898-cb72-4ef5-9bcd-7cc8c869860f admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:41.301783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1350/2688] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:41.303048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0f0c-7b2e-4a30-b614-6bdc6330a710 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:41.314297 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0f0c-7b2e-4a30-b614-6bdc6330a710 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:41.318926 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dbed4-c52d-4565-8d75-03b7ba5eba8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:41.319791 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dbed4-c52d-4565-8d75-03b7ba5eba8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:41.320071 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dbed4-c52d-4565-8d75-03b7ba5eba8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:41.320341 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dbed4-c52d-4565-8d75-03b7ba5eba8c admin admin] PATH_INFO: `/v3/projects/e263c6175ce44e878fc832e0adfe009b/users/5a8e22c4fb804db6af1239bfdd339e1b/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:41.323057 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2dbed4-c52d-4565-8d75-03b7ba5eba8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e263c6175ce44e878fc832e0adfe009b, user_id=5a8e22c4fb804db6af1239bfdd339e1b, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:41.325979 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2dbed4-c52d-4565-8d75-03b7ba5eba8c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:41.337440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1339/2689] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:41 2022] PUT /identity/v3/projects/e263c6175ce44e878fc832e0adfe009b/users/5a8e22c4fb804db6af1239bfdd339e1b/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:41.347894 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809c185-6678-4e7f-b535-0d082139eb65 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:41.348184 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809c185-6678-4e7f-b535-0d082139eb65 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:41.348462 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809c185-6678-4e7f-b535-0d082139eb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:41.375775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f809c185-6678-4e7f-b535-0d082139eb65 None None] MFA Rules not processed for user `5a8e22c4fb804db6af1239bfdd339e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:41.376968 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f809c185-6678-4e7f-b535-0d082139eb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:41.443018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1351/2690] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:49:41.454728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dbed4-c52d-4565-8d75-03b7ba5eba8c admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:41.456683 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6c2dbed4-c52d-4565-8d75-03b7ba5eba8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:41.512468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dbed4-c52d-4565-8d75-03b7ba5eba8c admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:41.516097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52ea1c-0b54-4684-b6c8-bb38ddfbb121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:41.516739 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52ea1c-0b54-4684-b6c8-bb38ddfbb121 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:41.517021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52ea1c-0b54-4684-b6c8-bb38ddfbb121 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:41.517298 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52ea1c-0b54-4684-b6c8-bb38ddfbb121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:41.570632 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52ea1c-0b54-4684-b6c8-bb38ddfbb121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:41.572043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52ea1c-0b54-4684-b6c8-bb38ddfbb121 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:41.581482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1340/2691] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:43.052240 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809c185-6678-4e7f-b535-0d082139eb65 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:43.053607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f809c185-6678-4e7f-b535-0d082139eb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:43.065459 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809c185-6678-4e7f-b535-0d082139eb65 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:43.068994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d0d49-d5d8-4a8c-a478-12a648bea4d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:43.069622 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d0d49-d5d8-4a8c-a478-12a648bea4d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:43.069901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d0d49-d5d8-4a8c-a478-12a648bea4d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:43.070198 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d0d49-d5d8-4a8c-a478-12a648bea4d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:43.123688 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d0d49-d5d8-4a8c-a478-12a648bea4d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:43.125021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d0d49-d5d8-4a8c-a478-12a648bea4d6 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:43.133499 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1352/2692] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:43.632430 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52ea1c-0b54-4684-b6c8-bb38ddfbb121 service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:43.641943 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52ea1c-0b54-4684-b6c8-bb38ddfbb121 service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:43.645666 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacae82a-16ee-4c91-985c-7f9d74fe0f88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:43.646343 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacae82a-16ee-4c91-985c-7f9d74fe0f88 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:43.646628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacae82a-16ee-4c91-985c-7f9d74fe0f88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:43.646907 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacae82a-16ee-4c91-985c-7f9d74fe0f88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:43.656264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacae82a-16ee-4c91-985c-7f9d74fe0f88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:43.657680 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacae82a-16ee-4c91-985c-7f9d74fe0f88 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:43.667581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1341/2693] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:47.483830 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d0d49-d5d8-4a8c-a478-12a648bea4d6 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:47.544930 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d0d49-d5d8-4a8c-a478-12a648bea4d6 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:47.549547 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473c094-77d2-4b5f-a70a-5334e01b7212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:47.550443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473c094-77d2-4b5f-a70a-5334e01b7212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:47.550729 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473c094-77d2-4b5f-a70a-5334e01b7212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:47.551003 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473c094-77d2-4b5f-a70a-5334e01b7212 admin admin] PATH_INFO: `/v3/users/7a809c0a2fcb4888ad0fb707eeed63e5` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:47.552182 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473c094-77d2-4b5f-a70a-5334e01b7212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a809c0a2fcb4888ad0fb707eeed63e5)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:47.554079 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473c094-77d2-4b5f-a70a-5334e01b7212 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:47.599447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3473c094-77d2-4b5f-a70a-5334e01b7212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a809c0a2fcb4888ad0fb707eeed63e5'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:47.606738 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3473c094-77d2-4b5f-a70a-5334e01b7212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a809c0a2fcb4888ad0fb707eeed63e5'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:47.607409 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3473c094-77d2-4b5f-a70a-5334e01b7212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a809c0a2fcb4888ad0fb707eeed63e5'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:47.608015 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3473c094-77d2-4b5f-a70a-5334e01b7212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a809c0a2fcb4888ad0fb707eeed63e5'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:47.619015 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3473c094-77d2-4b5f-a70a-5334e01b7212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a809c0a2fcb4888ad0fb707eeed63e5'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:47.630889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1353/2694] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:47 2022] DELETE /identity/v3/users/7a809c0a2fcb4888ad0fb707eeed63e5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:47.635996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194eb21-58a8-41e4-8991-940d27208757 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:47.636473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194eb21-58a8-41e4-8991-940d27208757 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:47.636570 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194eb21-58a8-41e4-8991-940d27208757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:47.653607 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-1194eb21-58a8-41e4-8991-940d27208757 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:47.654825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-1194eb21-58a8-41e4-8991-940d27208757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:47.712458 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1342/2695] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:47.722664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473c094-77d2-4b5f-a70a-5334e01b7212 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:47.724100 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3473c094-77d2-4b5f-a70a-5334e01b7212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:47.780111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473c094-77d2-4b5f-a70a-5334e01b7212 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:47.784033 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ca62a-0804-4869-bf61-c7714db51ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:47.784702 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ca62a-0804-4869-bf61-c7714db51ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:47.784980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ca62a-0804-4869-bf61-c7714db51ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:47.785255 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ca62a-0804-4869-bf61-c7714db51ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:47.794388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ca62a-0804-4869-bf61-c7714db51ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:47.795804 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ca62a-0804-4869-bf61-c7714db51ad2 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:47.804891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1354/2696] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:48.077178 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194eb21-58a8-41e4-8991-940d27208757 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:48.078623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-1194eb21-58a8-41e4-8991-940d27208757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:48.091420 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194eb21-58a8-41e4-8991-940d27208757 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:48.095959 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d50345-51c5-4a99-bb9e-341cca668d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:48.096815 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d50345-51c5-4a99-bb9e-341cca668d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:48.097095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d50345-51c5-4a99-bb9e-341cca668d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:48.097367 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d50345-51c5-4a99-bb9e-341cca668d17 admin admin] PATH_INFO: `/v3/projects/63cbcfd1628347f599e143eb79e5593f` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:48.098585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d50345-51c5-4a99-bb9e-341cca668d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cbcfd1628347f599e143eb79e5593f)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:48.100475 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d50345-51c5-4a99-bb9e-341cca668d17 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:48.147623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-50d50345-51c5-4a99-bb9e-341cca668d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cbcfd1628347f599e143eb79e5593f', 'request_id': 'req-50d50345-51c5-4a99-bb9e-341cca668d17'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.152784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-50d50345-51c5-4a99-bb9e-341cca668d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cbcfd1628347f599e143eb79e5593f', 'request_id': 'req-50d50345-51c5-4a99-bb9e-341cca668d17'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.158721 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-50d50345-51c5-4a99-bb9e-341cca668d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cbcfd1628347f599e143eb79e5593f', 'request_id': 'req-50d50345-51c5-4a99-bb9e-341cca668d17'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.171148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-50d50345-51c5-4a99-bb9e-341cca668d17 admin admin] The token cache is being invalidate because project 63cbcfd1628347f599e143eb79e5593f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:48.171456 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-50d50345-51c5-4a99-bb9e-341cca668d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.172198 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-50d50345-51c5-4a99-bb9e-341cca668d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.173883 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1343/2697] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:48 2022] DELETE /identity/v3/projects/63cbcfd1628347f599e143eb79e5593f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:48.178113 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ca62a-0804-4869-bf61-c7714db51ad2 service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:48.188809 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ca62a-0804-4869-bf61-c7714db51ad2 service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:48.241907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba73b9-6a04-4aa6-a59f-12f15599bb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:48.242720 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba73b9-6a04-4aa6-a59f-12f15599bb63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:48.243002 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba73b9-6a04-4aa6-a59f-12f15599bb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:48.243274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba73b9-6a04-4aa6-a59f-12f15599bb63 admin admin] PATH_INFO: `/v3/users/e7c2a8dfbe3f4834acb83e9a0ebf2490` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:48.244974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba73b9-6a04-4aa6-a59f-12f15599bb63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c2a8dfbe3f4834acb83e9a0ebf2490)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:48.246886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba73b9-6a04-4aa6-a59f-12f15599bb63 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:48.290534 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b9ba73b9-6a04-4aa6-a59f-12f15599bb63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c2a8dfbe3f4834acb83e9a0ebf2490'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.297213 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b9ba73b9-6a04-4aa6-a59f-12f15599bb63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c2a8dfbe3f4834acb83e9a0ebf2490'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.297856 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b9ba73b9-6a04-4aa6-a59f-12f15599bb63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c2a8dfbe3f4834acb83e9a0ebf2490'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.298468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b9ba73b9-6a04-4aa6-a59f-12f15599bb63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c2a8dfbe3f4834acb83e9a0ebf2490'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.310662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b9ba73b9-6a04-4aa6-a59f-12f15599bb63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c2a8dfbe3f4834acb83e9a0ebf2490'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.324130 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1355/2698] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:48 2022] DELETE /identity/v3/users/e7c2a8dfbe3f4834acb83e9a0ebf2490 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:48.597953 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d50345-51c5-4a99-bb9e-341cca668d17 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:48.599546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-50d50345-51c5-4a99-bb9e-341cca668d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:48.615903 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d50345-51c5-4a99-bb9e-341cca668d17 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:48.672701 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:48.673588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:48.673867 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:48.674139 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72 admin admin] PATH_INFO: `/v3/projects/7cefe112b3d7496fb4a1f48a85b71bcb` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:48.675327 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cefe112b3d7496fb4a1f48a85b71bcb)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:48.677200 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:48.723824 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cefe112b3d7496fb4a1f48a85b71bcb', 'request_id': 'req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.729990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cefe112b3d7496fb4a1f48a85b71bcb', 'request_id': 'req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.735794 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cefe112b3d7496fb4a1f48a85b71bcb', 'request_id': 'req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.748886 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72 admin admin] The token cache is being invalidate because project 7cefe112b3d7496fb4a1f48a85b71bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:48.749200 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.749859 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.751500 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1344/2699] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:48 2022] DELETE /identity/v3/projects/7cefe112b3d7496fb4a1f48a85b71bcb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:48.755575 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba73b9-6a04-4aa6-a59f-12f15599bb63 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:48.756980 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b9ba73b9-6a04-4aa6-a59f-12f15599bb63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:48.769552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba73b9-6a04-4aa6-a59f-12f15599bb63 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:48.825675 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ff876-e220-4760-97d0-c6894f7d774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:48.826573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ff876-e220-4760-97d0-c6894f7d774d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:48.826856 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ff876-e220-4760-97d0-c6894f7d774d admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:48.827135 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ff876-e220-4760-97d0-c6894f7d774d admin admin] PATH_INFO: `/v3/users/5a8e22c4fb804db6af1239bfdd339e1b` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:48.828385 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ff876-e220-4760-97d0-c6894f7d774d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a8e22c4fb804db6af1239bfdd339e1b)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:48.830313 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ff876-e220-4760-97d0-c6894f7d774d admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:48.874015 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7a9ff876-e220-4760-97d0-c6894f7d774d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a8e22c4fb804db6af1239bfdd339e1b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.880668 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7a9ff876-e220-4760-97d0-c6894f7d774d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a8e22c4fb804db6af1239bfdd339e1b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.881353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7a9ff876-e220-4760-97d0-c6894f7d774d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a8e22c4fb804db6af1239bfdd339e1b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.881957 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7a9ff876-e220-4760-97d0-c6894f7d774d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a8e22c4fb804db6af1239bfdd339e1b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.893349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-7a9ff876-e220-4760-97d0-c6894f7d774d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a8e22c4fb804db6af1239bfdd339e1b'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:48.905307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1356/2700] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:49:48 2022] DELETE /identity/v3/users/5a8e22c4fb804db6af1239bfdd339e1b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:49.171173 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:49.172675 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:49.186277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f6b30-e8e6-4a9d-972a-4c98f96a1d72 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:49.242618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf366e4-ee16-4828-9d8e-25997e71e75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:49.243468 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf366e4-ee16-4828-9d8e-25997e71e75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:49.243889 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf366e4-ee16-4828-9d8e-25997e71e75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:49.244174 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf366e4-ee16-4828-9d8e-25997e71e75a admin admin] PATH_INFO: `/v3/projects/e263c6175ce44e878fc832e0adfe009b` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:49.245405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf366e4-ee16-4828-9d8e-25997e71e75a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e263c6175ce44e878fc832e0adfe009b)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:49.247317 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf366e4-ee16-4828-9d8e-25997e71e75a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:49.292393 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-eaf366e4-ee16-4828-9d8e-25997e71e75a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e263c6175ce44e878fc832e0adfe009b', 'request_id': 'req-eaf366e4-ee16-4828-9d8e-25997e71e75a'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:49.297483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-eaf366e4-ee16-4828-9d8e-25997e71e75a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e263c6175ce44e878fc832e0adfe009b', 'request_id': 'req-eaf366e4-ee16-4828-9d8e-25997e71e75a'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:49.303319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-eaf366e4-ee16-4828-9d8e-25997e71e75a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e263c6175ce44e878fc832e0adfe009b', 'request_id': 'req-eaf366e4-ee16-4828-9d8e-25997e71e75a'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:49.315199 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-eaf366e4-ee16-4828-9d8e-25997e71e75a admin admin] The token cache is being invalidate because project e263c6175ce44e878fc832e0adfe009b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:49:49.315479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-eaf366e4-ee16-4828-9d8e-25997e71e75a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:49.316110 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-eaf366e4-ee16-4828-9d8e-25997e71e75a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:49:49.317619 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1345/2701] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:49:49 2022] DELETE /identity/v3/projects/e263c6175ce44e878fc832e0adfe009b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:49.323297 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150e33e-a6df-4982-9e53-0d2f1b1dadd1 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:49.323579 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150e33e-a6df-4982-9e53-0d2f1b1dadd1 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:49.323853 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150e33e-a6df-4982-9e53-0d2f1b1dadd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:49.341247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a150e33e-a6df-4982-9e53-0d2f1b1dadd1 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:49.342486 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a150e33e-a6df-4982-9e53-0d2f1b1dadd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:49.400781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1357/2702] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:49.463580 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bbf4b-3fad-4276-8e35-67483e0c7d4f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:49.463849 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bbf4b-3fad-4276-8e35-67483e0c7d4f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:49.464123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bbf4b-3fad-4276-8e35-67483e0c7d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:49.482367 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-000bbf4b-3fad-4276-8e35-67483e0c7d4f None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:49.483934 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-000bbf4b-3fad-4276-8e35-67483e0c7d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:49.491702 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1346/2703] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:49.496814 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150e33e-a6df-4982-9e53-0d2f1b1dadd1 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:49.506310 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150e33e-a6df-4982-9e53-0d2f1b1dadd1 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:49.511242 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd36ce7-c55b-45a0-985f-87d77e8c705e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:49.511945 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd36ce7-c55b-45a0-985f-87d77e8c705e admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:49.512162 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd36ce7-c55b-45a0-985f-87d77e8c705e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:49.512434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd36ce7-c55b-45a0-985f-87d77e8c705e admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:49.513157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd36ce7-c55b-45a0-985f-87d77e8c705e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:49:49.513460 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd36ce7-c55b-45a0-985f-87d77e8c705e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:49.515065 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd36ce7-c55b-45a0-985f-87d77e8c705e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:49.527250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1358/2704] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:49:49.531590 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bbf4b-3fad-4276-8e35-67483e0c7d4f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:49.541118 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bbf4b-3fad-4276-8e35-67483e0c7d4f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:49.545747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650b233-2056-4055-910a-602ad449e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:49.546363 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650b233-2056-4055-910a-602ad449e789 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:49.546642 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650b233-2056-4055-910a-602ad449e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:49.546917 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650b233-2056-4055-910a-602ad449e789 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:49.547598 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650b233-2056-4055-910a-602ad449e789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:49.549466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650b233-2056-4055-910a-602ad449e789 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:49.573476 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1347/2705] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:49:49 2022] POST /identity/v3/projects => generated 365 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:49.577598 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd36ce7-c55b-45a0-985f-87d77e8c705e admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:49.588645 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd36ce7-c55b-45a0-985f-87d77e8c705e admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:49.642288 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87488352-9e2d-4d64-b4c8-5206f8b3ca9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:49.642959 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87488352-9e2d-4d64-b4c8-5206f8b3ca9f admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:49.643243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87488352-9e2d-4d64-b4c8-5206f8b3ca9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:49.643520 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87488352-9e2d-4d64-b4c8-5206f8b3ca9f admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:49.644199 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87488352-9e2d-4d64-b4c8-5206f8b3ca9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:49.646104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87488352-9e2d-4d64-b4c8-5206f8b3ca9f admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:49.666877 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1359/2706] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:49:49 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:49:49.671188 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650b233-2056-4055-910a-602ad449e789 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:49.681264 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650b233-2056-4055-910a-602ad449e789 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:49.685904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be88ba5-c605-4c60-b4aa-e6f4311a5ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:49.686602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be88ba5-c605-4c60-b4aa-e6f4311a5ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:49.686884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be88ba5-c605-4c60-b4aa-e6f4311a5ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:49.687156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be88ba5-c605-4c60-b4aa-e6f4311a5ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:49.687868 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be88ba5-c605-4c60-b4aa-e6f4311a5ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:49.689451 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be88ba5-c605-4c60-b4aa-e6f4311a5ba6 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:49.699479 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1348/2707] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:49.703615 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87488352-9e2d-4d64-b4c8-5206f8b3ca9f admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:49.714438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87488352-9e2d-4d64-b4c8-5206f8b3ca9f admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:49.718946 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf3942-17ad-467f-a877-2e2a6aba4012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:49.719594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf3942-17ad-467f-a877-2e2a6aba4012 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:49.719875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf3942-17ad-467f-a877-2e2a6aba4012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:49.720176 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf3942-17ad-467f-a877-2e2a6aba4012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:49.720885 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf3942-17ad-467f-a877-2e2a6aba4012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:49.722494 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf3942-17ad-467f-a877-2e2a6aba4012 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:49.733854 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1360/2708] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:49:49.737817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be88ba5-c605-4c60-b4aa-e6f4311a5ba6 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:49.747521 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be88ba5-c605-4c60-b4aa-e6f4311a5ba6 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:49.752045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e793c-e291-4691-b2f7-57441721f315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:49.752901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e793c-e291-4691-b2f7-57441721f315 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:49.753176 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e793c-e291-4691-b2f7-57441721f315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:49.753446 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e793c-e291-4691-b2f7-57441721f315 admin admin] PATH_INFO: `/v3/projects/141aea7a5f36436ca1b11c108ad776d6/users/ed2b7731b26345f79781413318c16928/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:49.773776 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e793c-e291-4691-b2f7-57441721f315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141aea7a5f36436ca1b11c108ad776d6, user_id=ed2b7731b26345f79781413318c16928, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:49.777156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e793c-e291-4691-b2f7-57441721f315 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:49.789556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1349/2709] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:49:49 2022] PUT /identity/v3/projects/141aea7a5f36436ca1b11c108ad776d6/users/ed2b7731b26345f79781413318c16928/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:49:49.800081 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ee813-f6e8-452a-bf4b-62f3a2aaa953 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:49.800555 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ee813-f6e8-452a-bf4b-62f3a2aaa953 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:49.800666 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ee813-f6e8-452a-bf4b-62f3a2aaa953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:49.826702 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a01ee813-f6e8-452a-bf4b-62f3a2aaa953 None None] MFA Rules not processed for user `ed2b7731b26345f79781413318c16928`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:49:49.827907 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a01ee813-f6e8-452a-bf4b-62f3a2aaa953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:49.893056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1361/2710] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:49:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:49:49.905901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e793c-e291-4691-b2f7-57441721f315 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:49.908910 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-266e793c-e291-4691-b2f7-57441721f315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:49.979871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e793c-e291-4691-b2f7-57441721f315 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:49.983820 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e999a-7841-477a-9164-8b644d7f2b76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:49.984706 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e999a-7841-477a-9164-8b644d7f2b76 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:49.985000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e999a-7841-477a-9164-8b644d7f2b76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:49.985273 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e999a-7841-477a-9164-8b644d7f2b76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:49.994784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e999a-7841-477a-9164-8b644d7f2b76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:49.996214 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e999a-7841-477a-9164-8b644d7f2b76 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:50.005089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1350/2711] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:49:55.557424 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ee813-f6e8-452a-bf4b-62f3a2aaa953 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:49:55.558928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a01ee813-f6e8-452a-bf4b-62f3a2aaa953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:55.570774 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ee813-f6e8-452a-bf4b-62f3a2aaa953 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:49:55.575369 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27206e-e472-4343-825e-009449231474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:49:55.576001 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27206e-e472-4343-825e-009449231474 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:49:55.576283 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27206e-e472-4343-825e-009449231474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:49:55.576558 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27206e-e472-4343-825e-009449231474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:49:55.578277 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6d27206e-e472-4343-825e-009449231474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:49:55.641986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27206e-e472-4343-825e-009449231474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:49:55.644243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27206e-e472-4343-825e-009449231474 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:49:55.653561 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1362/2712] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:49:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:50:04.540397 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa4c83-8c01-4bad-9d72-1aa8c8587ea7 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:50:04.540897 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa4c83-8c01-4bad-9d72-1aa8c8587ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:50:04.541004 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa4c83-8c01-4bad-9d72-1aa8c8587ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:50:04.558520 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-39aa4c83-8c01-4bad-9d72-1aa8c8587ea7 None None] MFA Rules not processed for user `4b161aa0d704420baaedf64d635f85ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:50:04.559713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-39aa4c83-8c01-4bad-9d72-1aa8c8587ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:50:04.566517 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1351/2713] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:50:04.872208 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27206e-e472-4343-825e-009449231474 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:50:04.873627 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6d27206e-e472-4343-825e-009449231474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:50:04.928533 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27206e-e472-4343-825e-009449231474 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:50:04.932421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de545a66-f2b0-494c-888d-96d91b62aed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:50:04.933055 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de545a66-f2b0-494c-888d-96d91b62aed6 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:50:04.933335 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de545a66-f2b0-494c-888d-96d91b62aed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:50:04.933605 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de545a66-f2b0-494c-888d-96d91b62aed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:50:04.935335 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-de545a66-f2b0-494c-888d-96d91b62aed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:50:04.944554 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de545a66-f2b0-494c-888d-96d91b62aed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:50:04.946090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de545a66-f2b0-494c-888d-96d91b62aed6 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:50:04.954900 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1363/2714] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:50:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:50:20.941213 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa4c83-8c01-4bad-9d72-1aa8c8587ea7 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:50:20.943326 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-39aa4c83-8c01-4bad-9d72-1aa8c8587ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:50:21.023341 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa4c83-8c01-4bad-9d72-1aa8c8587ea7 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:50:21.035408 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52599e1-a217-4373-9257-879dca8f36aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12f5d874be84f1ca79eb439267c7b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:50:21.036063 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52599e1-a217-4373-9257-879dca8f36aa service placement] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:50:21.036379 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52599e1-a217-4373-9257-879dca8f36aa service placement] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:50:21.036658 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52599e1-a217-4373-9257-879dca8f36aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:50:21.042464 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b52599e1-a217-4373-9257-879dca8f36aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:50:21.055283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52599e1-a217-4373-9257-879dca8f36aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:50:21.056859 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52599e1-a217-4373-9257-879dca8f36aa service placement] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:50:21.067839 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1352/2715] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:50:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:50:21.208928 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de545a66-f2b0-494c-888d-96d91b62aed6 service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:50:21.217322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de545a66-f2b0-494c-888d-96d91b62aed6 service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:50:21.220982 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90877bf-06c6-4610-9f14-33930736e5cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:50:21.221607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90877bf-06c6-4610-9f14-33930736e5cd service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:50:21.221886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90877bf-06c6-4610-9f14-33930736e5cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:50:21.222159 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90877bf-06c6-4610-9f14-33930736e5cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:50:21.223911 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e90877bf-06c6-4610-9f14-33930736e5cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:50:21.284935 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90877bf-06c6-4610-9f14-33930736e5cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:50:21.286353 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90877bf-06c6-4610-9f14-33930736e5cd service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:50:21.296124 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1364/2716] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:50:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:50:28.461348 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19c2d-ef6d-4f55-83c3-223b79c400b1 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:50:28.461832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19c2d-ef6d-4f55-83c3-223b79c400b1 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:50:28.461950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19c2d-ef6d-4f55-83c3-223b79c400b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:50:28.478978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-dfa19c2d-ef6d-4f55-83c3-223b79c400b1 None None] MFA Rules not processed for user `6e94bc50928f4fc28f804cac5b6293ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:50:28.480164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-dfa19c2d-ef6d-4f55-83c3-223b79c400b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:50:28.533933 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1353/2717] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:50:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:50:29.274901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90877bf-06c6-4610-9f14-33930736e5cd service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:50:29.339308 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90877bf-06c6-4610-9f14-33930736e5cd service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:50:29.345797 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9292f3-1d79-4b7d-87a5-f93b3645fd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:50:29.347031 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9292f3-1d79-4b7d-87a5-f93b3645fd1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:50:29.347412 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9292f3-1d79-4b7d-87a5-f93b3645fd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:50:29.347663 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9292f3-1d79-4b7d-87a5-f93b3645fd1e admin admin] PATH_INFO: `/v3/users/ed2b7731b26345f79781413318c16928` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:50:29.349056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9292f3-1d79-4b7d-87a5-f93b3645fd1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2b7731b26345f79781413318c16928)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:50:29.351141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9292f3-1d79-4b7d-87a5-f93b3645fd1e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:50:29.396121 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-af9292f3-1d79-4b7d-87a5-f93b3645fd1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2b7731b26345f79781413318c16928'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:50:29.403141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-af9292f3-1d79-4b7d-87a5-f93b3645fd1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2b7731b26345f79781413318c16928'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:50:29.404493 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-af9292f3-1d79-4b7d-87a5-f93b3645fd1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2b7731b26345f79781413318c16928'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:50:29.405425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-af9292f3-1d79-4b7d-87a5-f93b3645fd1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2b7731b26345f79781413318c16928'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:50:29.416863 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-af9292f3-1d79-4b7d-87a5-f93b3645fd1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2b7731b26345f79781413318c16928'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:50:29.431208 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1365/2718] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:50:29 2022] DELETE /identity/v3/users/ed2b7731b26345f79781413318c16928 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:50:29.436055 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d5314-b7ff-48ea-9797-f227a063c343 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:50:29.436435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d5314-b7ff-48ea-9797-f227a063c343 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:50:29.436818 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d5314-b7ff-48ea-9797-f227a063c343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:50:29.455972 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-9c3d5314-b7ff-48ea-9797-f227a063c343 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:50:29.457204 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9c3d5314-b7ff-48ea-9797-f227a063c343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:50:29.518864 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1354/2719] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:50:29.528897 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9292f3-1d79-4b7d-87a5-f93b3645fd1e admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:50:29.530395 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-af9292f3-1d79-4b7d-87a5-f93b3645fd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:50:29.589959 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9292f3-1d79-4b7d-87a5-f93b3645fd1e admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:50:29.593692 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381b983-8389-4f69-af6d-c1fd853ca803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:50:29.594368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381b983-8389-4f69-af6d-c1fd853ca803 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:50:29.594651 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381b983-8389-4f69-af6d-c1fd853ca803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:50:29.594925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381b983-8389-4f69-af6d-c1fd853ca803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:50:29.603994 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381b983-8389-4f69-af6d-c1fd853ca803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:50:29.605425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381b983-8389-4f69-af6d-c1fd853ca803 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:50:29.615925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1366/2720] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:50:29.878960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d5314-b7ff-48ea-9797-f227a063c343 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:50:29.880391 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9c3d5314-b7ff-48ea-9797-f227a063c343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:50:29.892244 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d5314-b7ff-48ea-9797-f227a063c343 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:50:29.896974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121264e-2398-4818-a9a2-4d4d038dbd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:50:29.897834 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121264e-2398-4818-a9a2-4d4d038dbd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:50:29.898117 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121264e-2398-4818-a9a2-4d4d038dbd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:50:29.898624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121264e-2398-4818-a9a2-4d4d038dbd24 admin admin] PATH_INFO: `/v3/projects/141aea7a5f36436ca1b11c108ad776d6` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:50:29.899957 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121264e-2398-4818-a9a2-4d4d038dbd24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=141aea7a5f36436ca1b11c108ad776d6)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:50:29.901605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121264e-2398-4818-a9a2-4d4d038dbd24 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:50:29.959684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0121264e-2398-4818-a9a2-4d4d038dbd24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141aea7a5f36436ca1b11c108ad776d6', 'request_id': 'req-0121264e-2398-4818-a9a2-4d4d038dbd24'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:50:29.965141 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0121264e-2398-4818-a9a2-4d4d038dbd24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141aea7a5f36436ca1b11c108ad776d6', 'request_id': 'req-0121264e-2398-4818-a9a2-4d4d038dbd24'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:50:29.973571 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0121264e-2398-4818-a9a2-4d4d038dbd24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141aea7a5f36436ca1b11c108ad776d6', 'request_id': 'req-0121264e-2398-4818-a9a2-4d4d038dbd24'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:50:29.988085 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0121264e-2398-4818-a9a2-4d4d038dbd24 admin admin] The token cache is being invalidate because project 141aea7a5f36436ca1b11c108ad776d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:50:29.988376 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0121264e-2398-4818-a9a2-4d4d038dbd24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:50:29.989189 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-0121264e-2398-4818-a9a2-4d4d038dbd24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:50:29.990932 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1355/2721] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:50:29 2022] DELETE /identity/v3/projects/141aea7a5f36436ca1b11c108ad776d6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:51:36.583814 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fdd72-f410-4819-bcba-a4d2b9586464 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:51:36.584307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fdd72-f410-4819-bcba-a4d2b9586464 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:51:36.584407 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fdd72-f410-4819-bcba-a4d2b9586464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:51:36.601598 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ce4fdd72-f410-4819-bcba-a4d2b9586464 None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:51:36.602844 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ce4fdd72-f410-4819-bcba-a4d2b9586464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:51:36.657352 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1367/2722] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 5 15:51:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:51:36.703750 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121264e-2398-4818-a9a2-4d4d038dbd24 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:51:36.705157 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-0121264e-2398-4818-a9a2-4d4d038dbd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:51:36.771858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121264e-2398-4818-a9a2-4d4d038dbd24 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:51:36.777545 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db6bc0-02b3-466a-b48e-465d16599a01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:51:36.778200 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db6bc0-02b3-466a-b48e-465d16599a01 service swift] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:51:36.778484 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db6bc0-02b3-466a-b48e-465d16599a01 service swift] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:51:36.778756 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db6bc0-02b3-466a-b48e-465d16599a01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:51:36.787029 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db6bc0-02b3-466a-b48e-465d16599a01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:51:36.788579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db6bc0-02b3-466a-b48e-465d16599a01 service swift] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:51:36.796784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1356/2723] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:51:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:51:49.361726 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5cfd7-f8f3-47e8-8ba1-5bbad1bdfeb6 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:51:49.362337 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5cfd7-f8f3-47e8-8ba1-5bbad1bdfeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:51:49.362448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5cfd7-f8f3-47e8-8ba1-5bbad1bdfeb6 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:51:49.363817 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1368/2724] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 5 15:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:51:49.369831 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b2502-9b8c-4916-9f72-07c40d6d5986 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:51:49.370325 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b2502-9b8c-4916-9f72-07c40d6d5986 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:51:49.370422 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b2502-9b8c-4916-9f72-07c40d6d5986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:51:49.387896 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-c54b2502-9b8c-4916-9f72-07c40d6d5986 None None] MFA Rules not processed for user `2a29a4b1b1aa45aea2e466d8f8b79365`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:51:49.389217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c54b2502-9b8c-4916-9f72-07c40d6d5986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:51:49.456923 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1357/2725] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 5 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:51:49.468465 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5cfd7-f8f3-47e8-8ba1-5bbad1bdfeb6 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:51:49.470155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3ac5cfd7-f8f3-47e8-8ba1-5bbad1bdfeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:51:49.527159 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5cfd7-f8f3-47e8-8ba1-5bbad1bdfeb6 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:51:49.530847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b7a29-e98b-4e3a-86f9-8a93b6f3980b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab6c13dc02ba49d0be523fa9a73fdf5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:51:49.531481 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b7a29-e98b-4e3a-86f9-8a93b6f3980b service glance] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:51:49.531757 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b7a29-e98b-4e3a-86f9-8a93b6f3980b service glance] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:51:49.532027 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b7a29-e98b-4e3a-86f9-8a93b6f3980b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:51:49.541643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b7a29-e98b-4e3a-86f9-8a93b6f3980b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:51:49.543075 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b7a29-e98b-4e3a-86f9-8a93b6f3980b service glance] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:51:49.553927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1369/2726] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:51:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:51:49.619554 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465ef1c-565f-4eba-9d68-1e25488eea42 None None] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:51:49.619847 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465ef1c-565f-4eba-9d68-1e25488eea42 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:51:49.620121 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465ef1c-565f-4eba-9d68-1e25488eea42 None None] PATH_INFO: `/` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:51:49.621461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1358/2727] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 5 15:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:51:49.626839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e55ab-c684-4830-864c-d72436b97ca2 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:51:49.627143 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e55ab-c684-4830-864c-d72436b97ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:51:49.627415 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e55ab-c684-4830-864c-d72436b97ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:51:49.644927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-fa7e55ab-c684-4830-864c-d72436b97ca2 None None] MFA Rules not processed for user `2fe9f8eb94c84c36ad7a49507b2c8360`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:51:49.646105 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-fa7e55ab-c684-4830-864c-d72436b97ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:51:49.694778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1370/2728] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 5 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:51:49.706801 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465ef1c-565f-4eba-9d68-1e25488eea42 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:51:49.708547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-2465ef1c-565f-4eba-9d68-1e25488eea42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:51:49.721981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465ef1c-565f-4eba-9d68-1e25488eea42 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:51:49.725473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e50e2b-28e3-43a3-9467-b00502f54486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:51:49.726097 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e50e2b-28e3-43a3-9467-b00502f54486 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:51:49.726413 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e50e2b-28e3-43a3-9467-b00502f54486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:51:49.726687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e50e2b-28e3-43a3-9467-b00502f54486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:51:49.734233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e50e2b-28e3-43a3-9467-b00502f54486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:51:49.735601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e50e2b-28e3-43a3-9467-b00502f54486 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:51:49.743130 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1359/2729] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:51:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:51:49.822936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9fc60-724a-4adf-8622-a240a2c05004 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:51:49.823226 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9fc60-724a-4adf-8622-a240a2c05004 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:51:49.823500 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9fc60-724a-4adf-8622-a240a2c05004 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:51:49.824871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1371/2730] 10.222.0.58 () {54 vars in 921 bytes} [Thu May 5 15:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 05 15:51:49.831032 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e484-e6b9-4770-9e2a-daecb2162c10 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:51:49.831319 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e484-e6b9-4770-9e2a-daecb2162c10 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:51:49.831595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e484-e6b9-4770-9e2a-daecb2162c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:51:49.850229 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-aa06e484-e6b9-4770-9e2a-daecb2162c10 None None] MFA Rules not processed for user `2a29a4b1b1aa45aea2e466d8f8b79365`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:51:49.851403 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-aa06e484-e6b9-4770-9e2a-daecb2162c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:51:49.861173 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1360/2731] 10.222.0.58 () {58 vars in 1018 bytes} [Thu May 5 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:51:49.871305 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9fc60-724a-4adf-8622-a240a2c05004 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:51:49.882250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9fc60-724a-4adf-8622-a240a2c05004 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:51:49.885734 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed9eb9-a795-49f7-b601-b4a3539609ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:51:49.886389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed9eb9-a795-49f7-b601-b4a3539609ab service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:51:49.886674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed9eb9-a795-49f7-b601-b4a3539609ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:51:49.886975 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed9eb9-a795-49f7-b601-b4a3539609ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:51:49.897441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed9eb9-a795-49f7-b601-b4a3539609ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:51:49.898903 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed9eb9-a795-49f7-b601-b4a3539609ab service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:51:49.910454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1372/2732] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:51:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:51:52.188458 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42052bcf-3175-40a3-858d-9472578669f9 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:51:52.188913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42052bcf-3175-40a3-858d-9472578669f9 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:51:52.189121 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42052bcf-3175-40a3-858d-9472578669f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:51:52.211951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-42052bcf-3175-40a3-858d-9472578669f9 None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:51:52.213185 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-42052bcf-3175-40a3-858d-9472578669f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:51:52.226346 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1361/2733] 10.222.0.58 () {58 vars in 1009 bytes} [Thu May 5 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:51:52.238207 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed9eb9-a795-49f7-b601-b4a3539609ab service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:51:52.251678 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed9eb9-a795-49f7-b601-b4a3539609ab service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:51:52.260321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db9c43-e39d-4adb-9b37-3a75804aaceb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:51:52.260974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db9c43-e39d-4adb-9b37-3a75804aaceb service swift] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:51:52.261448 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db9c43-e39d-4adb-9b37-3a75804aaceb service swift] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:51:52.261879 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db9c43-e39d-4adb-9b37-3a75804aaceb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:51:52.272231 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db9c43-e39d-4adb-9b37-3a75804aaceb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:51:52.274264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db9c43-e39d-4adb-9b37-3a75804aaceb service swift] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:51:52.283775 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1373/2734] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:51:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:52:12.026012 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef610-271e-45ab-a09f-9d3c152edde8 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:12.026524 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef610-271e-45ab-a09f-9d3c152edde8 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:12.026628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef610-271e-45ab-a09f-9d3c152edde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:12.048971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-852ef610-271e-45ab-a09f-9d3c152edde8 None None] MFA Rules not processed for user `a44a128e68d94e34ac3463eb7f1d8f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:52:12.050301 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-852ef610-271e-45ab-a09f-9d3c152edde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:12.057694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1362/2735] 10.222.0.58 () {58 vars in 967 bytes} [Thu May 5 15:52:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:52:12.072227 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db9c43-e39d-4adb-9b37-3a75804aaceb service swift] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:12.084619 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db9c43-e39d-4adb-9b37-3a75804aaceb service swift] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:12.091154 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870c9e8-9879-42df-8e4b-55935f75f7be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90b5737f2c345b08460d291ccf49466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:12.092378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870c9e8-9879-42df-8e4b-55935f75f7be service swift] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:12.092378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870c9e8-9879-42df-8e4b-55935f75f7be service swift] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:12.092378 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870c9e8-9879-42df-8e4b-55935f75f7be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:12.102098 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870c9e8-9879-42df-8e4b-55935f75f7be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:12.104017 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870c9e8-9879-42df-8e4b-55935f75f7be service swift] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:12.114338 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1374/2736] 10.222.0.58 () {60 vars in 1384 bytes} [Thu May 5 15:52:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 05 15:52:15.259518 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ef610-271e-45ab-a09f-9d3c152edde8 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:15.260956 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-852ef610-271e-45ab-a09f-9d3c152edde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:15.272234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ef610-271e-45ab-a09f-9d3c152edde8 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:15.275769 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68db99e-4cc0-4121-b90b-b2f10d5699f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:15.276447 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68db99e-4cc0-4121-b90b-b2f10d5699f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:15.276678 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68db99e-4cc0-4121-b90b-b2f10d5699f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:15.276952 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68db99e-4cc0-4121-b90b-b2f10d5699f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:15.278669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-f68db99e-4cc0-4121-b90b-b2f10d5699f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:15.340082 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68db99e-4cc0-4121-b90b-b2f10d5699f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:15.341522 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68db99e-4cc0-4121-b90b-b2f10d5699f3 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:15.351581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1363/2737] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:52:22.089391 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870c9e8-9879-42df-8e4b-55935f75f7be service swift] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:22.090906 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e870c9e8-9879-42df-8e4b-55935f75f7be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:22.104947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870c9e8-9879-42df-8e4b-55935f75f7be service swift] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:22.109793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c203ecb-8fbb-4620-8df6-dd51faa78add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:22.110711 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c203ecb-8fbb-4620-8df6-dd51faa78add admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:22.110990 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c203ecb-8fbb-4620-8df6-dd51faa78add admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:22.111264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c203ecb-8fbb-4620-8df6-dd51faa78add admin admin] PATH_INFO: `/v3/users/4b161aa0d704420baaedf64d635f85ca` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:22.112431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c203ecb-8fbb-4620-8df6-dd51faa78add admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b161aa0d704420baaedf64d635f85ca)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:22.114376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c203ecb-8fbb-4620-8df6-dd51faa78add admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:22.158950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2c203ecb-8fbb-4620-8df6-dd51faa78add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b161aa0d704420baaedf64d635f85ca'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.165421 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2c203ecb-8fbb-4620-8df6-dd51faa78add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b161aa0d704420baaedf64d635f85ca'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.166072 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2c203ecb-8fbb-4620-8df6-dd51faa78add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b161aa0d704420baaedf64d635f85ca'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.166700 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2c203ecb-8fbb-4620-8df6-dd51faa78add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b161aa0d704420baaedf64d635f85ca'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.177809 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-2c203ecb-8fbb-4620-8df6-dd51faa78add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b161aa0d704420baaedf64d635f85ca'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.190014 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1375/2738] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:52:22 2022] DELETE /identity/v3/users/4b161aa0d704420baaedf64d635f85ca => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:52:22.360137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68db99e-4cc0-4121-b90b-b2f10d5699f3 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:22.370844 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68db99e-4cc0-4121-b90b-b2f10d5699f3 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:22.427306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfc309-594f-47db-9d3e-558884358a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:22.428158 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfc309-594f-47db-9d3e-558884358a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:22.428442 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfc309-594f-47db-9d3e-558884358a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:22.428716 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfc309-594f-47db-9d3e-558884358a35 admin admin] PATH_INFO: `/v3/projects/70a38fd1cdcd44f1b9d2fb832027c40b` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:22.429881 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfc309-594f-47db-9d3e-558884358a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a38fd1cdcd44f1b9d2fb832027c40b)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:22.431787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfc309-594f-47db-9d3e-558884358a35 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:22.478344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-14cfc309-594f-47db-9d3e-558884358a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a38fd1cdcd44f1b9d2fb832027c40b', 'request_id': 'req-14cfc309-594f-47db-9d3e-558884358a35'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.483667 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-14cfc309-594f-47db-9d3e-558884358a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a38fd1cdcd44f1b9d2fb832027c40b', 'request_id': 'req-14cfc309-594f-47db-9d3e-558884358a35'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.490246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-14cfc309-594f-47db-9d3e-558884358a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a38fd1cdcd44f1b9d2fb832027c40b', 'request_id': 'req-14cfc309-594f-47db-9d3e-558884358a35'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.501736 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-14cfc309-594f-47db-9d3e-558884358a35 admin admin] The token cache is being invalidate because project 70a38fd1cdcd44f1b9d2fb832027c40b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:52:22.502021 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-14cfc309-594f-47db-9d3e-558884358a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.502661 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-14cfc309-594f-47db-9d3e-558884358a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.504382 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1364/2739] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:52:22 2022] DELETE /identity/v3/projects/70a38fd1cdcd44f1b9d2fb832027c40b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:52:22.508217 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c203ecb-8fbb-4620-8df6-dd51faa78add admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:22.509740 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-2c203ecb-8fbb-4620-8df6-dd51faa78add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:22.523601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c203ecb-8fbb-4620-8df6-dd51faa78add admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:22.577691 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051d99f-8d92-4963-bfe6-16d67b1c1dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:22.579166 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051d99f-8d92-4963-bfe6-16d67b1c1dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:22.579447 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051d99f-8d92-4963-bfe6-16d67b1c1dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:22.579722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051d99f-8d92-4963-bfe6-16d67b1c1dd8 admin admin] PATH_INFO: `/v3/users/a9549e8e629a4e9380966228d6adb284` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:22.580895 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051d99f-8d92-4963-bfe6-16d67b1c1dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9549e8e629a4e9380966228d6adb284)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:22.583111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051d99f-8d92-4963-bfe6-16d67b1c1dd8 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:22.626916 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d051d99f-8d92-4963-bfe6-16d67b1c1dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9549e8e629a4e9380966228d6adb284'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.633409 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d051d99f-8d92-4963-bfe6-16d67b1c1dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9549e8e629a4e9380966228d6adb284'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.634063 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d051d99f-8d92-4963-bfe6-16d67b1c1dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9549e8e629a4e9380966228d6adb284'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.634704 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d051d99f-8d92-4963-bfe6-16d67b1c1dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9549e8e629a4e9380966228d6adb284'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.646516 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-d051d99f-8d92-4963-bfe6-16d67b1c1dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9549e8e629a4e9380966228d6adb284'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.659189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1376/2740] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:52:22 2022] DELETE /identity/v3/users/a9549e8e629a4e9380966228d6adb284 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:52:22.824066 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfc309-594f-47db-9d3e-558884358a35 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:22.825596 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-14cfc309-594f-47db-9d3e-558884358a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:22.848069 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfc309-594f-47db-9d3e-558884358a35 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:22.915616 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c3c53-3ed0-4f26-ada2-c20335621396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:22.916399 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c3c53-3ed0-4f26-ada2-c20335621396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:22.916680 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c3c53-3ed0-4f26-ada2-c20335621396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:22.916955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c3c53-3ed0-4f26-ada2-c20335621396 admin admin] PATH_INFO: `/v3/projects/ccf5b4a8a2794f059837b86b4cd827b2` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:22.918118 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c3c53-3ed0-4f26-ada2-c20335621396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf5b4a8a2794f059837b86b4cd827b2)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:22.920025 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c3c53-3ed0-4f26-ada2-c20335621396 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:22.967546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-238c3c53-3ed0-4f26-ada2-c20335621396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf5b4a8a2794f059837b86b4cd827b2', 'request_id': 'req-238c3c53-3ed0-4f26-ada2-c20335621396'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.972991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-238c3c53-3ed0-4f26-ada2-c20335621396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf5b4a8a2794f059837b86b4cd827b2', 'request_id': 'req-238c3c53-3ed0-4f26-ada2-c20335621396'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.979135 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-238c3c53-3ed0-4f26-ada2-c20335621396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf5b4a8a2794f059837b86b4cd827b2', 'request_id': 'req-238c3c53-3ed0-4f26-ada2-c20335621396'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.992872 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-238c3c53-3ed0-4f26-ada2-c20335621396 admin admin] The token cache is being invalidate because project ccf5b4a8a2794f059837b86b4cd827b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:52:22.993318 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-238c3c53-3ed0-4f26-ada2-c20335621396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.994124 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-238c3c53-3ed0-4f26-ada2-c20335621396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:22.996123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1365/2741] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:52:22 2022] DELETE /identity/v3/projects/ccf5b4a8a2794f059837b86b4cd827b2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:52:41.701380 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051d99f-8d92-4963-bfe6-16d67b1c1dd8 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:41.702801 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d051d99f-8d92-4963-bfe6-16d67b1c1dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:41.759541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051d99f-8d92-4963-bfe6-16d67b1c1dd8 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:41.805867 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3336c-4be1-4567-beff-72d57f68bbc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:41.806542 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3336c-4be1-4567-beff-72d57f68bbc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:41.806825 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3336c-4be1-4567-beff-72d57f68bbc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:41.807104 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3336c-4be1-4567-beff-72d57f68bbc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:41.808851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-11a3336c-4be1-4567-beff-72d57f68bbc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:41.864710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3336c-4be1-4567-beff-72d57f68bbc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:41.866127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3336c-4be1-4567-beff-72d57f68bbc7 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:41.874901 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1377/2742] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:52:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:52:42.182303 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c3c53-3ed0-4f26-ada2-c20335621396 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:42.183697 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-238c3c53-3ed0-4f26-ada2-c20335621396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:42.238625 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c3c53-3ed0-4f26-ada2-c20335621396 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:42.242230 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de09f2-d08d-49c6-9f83-8d57723d0ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:42.242879 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de09f2-d08d-49c6-9f83-8d57723d0ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:42.243164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de09f2-d08d-49c6-9f83-8d57723d0ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:42.243441 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de09f2-d08d-49c6-9f83-8d57723d0ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:42.245146 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-57de09f2-d08d-49c6-9f83-8d57723d0ac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:42.314178 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de09f2-d08d-49c6-9f83-8d57723d0ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:42.315689 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de09f2-d08d-49c6-9f83-8d57723d0ac2 service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:42.327054 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1366/2743] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:52:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:52:43.514768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3336c-4be1-4567-beff-72d57f68bbc7 service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:43.516756 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-11a3336c-4be1-4567-beff-72d57f68bbc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:43.528420 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3336c-4be1-4567-beff-72d57f68bbc7 service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:43.533239 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a11e1-a505-4d16-9c92-489f403a54ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:43.533886 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a11e1-a505-4d16-9c92-489f403a54ca service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:43.534185 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a11e1-a505-4d16-9c92-489f403a54ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:43.534490 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a11e1-a505-4d16-9c92-489f403a54ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:43.536278 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c43a11e1-a505-4d16-9c92-489f403a54ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:43.553987 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a11e1-a505-4d16-9c92-489f403a54ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:43.555470 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a11e1-a505-4d16-9c92-489f403a54ca service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:43.567788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1378/2744] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:52:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:52:44.593143 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de09f2-d08d-49c6-9f83-8d57723d0ac2 service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:44.595810 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-57de09f2-d08d-49c6-9f83-8d57723d0ac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:44.616773 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de09f2-d08d-49c6-9f83-8d57723d0ac2 service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:44.623355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52065a-c79a-4822-a07b-e093bad3e61a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:44.624178 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52065a-c79a-4822-a07b-e093bad3e61a service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:44.624460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52065a-c79a-4822-a07b-e093bad3e61a service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:44.624733 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52065a-c79a-4822-a07b-e093bad3e61a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:44.626924 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-db52065a-c79a-4822-a07b-e093bad3e61a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:44.642148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52065a-c79a-4822-a07b-e093bad3e61a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:44.643815 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52065a-c79a-4822-a07b-e093bad3e61a service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:44.668312 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1367/2745] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:52:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:52:48.864664 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a11e1-a505-4d16-9c92-489f403a54ca service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:48.873026 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a11e1-a505-4d16-9c92-489f403a54ca service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:48.877095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6540-9b01-4e08-adb5-a8be12f2f2ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:48.877717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6540-9b01-4e08-adb5-a8be12f2f2ce service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:48.877995 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6540-9b01-4e08-adb5-a8be12f2f2ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:48.878320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6540-9b01-4e08-adb5-a8be12f2f2ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:48.880089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-39ee6540-9b01-4e08-adb5-a8be12f2f2ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:48.939617 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee6540-9b01-4e08-adb5-a8be12f2f2ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:48.941059 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee6540-9b01-4e08-adb5-a8be12f2f2ce service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:48.950289 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1379/2746] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:52:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:52:52.096049 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52065a-c79a-4822-a07b-e093bad3e61a service nova] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:52.097593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-db52065a-c79a-4822-a07b-e093bad3e61a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:52.112703 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52065a-c79a-4822-a07b-e093bad3e61a service nova] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:52.117410 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcb5e0-c5f8-46c9-b430-e61806a930c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:52.118259 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcb5e0-c5f8-46c9-b430-e61806a930c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:52.118546 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcb5e0-c5f8-46c9-b430-e61806a930c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:52.119263 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcb5e0-c5f8-46c9-b430-e61806a930c3 admin admin] PATH_INFO: `/v3/users/6e94bc50928f4fc28f804cac5b6293ed` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:52.120579 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcb5e0-c5f8-46c9-b430-e61806a930c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e94bc50928f4fc28f804cac5b6293ed)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:52.122576 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcb5e0-c5f8-46c9-b430-e61806a930c3 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:52.168009 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cdbcb5e0-c5f8-46c9-b430-e61806a930c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e94bc50928f4fc28f804cac5b6293ed'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:52.168649 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cdbcb5e0-c5f8-46c9-b430-e61806a930c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e94bc50928f4fc28f804cac5b6293ed'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:52.176161 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cdbcb5e0-c5f8-46c9-b430-e61806a930c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e94bc50928f4fc28f804cac5b6293ed'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:52.182844 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cdbcb5e0-c5f8-46c9-b430-e61806a930c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e94bc50928f4fc28f804cac5b6293ed'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:52.183485 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cdbcb5e0-c5f8-46c9-b430-e61806a930c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e94bc50928f4fc28f804cac5b6293ed'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:52.200246 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1368/2747] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:52:52 2022] DELETE /identity/v3/users/6e94bc50928f4fc28f804cac5b6293ed => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:52:52.368085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6540-9b01-4e08-adb5-a8be12f2f2ce service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:52.381592 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6540-9b01-4e08-adb5-a8be12f2f2ce service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:52.442253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931c613-7342-4526-9000-e29459516053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:52.443113 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931c613-7342-4526-9000-e29459516053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:52.443397 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931c613-7342-4526-9000-e29459516053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:52.443676 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931c613-7342-4526-9000-e29459516053 admin admin] PATH_INFO: `/v3/projects/ef541155816d4ac0938103cc1c142845` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:52.444847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931c613-7342-4526-9000-e29459516053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef541155816d4ac0938103cc1c142845)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:52.446785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931c613-7342-4526-9000-e29459516053 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:52.496771 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c931c613-7342-4526-9000-e29459516053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef541155816d4ac0938103cc1c142845', 'request_id': 'req-c931c613-7342-4526-9000-e29459516053'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:52.501953 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c931c613-7342-4526-9000-e29459516053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef541155816d4ac0938103cc1c142845', 'request_id': 'req-c931c613-7342-4526-9000-e29459516053'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:52.507948 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c931c613-7342-4526-9000-e29459516053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef541155816d4ac0938103cc1c142845', 'request_id': 'req-c931c613-7342-4526-9000-e29459516053'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:52.522344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c931c613-7342-4526-9000-e29459516053 admin admin] The token cache is being invalidate because project ef541155816d4ac0938103cc1c142845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:52:52.522632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c931c613-7342-4526-9000-e29459516053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:52.523266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-c931c613-7342-4526-9000-e29459516053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:52:52.524812 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1380/2748] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:52:52 2022] DELETE /identity/v3/projects/ef541155816d4ac0938103cc1c142845 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:52:52.529738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3674f-fcab-4cc4-ac29-9505ae63f8cc None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:52.530023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3674f-fcab-4cc4-ac29-9505ae63f8cc None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:52.530338 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3674f-fcab-4cc4-ac29-9505ae63f8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:52.548407 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-bea3674f-fcab-4cc4-ac29-9505ae63f8cc None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:52:52.549595 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bea3674f-fcab-4cc4-ac29-9505ae63f8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:52.606171 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1369/2749] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:52:52.614551 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945b77a-f292-4697-b9b1-f9bb703116ac None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:52.614845 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945b77a-f292-4697-b9b1-f9bb703116ac None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:52.615125 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945b77a-f292-4697-b9b1-f9bb703116ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:52.634694 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-c945b77a-f292-4697-b9b1-f9bb703116ac None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:52:52.635819 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c945b77a-f292-4697-b9b1-f9bb703116ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:52.644314 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1381/2750] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:52:52.648864 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3674f-fcab-4cc4-ac29-9505ae63f8cc None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:52.658626 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3674f-fcab-4cc4-ac29-9505ae63f8cc None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:52.663085 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0fc4f-f910-4540-9b0b-abd274b4545d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:52.663723 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0fc4f-f910-4540-9b0b-abd274b4545d admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:52.664000 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0fc4f-f910-4540-9b0b-abd274b4545d admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:52.664275 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0fc4f-f910-4540-9b0b-abd274b4545d admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:52.664987 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0fc4f-f910-4540-9b0b-abd274b4545d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:52:52.665312 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0fc4f-f910-4540-9b0b-abd274b4545d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:52.666914 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0fc4f-f910-4540-9b0b-abd274b4545d admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:52.678137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1370/2751] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:52:52.682608 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945b77a-f292-4697-b9b1-f9bb703116ac None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:52.692285 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945b77a-f292-4697-b9b1-f9bb703116ac None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:52.696908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156de843-5efa-4e5a-9a3a-539f21b7c3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:52.697544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156de843-5efa-4e5a-9a3a-539f21b7c3bb admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:52.697822 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156de843-5efa-4e5a-9a3a-539f21b7c3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:52.698095 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156de843-5efa-4e5a-9a3a-539f21b7c3bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:52.698807 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156de843-5efa-4e5a-9a3a-539f21b7c3bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:52.700676 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156de843-5efa-4e5a-9a3a-539f21b7c3bb admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:52.725584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1382/2752] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:52:52 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:52:52.729640 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0fc4f-f910-4540-9b0b-abd274b4545d admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:52.739474 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0fc4f-f910-4540-9b0b-abd274b4545d admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:52.792936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23391a0e-8a5d-4df2-9c85-39fd8dd93c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:52.793588 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391a0e-8a5d-4df2-9c85-39fd8dd93c8d admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:52.793869 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391a0e-8a5d-4df2-9c85-39fd8dd93c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:52.794137 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391a0e-8a5d-4df2-9c85-39fd8dd93c8d admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:52.794842 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23391a0e-8a5d-4df2-9c85-39fd8dd93c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:52.796747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23391a0e-8a5d-4df2-9c85-39fd8dd93c8d admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:52.816410 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1371/2753] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:52:52 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:52:52.820577 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156de843-5efa-4e5a-9a3a-539f21b7c3bb admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:52.831166 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156de843-5efa-4e5a-9a3a-539f21b7c3bb admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:52.836035 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419094d5-2598-4ce1-93a2-9507e9d4187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:52.836665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419094d5-2598-4ce1-93a2-9507e9d4187b admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:52.836947 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419094d5-2598-4ce1-93a2-9507e9d4187b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:52.837216 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419094d5-2598-4ce1-93a2-9507e9d4187b admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:52.837923 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419094d5-2598-4ce1-93a2-9507e9d4187b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:52.839528 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419094d5-2598-4ce1-93a2-9507e9d4187b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:52.849541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1383/2754] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:52:52.853278 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23391a0e-8a5d-4df2-9c85-39fd8dd93c8d admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:52.863187 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23391a0e-8a5d-4df2-9c85-39fd8dd93c8d admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:52.867742 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7657ba4-68de-4d7a-9a80-c4d45a7ec6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:52.868392 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7657ba4-68de-4d7a-9a80-c4d45a7ec6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:52.868670 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7657ba4-68de-4d7a-9a80-c4d45a7ec6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:52.868945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7657ba4-68de-4d7a-9a80-c4d45a7ec6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:52.869651 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7657ba4-68de-4d7a-9a80-c4d45a7ec6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:52.871240 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7657ba4-68de-4d7a-9a80-c4d45a7ec6a1 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:52.881177 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1372/2755] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:52:52.885250 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419094d5-2598-4ce1-93a2-9507e9d4187b admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:52.896203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419094d5-2598-4ce1-93a2-9507e9d4187b admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:52.900900 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ec681-7d6c-4f99-8988-57ea1b33b227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:52.901772 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ec681-7d6c-4f99-8988-57ea1b33b227 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:52.902056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ec681-7d6c-4f99-8988-57ea1b33b227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:52.902383 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ec681-7d6c-4f99-8988-57ea1b33b227 admin admin] PATH_INFO: `/v3/projects/08e032d5a6c4470ab4739d8b63189a51/users/b87fe5fb6bf741e4a37b1513793a5082/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:52.916467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ec681-7d6c-4f99-8988-57ea1b33b227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e032d5a6c4470ab4739d8b63189a51, user_id=b87fe5fb6bf741e4a37b1513793a5082, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:52.919133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ec681-7d6c-4f99-8988-57ea1b33b227 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:52.932532 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1384/2756] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:52:52 2022] PUT /identity/v3/projects/08e032d5a6c4470ab4739d8b63189a51/users/b87fe5fb6bf741e4a37b1513793a5082/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:52:52.937747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942877b9-5a5f-4616-b9e8-a9e92c0eded3 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:52.938066 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942877b9-5a5f-4616-b9e8-a9e92c0eded3 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:52.938388 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942877b9-5a5f-4616-b9e8-a9e92c0eded3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:52.956913 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-942877b9-5a5f-4616-b9e8-a9e92c0eded3 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:52:52.958382 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-942877b9-5a5f-4616-b9e8-a9e92c0eded3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:53.014373 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1373/2757] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:52:53.023946 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ec681-7d6c-4f99-8988-57ea1b33b227 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:53.025707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-668ec681-7d6c-4f99-8988-57ea1b33b227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:53.080887 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ec681-7d6c-4f99-8988-57ea1b33b227 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:53.084709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cc60b-d2f0-4d08-ab0a-54894e9f000f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:53.085340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cc60b-d2f0-4d08-ab0a-54894e9f000f service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:53.085625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cc60b-d2f0-4d08-ab0a-54894e9f000f service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:53.085925 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cc60b-d2f0-4d08-ab0a-54894e9f000f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:53.094673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cc60b-d2f0-4d08-ab0a-54894e9f000f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:53.096078 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cc60b-d2f0-4d08-ab0a-54894e9f000f service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:53.105200 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1385/2758] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:52:57.175045 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404c6f9-1d1e-4a69-9491-8061b17dfbe3 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:57.175593 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404c6f9-1d1e-4a69-9491-8061b17dfbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:57.175680 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404c6f9-1d1e-4a69-9491-8061b17dfbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:57.211016 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-b404c6f9-1d1e-4a69-9491-8061b17dfbe3 None None] MFA Rules not processed for user `b87fe5fb6bf741e4a37b1513793a5082`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:52:57.212318 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b404c6f9-1d1e-4a69-9491-8061b17dfbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:57.276937 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1374/2759] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:52:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:52:57.289209 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cc60b-d2f0-4d08-ab0a-54894e9f000f service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:57.290741 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-773cc60b-d2f0-4d08-ab0a-54894e9f000f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:57.369629 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cc60b-d2f0-4d08-ab0a-54894e9f000f service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:57.375313 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dd58f-609b-4327-b1f9-a26c9a5de1eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:57.376034 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dd58f-609b-4327-b1f9-a26c9a5de1eb service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:57.376897 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dd58f-609b-4327-b1f9-a26c9a5de1eb service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:57.377239 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dd58f-609b-4327-b1f9-a26c9a5de1eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:57.385074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242dd58f-609b-4327-b1f9-a26c9a5de1eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:57.386785 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242dd58f-609b-4327-b1f9-a26c9a5de1eb service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:57.395917 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1386/2760] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:52:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:52:58.965019 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287296d-beaa-4838-a30b-483e59cf99dd None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:58.965527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287296d-beaa-4838-a30b-483e59cf99dd None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:58.965630 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287296d-beaa-4838-a30b-483e59cf99dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:58.991665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-9287296d-beaa-4838-a30b-483e59cf99dd None None] MFA Rules not processed for user `b87fe5fb6bf741e4a37b1513793a5082`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:52:58.993483 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9287296d-beaa-4838-a30b-483e59cf99dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:59.006439 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1375/2761] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:52:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:52:59.344541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dd58f-609b-4327-b1f9-a26c9a5de1eb service nova] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:59.354818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dd58f-609b-4327-b1f9-a26c9a5de1eb service nova] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:59.358768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce78d5-826e-467a-affd-38793a6757e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:59.359507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce78d5-826e-467a-affd-38793a6757e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:59.360015 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce78d5-826e-467a-affd-38793a6757e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:59.360363 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce78d5-826e-467a-affd-38793a6757e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:59.364713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-99ce78d5-826e-467a-affd-38793a6757e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:59.376061 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce78d5-826e-467a-affd-38793a6757e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:59.377669 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce78d5-826e-467a-affd-38793a6757e6 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:59.386922 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1387/2762] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:52:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:52:59.743322 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287296d-beaa-4838-a30b-483e59cf99dd None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:52:59.744705 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-9287296d-beaa-4838-a30b-483e59cf99dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:59.853970 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287296d-beaa-4838-a30b-483e59cf99dd None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:52:59.859266 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdc4c9-ba4e-4b91-95f8-33d52a0e9b4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12f5d874be84f1ca79eb439267c7b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:52:59.859939 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdc4c9-ba4e-4b91-95f8-33d52a0e9b4c service placement] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:52:59.860221 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdc4c9-ba4e-4b91-95f8-33d52a0e9b4c service placement] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:52:59.860493 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdc4c9-ba4e-4b91-95f8-33d52a0e9b4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:52:59.862879 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4cfdc4c9-ba4e-4b91-95f8-33d52a0e9b4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:52:59.875454 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdc4c9-ba4e-4b91-95f8-33d52a0e9b4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:52:59.877335 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdc4c9-ba4e-4b91-95f8-33d52a0e9b4c service placement] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:52:59.896894 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1376/2763] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:52:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:53:01.594036 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce78d5-826e-467a-affd-38793a6757e6 service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:53:01.595717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-99ce78d5-826e-467a-affd-38793a6757e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:53:01.606180 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce78d5-826e-467a-affd-38793a6757e6 service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:53:01.609903 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1c1b1-2d4a-4980-9789-bb7d40da87e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:53:01.610749 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1c1b1-2d4a-4980-9789-bb7d40da87e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:53:01.611123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1c1b1-2d4a-4980-9789-bb7d40da87e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:53:01.611494 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1c1b1-2d4a-4980-9789-bb7d40da87e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:53:01.613320 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-cdf1c1b1-2d4a-4980-9789-bb7d40da87e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:53:01.623577 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1c1b1-2d4a-4980-9789-bb7d40da87e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:53:01.625096 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1c1b1-2d4a-4980-9789-bb7d40da87e5 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:53:01.634529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1388/2764] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:53:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:53:07.632027 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdc4c9-ba4e-4b91-95f8-33d52a0e9b4c service placement] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:53:07.645539 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdc4c9-ba4e-4b91-95f8-33d52a0e9b4c service placement] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:53:07.650940 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ce5f1-8024-477f-b6ac-4ecace4a22cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:53:07.651572 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ce5f1-8024-477f-b6ac-4ecace4a22cc service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:53:07.651852 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ce5f1-8024-477f-b6ac-4ecace4a22cc service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:53:07.652122 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ce5f1-8024-477f-b6ac-4ecace4a22cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:53:07.653833 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-008ce5f1-8024-477f-b6ac-4ecace4a22cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:53:07.666811 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ce5f1-8024-477f-b6ac-4ecace4a22cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:53:07.668355 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ce5f1-8024-477f-b6ac-4ecace4a22cc service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:53:07.679813 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1377/2765] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:53:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:53:56.074712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7a5f6-72cf-49a7-a039-c4204990c7a9 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:53:56.075214 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7a5f6-72cf-49a7-a039-c4204990c7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:53:56.075335 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7a5f6-72cf-49a7-a039-c4204990c7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:53:56.092584 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e7d7a5f6-72cf-49a7-a039-c4204990c7a9 None None] MFA Rules not processed for user `b87fe5fb6bf741e4a37b1513793a5082`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:53:56.093763 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e7d7a5f6-72cf-49a7-a039-c4204990c7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:53:56.101180 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1389/2766] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:53:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:54:07.485126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ce5f1-8024-477f-b6ac-4ecace4a22cc service nova] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:54:07.497799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ce5f1-8024-477f-b6ac-4ecace4a22cc service nova] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:54:07.503218 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d841b4f-9d58-452c-9979-ebd7a46745bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a29a4b1b1aa45aea2e466d8f8b79365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:54:07.503856 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841b4f-9d58-452c-9979-ebd7a46745bc service nova] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:54:07.504138 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841b4f-9d58-452c-9979-ebd7a46745bc service nova] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:54:07.504432 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841b4f-9d58-452c-9979-ebd7a46745bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:54:07.508825 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-8d841b4f-9d58-452c-9979-ebd7a46745bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:54:07.519387 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d841b4f-9d58-452c-9979-ebd7a46745bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:54:07.520965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d841b4f-9d58-452c-9979-ebd7a46745bc service nova] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:54:07.531865 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1378/2767] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:54:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:54:48.001750 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506b173-c491-4a79-814f-d181d36fbcf3 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:54:48.002322 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506b173-c491-4a79-814f-d181d36fbcf3 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:54:48.002435 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506b173-c491-4a79-814f-d181d36fbcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:54:48.028552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a506b173-c491-4a79-814f-d181d36fbcf3 None None] MFA Rules not processed for user `b87fe5fb6bf741e4a37b1513793a5082`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:54:48.029767 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a506b173-c491-4a79-814f-d181d36fbcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:54:48.053024 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1390/2768] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:54:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:55:26.742861 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d841b4f-9d58-452c-9979-ebd7a46745bc service nova] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:55:26.799126 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d841b4f-9d58-452c-9979-ebd7a46745bc service nova] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:55:26.804003 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1652f97-bbc1-4458-a66a-812e46ecbd36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12f5d874be84f1ca79eb439267c7b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:55:26.804628 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652f97-bbc1-4458-a66a-812e46ecbd36 service placement] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:55:26.804908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652f97-bbc1-4458-a66a-812e46ecbd36 service placement] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:55:26.805180 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652f97-bbc1-4458-a66a-812e46ecbd36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:55:26.806994 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e1652f97-bbc1-4458-a66a-812e46ecbd36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:55:26.829800 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1652f97-bbc1-4458-a66a-812e46ecbd36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:55:26.831394 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1652f97-bbc1-4458-a66a-812e46ecbd36 service placement] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:55:26.841172 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1379/2769] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:55:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:55:44.108970 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1462e17-daa3-4486-8c37-5edef7547a06 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:55:44.109459 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1462e17-daa3-4486-8c37-5edef7547a06 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:55:44.109571 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1462e17-daa3-4486-8c37-5edef7547a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:55:44.127243 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f1462e17-daa3-4486-8c37-5edef7547a06 None None] MFA Rules not processed for user `b87fe5fb6bf741e4a37b1513793a5082`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:55:44.128435 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f1462e17-daa3-4486-8c37-5edef7547a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:55:44.135205 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1391/2770] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:55:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:55:44.435095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1652f97-bbc1-4458-a66a-812e46ecbd36 service placement] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:55:44.453605 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1652f97-bbc1-4458-a66a-812e46ecbd36 service placement] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:55:44.457611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13b13f-5d30-4d15-b65a-d0bbdb4bfb0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:55:44.458353 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13b13f-5d30-4d15-b65a-d0bbdb4bfb0f service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:55:44.458678 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13b13f-5d30-4d15-b65a-d0bbdb4bfb0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:55:44.459013 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13b13f-5d30-4d15-b65a-d0bbdb4bfb0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:55:44.460742 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-bf13b13f-5d30-4d15-b65a-d0bbdb4bfb0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:55:44.484324 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13b13f-5d30-4d15-b65a-d0bbdb4bfb0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:55:44.486585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13b13f-5d30-4d15-b65a-d0bbdb4bfb0f service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:55:44.494639 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1380/2771] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:55:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:56:50.438836 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1462e17-daa3-4486-8c37-5edef7547a06 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:50.471208 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1462e17-daa3-4486-8c37-5edef7547a06 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:50.476539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab7275-8b84-4983-9358-7bd05a91866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:50.477419 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab7275-8b84-4983-9358-7bd05a91866b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:50.477707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab7275-8b84-4983-9358-7bd05a91866b admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:50.477984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab7275-8b84-4983-9358-7bd05a91866b admin admin] PATH_INFO: `/v3/users/b87fe5fb6bf741e4a37b1513793a5082` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:50.479339 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab7275-8b84-4983-9358-7bd05a91866b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b87fe5fb6bf741e4a37b1513793a5082)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:50.481281 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab7275-8b84-4983-9358-7bd05a91866b admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:50.530047 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f6ab7275-8b84-4983-9358-7bd05a91866b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b87fe5fb6bf741e4a37b1513793a5082'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:56:50.537299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f6ab7275-8b84-4983-9358-7bd05a91866b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b87fe5fb6bf741e4a37b1513793a5082'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:56:50.537958 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f6ab7275-8b84-4983-9358-7bd05a91866b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b87fe5fb6bf741e4a37b1513793a5082'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:56:50.538587 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f6ab7275-8b84-4983-9358-7bd05a91866b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b87fe5fb6bf741e4a37b1513793a5082'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:56:50.549643 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-f6ab7275-8b84-4983-9358-7bd05a91866b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b87fe5fb6bf741e4a37b1513793a5082'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:56:50.563858 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1392/2772] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:56:50 2022] DELETE /identity/v3/users/b87fe5fb6bf741e4a37b1513793a5082 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:56:50.730453 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13b13f-5d30-4d15-b65a-d0bbdb4bfb0f service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:50.742506 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13b13f-5d30-4d15-b65a-d0bbdb4bfb0f service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:50.797525 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d0d23-234e-478a-aedf-3c68f26bd38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:50.798412 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d0d23-234e-478a-aedf-3c68f26bd38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:50.798693 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d0d23-234e-478a-aedf-3c68f26bd38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:50.798966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d0d23-234e-478a-aedf-3c68f26bd38a admin admin] PATH_INFO: `/v3/projects/08e032d5a6c4470ab4739d8b63189a51` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:50.800128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d0d23-234e-478a-aedf-3c68f26bd38a admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e032d5a6c4470ab4739d8b63189a51)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:50.802111 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d0d23-234e-478a-aedf-3c68f26bd38a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:50.847217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-866d0d23-234e-478a-aedf-3c68f26bd38a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e032d5a6c4470ab4739d8b63189a51', 'request_id': 'req-866d0d23-234e-478a-aedf-3c68f26bd38a'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:56:50.853065 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-866d0d23-234e-478a-aedf-3c68f26bd38a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e032d5a6c4470ab4739d8b63189a51', 'request_id': 'req-866d0d23-234e-478a-aedf-3c68f26bd38a'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:56:50.858935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-866d0d23-234e-478a-aedf-3c68f26bd38a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e032d5a6c4470ab4739d8b63189a51', 'request_id': 'req-866d0d23-234e-478a-aedf-3c68f26bd38a'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:56:50.882241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-866d0d23-234e-478a-aedf-3c68f26bd38a admin admin] The token cache is being invalidate because project 08e032d5a6c4470ab4739d8b63189a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:56:50.882814 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-866d0d23-234e-478a-aedf-3c68f26bd38a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:56:50.883150 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-866d0d23-234e-478a-aedf-3c68f26bd38a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:56:50.884668 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1381/2773] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:56:50 2022] DELETE /identity/v3/projects/08e032d5a6c4470ab4739d8b63189a51 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:56:50.889755 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589a943-8a22-4e74-9024-9d4a8586b149 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:50.890041 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589a943-8a22-4e74-9024-9d4a8586b149 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:50.890354 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589a943-8a22-4e74-9024-9d4a8586b149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:50.944255 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-2589a943-8a22-4e74-9024-9d4a8586b149 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:56:50.945477 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-2589a943-8a22-4e74-9024-9d4a8586b149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:56:51.002176 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1393/2774] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:56:51.010094 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdb794-25a8-4edb-903a-dbc70458a110 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:51.010415 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdb794-25a8-4edb-903a-dbc70458a110 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:51.010697 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdb794-25a8-4edb-903a-dbc70458a110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:51.028616 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-36cdb794-25a8-4edb-903a-dbc70458a110 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:56:51.029804 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-36cdb794-25a8-4edb-903a-dbc70458a110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:56:51.038286 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1382/2775] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:56:51.042560 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589a943-8a22-4e74-9024-9d4a8586b149 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:51.052155 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589a943-8a22-4e74-9024-9d4a8586b149 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:51.056728 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad32269-ad9a-48b5-8181-9a723e9a98aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:51.057381 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad32269-ad9a-48b5-8181-9a723e9a98aa admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:51.057665 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad32269-ad9a-48b5-8181-9a723e9a98aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:51.057943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad32269-ad9a-48b5-8181-9a723e9a98aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:51.058705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad32269-ad9a-48b5-8181-9a723e9a98aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:56:51.059015 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad32269-ad9a-48b5-8181-9a723e9a98aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:51.060597 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad32269-ad9a-48b5-8181-9a723e9a98aa admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:51.071865 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1394/2776] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:56:51.076135 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdb794-25a8-4edb-903a-dbc70458a110 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:51.085594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdb794-25a8-4edb-903a-dbc70458a110 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:51.090136 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7408edb-d9ee-4c48-9718-b5ae82b2b3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:51.090799 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7408edb-d9ee-4c48-9718-b5ae82b2b3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:51.091080 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7408edb-d9ee-4c48-9718-b5ae82b2b3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:51.091352 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7408edb-d9ee-4c48-9718-b5ae82b2b3f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:51.092280 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7408edb-d9ee-4c48-9718-b5ae82b2b3f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:51.094142 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7408edb-d9ee-4c48-9718-b5ae82b2b3f3 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:51.119696 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1383/2777] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:56:51 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:56:51.123881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad32269-ad9a-48b5-8181-9a723e9a98aa admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:51.134196 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad32269-ad9a-48b5-8181-9a723e9a98aa admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:51.188710 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac909ff-385d-4baa-b73b-4cbf99a0bf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:51.189371 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac909ff-385d-4baa-b73b-4cbf99a0bf9e admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:51.189653 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac909ff-385d-4baa-b73b-4cbf99a0bf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:51.189924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac909ff-385d-4baa-b73b-4cbf99a0bf9e admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:51.190658 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac909ff-385d-4baa-b73b-4cbf99a0bf9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:51.193037 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac909ff-385d-4baa-b73b-4cbf99a0bf9e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:51.212784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1395/2778] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:56:51 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:56:51.217027 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7408edb-d9ee-4c48-9718-b5ae82b2b3f3 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:51.227466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7408edb-d9ee-4c48-9718-b5ae82b2b3f3 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:51.232033 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c1e1e-978f-4351-9b21-3f75e22a9da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:51.232681 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c1e1e-978f-4351-9b21-3f75e22a9da6 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:51.232977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c1e1e-978f-4351-9b21-3f75e22a9da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:51.233236 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c1e1e-978f-4351-9b21-3f75e22a9da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:51.233950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c1e1e-978f-4351-9b21-3f75e22a9da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:51.235581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c1e1e-978f-4351-9b21-3f75e22a9da6 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:51.245268 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1384/2779] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:56:51.248974 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac909ff-385d-4baa-b73b-4cbf99a0bf9e admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:51.259343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac909ff-385d-4baa-b73b-4cbf99a0bf9e admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:51.263955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756c362-5848-4e2c-bd64-fe396ece838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:51.264603 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756c362-5848-4e2c-bd64-fe396ece838a admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:51.264889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756c362-5848-4e2c-bd64-fe396ece838a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:51.265170 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756c362-5848-4e2c-bd64-fe396ece838a admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:51.265881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756c362-5848-4e2c-bd64-fe396ece838a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:51.267489 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756c362-5848-4e2c-bd64-fe396ece838a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:51.277838 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1396/2780] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:56:51.281874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c1e1e-978f-4351-9b21-3f75e22a9da6 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:51.292088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c1e1e-978f-4351-9b21-3f75e22a9da6 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:51.296637 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fc6c0-54c4-43e4-8caa-ba14e704ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:51.297501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fc6c0-54c4-43e4-8caa-ba14e704ec56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:51.297779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fc6c0-54c4-43e4-8caa-ba14e704ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:51.298052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fc6c0-54c4-43e4-8caa-ba14e704ec56 admin admin] PATH_INFO: `/v3/projects/57eea18962474951a78a5b3fccc8be82/users/1577623364174d58aa607eee3845e640/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:51.311832 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fc6c0-54c4-43e4-8caa-ba14e704ec56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57eea18962474951a78a5b3fccc8be82, user_id=1577623364174d58aa607eee3845e640, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:51.314457 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fc6c0-54c4-43e4-8caa-ba14e704ec56 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:51.327328 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1385/2781] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:56:51 2022] PUT /identity/v3/projects/57eea18962474951a78a5b3fccc8be82/users/1577623364174d58aa607eee3845e640/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:56:51.337892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36e062-ed26-49cd-b119-57ca4799af68 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:51.338189 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36e062-ed26-49cd-b119-57ca4799af68 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:51.338572 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36e062-ed26-49cd-b119-57ca4799af68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:51.371781 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-0e36e062-ed26-49cd-b119-57ca4799af68 None None] MFA Rules not processed for user `1577623364174d58aa607eee3845e640`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:56:51.372985 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0e36e062-ed26-49cd-b119-57ca4799af68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:56:51.445111 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1397/2782] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:56:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:56:51.447285 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fc6c0-54c4-43e4-8caa-ba14e704ec56 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:51.510611 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fc6c0-54c4-43e4-8caa-ba14e704ec56 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:51.516048 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb860f8-8809-42b3-b35f-cfbfcbe35e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:51.516714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb860f8-8809-42b3-b35f-cfbfcbe35e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:51.516990 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb860f8-8809-42b3-b35f-cfbfcbe35e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:51.517260 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb860f8-8809-42b3-b35f-cfbfcbe35e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:51.517941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb860f8-8809-42b3-b35f-cfbfcbe35e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:51.520128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb860f8-8809-42b3-b35f-cfbfcbe35e49 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:51.546954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1386/2783] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:56:51 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:56:51.552187 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36e062-ed26-49cd-b119-57ca4799af68 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:51.562704 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36e062-ed26-49cd-b119-57ca4799af68 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:51.617089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e57908-8a63-4fc3-bfb9-7499fe04529c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:51.617746 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e57908-8a63-4fc3-bfb9-7499fe04529c admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:51.618028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e57908-8a63-4fc3-bfb9-7499fe04529c admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:51.618336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e57908-8a63-4fc3-bfb9-7499fe04529c admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:51.619035 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e57908-8a63-4fc3-bfb9-7499fe04529c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:51.620903 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e57908-8a63-4fc3-bfb9-7499fe04529c admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:51.639839 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1398/2784] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:56:51 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:56:51.643865 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb860f8-8809-42b3-b35f-cfbfcbe35e49 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:51.654578 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb860f8-8809-42b3-b35f-cfbfcbe35e49 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:51.659119 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d42d59-f0a7-4e18-b83c-3a588984ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:51.659770 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d42d59-f0a7-4e18-b83c-3a588984ae00 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:51.660051 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d42d59-f0a7-4e18-b83c-3a588984ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:51.660976 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d42d59-f0a7-4e18-b83c-3a588984ae00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:51.661845 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d42d59-f0a7-4e18-b83c-3a588984ae00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:51.663466 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d42d59-f0a7-4e18-b83c-3a588984ae00 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:51.673685 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1387/2785] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:56:51.677818 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e57908-8a63-4fc3-bfb9-7499fe04529c admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:51.687432 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e57908-8a63-4fc3-bfb9-7499fe04529c admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:51.692049 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8c24c-8fd2-4714-8188-6dda8b4d20f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:51.692914 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8c24c-8fd2-4714-8188-6dda8b4d20f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:51.693195 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8c24c-8fd2-4714-8188-6dda8b4d20f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:51.693467 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8c24c-8fd2-4714-8188-6dda8b4d20f3 admin admin] PATH_INFO: `/v3/projects/03370c1aa5eb4eacbccdf95b188eb74a/users/f9179905c679428e968e9a087be9526c/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:51.708204 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8c24c-8fd2-4714-8188-6dda8b4d20f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03370c1aa5eb4eacbccdf95b188eb74a, user_id=f9179905c679428e968e9a087be9526c, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:51.710983 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8c24c-8fd2-4714-8188-6dda8b4d20f3 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:51.724325 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1399/2786] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:56:51 2022] PUT /identity/v3/projects/03370c1aa5eb4eacbccdf95b188eb74a/users/f9179905c679428e968e9a087be9526c/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:56:51.729460 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d42d59-f0a7-4e18-b83c-3a588984ae00 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:51.739306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d42d59-f0a7-4e18-b83c-3a588984ae00 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:51.793988 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffcf87-6674-4b7c-b01d-7ab43e5278d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:51.794687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffcf87-6674-4b7c-b01d-7ab43e5278d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:51.794976 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffcf87-6674-4b7c-b01d-7ab43e5278d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:51.795255 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffcf87-6674-4b7c-b01d-7ab43e5278d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:51.795971 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffcf87-6674-4b7c-b01d-7ab43e5278d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:51.797558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffcf87-6674-4b7c-b01d-7ab43e5278d7 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:51.807095 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1388/2787] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:56:51.811315 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8c24c-8fd2-4714-8188-6dda8b4d20f3 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:51.821736 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8c24c-8fd2-4714-8188-6dda8b4d20f3 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:51.826256 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9123666-b444-4659-8745-9f69e6c77300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:51.827127 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123666-b444-4659-8745-9f69e6c77300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:51.827407 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123666-b444-4659-8745-9f69e6c77300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:51.827680 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123666-b444-4659-8745-9f69e6c77300 admin admin] PATH_INFO: `/v3/projects/03370c1aa5eb4eacbccdf95b188eb74a/users/f9179905c679428e968e9a087be9526c/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:51.829615 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9123666-b444-4659-8745-9f69e6c77300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03370c1aa5eb4eacbccdf95b188eb74a, user_id=f9179905c679428e968e9a087be9526c, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:51.832788 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9123666-b444-4659-8745-9f69e6c77300 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:51.842782 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1400/2788] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:56:51 2022] PUT /identity/v3/projects/03370c1aa5eb4eacbccdf95b188eb74a/users/f9179905c679428e968e9a087be9526c/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:56:51.854381 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d364c2-dd41-42cc-9ca4-67c479848975 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:51.854675 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d364c2-dd41-42cc-9ca4-67c479848975 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:51.854955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d364c2-dd41-42cc-9ca4-67c479848975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:51.880620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-b0d364c2-dd41-42cc-9ca4-67c479848975 None None] MFA Rules not processed for user `f9179905c679428e968e9a087be9526c`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:56:51.881809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-b0d364c2-dd41-42cc-9ca4-67c479848975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:56:51.950929 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1389/2789] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:56:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:56:51.962942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9123666-b444-4659-8745-9f69e6c77300 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:51.964666 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b9123666-b444-4659-8745-9f69e6c77300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:56:52.041080 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9123666-b444-4659-8745-9f69e6c77300 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:52.044642 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9f752-153a-4b60-968e-f32168e3810b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:52.045274 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9f752-153a-4b60-968e-f32168e3810b service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:52.045552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9f752-153a-4b60-968e-f32168e3810b service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:52.045827 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9f752-153a-4b60-968e-f32168e3810b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:52.055099 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9f752-153a-4b60-968e-f32168e3810b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:52.056509 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9f752-153a-4b60-968e-f32168e3810b service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:52.065595 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1401/2790] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:56:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:56:52.136891 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d364c2-dd41-42cc-9ca4-67c479848975 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:56:52.147342 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d364c2-dd41-42cc-9ca4-67c479848975 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:56:52.150904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bcbdac-7136-4e4e-b9b3-d1d6db13c8be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:56:52.151535 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcbdac-7136-4e4e-b9b3-d1d6db13c8be service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:56:52.151815 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcbdac-7136-4e4e-b9b3-d1d6db13c8be service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:56:52.152089 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcbdac-7136-4e4e-b9b3-d1d6db13c8be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:56:52.205747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcbdac-7136-4e4e-b9b3-d1d6db13c8be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:56:52.207775 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcbdac-7136-4e4e-b9b3-d1d6db13c8be service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:56:52.216755 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1390/2791] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:56:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:57:30.085625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9f752-153a-4b60-968e-f32168e3810b service cinder] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:30.149559 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9f752-153a-4b60-968e-f32168e3810b service cinder] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:30.153979 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9d7f3-4dab-4272-9017-325f380079ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:30.154869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9d7f3-4dab-4272-9017-325f380079ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:30.155151 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9d7f3-4dab-4272-9017-325f380079ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:30.155423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9d7f3-4dab-4272-9017-325f380079ea admin admin] PATH_INFO: `/v3/users/1577623364174d58aa607eee3845e640` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:30.156585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9d7f3-4dab-4272-9017-325f380079ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1577623364174d58aa607eee3845e640)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:30.159018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9d7f3-4dab-4272-9017-325f380079ea admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:30.204419 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-86b9d7f3-4dab-4272-9017-325f380079ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1577623364174d58aa607eee3845e640'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:30.211056 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-86b9d7f3-4dab-4272-9017-325f380079ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1577623364174d58aa607eee3845e640'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:30.211719 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-86b9d7f3-4dab-4272-9017-325f380079ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1577623364174d58aa607eee3845e640'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:30.212351 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-86b9d7f3-4dab-4272-9017-325f380079ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1577623364174d58aa607eee3845e640'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:30.223767 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-86b9d7f3-4dab-4272-9017-325f380079ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1577623364174d58aa607eee3845e640'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:30.236637 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1402/2792] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:57:30 2022] DELETE /identity/v3/users/1577623364174d58aa607eee3845e640 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:30.241960 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be8131-e717-4968-b054-452a9d4d9449 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:30.242490 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be8131-e717-4968-b054-452a9d4d9449 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:30.242602 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be8131-e717-4968-b054-452a9d4d9449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:30.259290 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-93be8131-e717-4968-b054-452a9d4d9449 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:30.260516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-93be8131-e717-4968-b054-452a9d4d9449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:30.319486 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1391/2793] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:30.328969 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9d7f3-4dab-4272-9017-325f380079ea admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:30.330364 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-86b9d7f3-4dab-4272-9017-325f380079ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:30.386307 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9d7f3-4dab-4272-9017-325f380079ea admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:30.389837 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8f6c0-cd0d-4277-b66e-be7fbc91157a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:30.390525 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8f6c0-cd0d-4277-b66e-be7fbc91157a service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:30.390807 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8f6c0-cd0d-4277-b66e-be7fbc91157a service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:30.391086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8f6c0-cd0d-4277-b66e-be7fbc91157a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:30.399931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8f6c0-cd0d-4277-b66e-be7fbc91157a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:30.401339 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8f6c0-cd0d-4277-b66e-be7fbc91157a service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:30.410674 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1403/2794] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:57:30.671287 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be8131-e717-4968-b054-452a9d4d9449 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:30.672904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-93be8131-e717-4968-b054-452a9d4d9449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:30.689606 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be8131-e717-4968-b054-452a9d4d9449 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:30.695755 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a88348-0597-47a3-9bc6-b1af1483d498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:30.696728 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a88348-0597-47a3-9bc6-b1af1483d498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:30.696870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a88348-0597-47a3-9bc6-b1af1483d498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:30.697148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a88348-0597-47a3-9bc6-b1af1483d498 admin admin] PATH_INFO: `/v3/projects/57eea18962474951a78a5b3fccc8be82` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:30.698330 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a88348-0597-47a3-9bc6-b1af1483d498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57eea18962474951a78a5b3fccc8be82)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:30.700214 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a88348-0597-47a3-9bc6-b1af1483d498 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:30.745308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e8a88348-0597-47a3-9bc6-b1af1483d498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57eea18962474951a78a5b3fccc8be82', 'request_id': 'req-e8a88348-0597-47a3-9bc6-b1af1483d498'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:30.750601 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e8a88348-0597-47a3-9bc6-b1af1483d498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57eea18962474951a78a5b3fccc8be82', 'request_id': 'req-e8a88348-0597-47a3-9bc6-b1af1483d498'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:30.757364 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e8a88348-0597-47a3-9bc6-b1af1483d498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57eea18962474951a78a5b3fccc8be82', 'request_id': 'req-e8a88348-0597-47a3-9bc6-b1af1483d498'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:30.769780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e8a88348-0597-47a3-9bc6-b1af1483d498 admin admin] The token cache is being invalidate because project 57eea18962474951a78a5b3fccc8be82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:57:30.770067 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e8a88348-0597-47a3-9bc6-b1af1483d498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:30.770778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e8a88348-0597-47a3-9bc6-b1af1483d498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:30.772408 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1392/2795] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:57:30 2022] DELETE /identity/v3/projects/57eea18962474951a78a5b3fccc8be82 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 05 15:57:30.776513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8f6c0-cd0d-4277-b66e-be7fbc91157a service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:30.785964 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8f6c0-cd0d-4277-b66e-be7fbc91157a service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:30.839972 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041005e-d6b0-4024-bc79-3979e7e6d86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:30.840833 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041005e-d6b0-4024-bc79-3979e7e6d86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:30.841119 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041005e-d6b0-4024-bc79-3979e7e6d86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:30.841398 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041005e-d6b0-4024-bc79-3979e7e6d86a admin admin] PATH_INFO: `/v3/users/f9179905c679428e968e9a087be9526c` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:30.842924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041005e-d6b0-4024-bc79-3979e7e6d86a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9179905c679428e968e9a087be9526c)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:30.844761 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041005e-d6b0-4024-bc79-3979e7e6d86a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:30.888526 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e041005e-d6b0-4024-bc79-3979e7e6d86a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9179905c679428e968e9a087be9526c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:30.895032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e041005e-d6b0-4024-bc79-3979e7e6d86a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9179905c679428e968e9a087be9526c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:30.895712 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e041005e-d6b0-4024-bc79-3979e7e6d86a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9179905c679428e968e9a087be9526c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:30.896454 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e041005e-d6b0-4024-bc79-3979e7e6d86a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9179905c679428e968e9a087be9526c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:30.907724 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-e041005e-d6b0-4024-bc79-3979e7e6d86a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9179905c679428e968e9a087be9526c'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:30.920361 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1404/2796] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:57:30 2022] DELETE /identity/v3/users/f9179905c679428e968e9a087be9526c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:31.185478 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a88348-0597-47a3-9bc6-b1af1483d498 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:31.187052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e8a88348-0597-47a3-9bc6-b1af1483d498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:31.201397 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a88348-0597-47a3-9bc6-b1af1483d498 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:31.257257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2b411-7cce-4fed-8395-5d10f86650e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:31.258108 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2b411-7cce-4fed-8395-5d10f86650e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:31.258419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2b411-7cce-4fed-8395-5d10f86650e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:31.258692 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2b411-7cce-4fed-8395-5d10f86650e0 admin admin] PATH_INFO: `/v3/projects/03370c1aa5eb4eacbccdf95b188eb74a` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:31.259851 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2b411-7cce-4fed-8395-5d10f86650e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03370c1aa5eb4eacbccdf95b188eb74a)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:31.261843 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2b411-7cce-4fed-8395-5d10f86650e0 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:31.306085 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-96d2b411-7cce-4fed-8395-5d10f86650e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03370c1aa5eb4eacbccdf95b188eb74a', 'request_id': 'req-96d2b411-7cce-4fed-8395-5d10f86650e0'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:31.311285 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-96d2b411-7cce-4fed-8395-5d10f86650e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03370c1aa5eb4eacbccdf95b188eb74a', 'request_id': 'req-96d2b411-7cce-4fed-8395-5d10f86650e0'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:31.317156 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-96d2b411-7cce-4fed-8395-5d10f86650e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03370c1aa5eb4eacbccdf95b188eb74a', 'request_id': 'req-96d2b411-7cce-4fed-8395-5d10f86650e0'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:31.329305 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-96d2b411-7cce-4fed-8395-5d10f86650e0 admin admin] The token cache is being invalidate because project 03370c1aa5eb4eacbccdf95b188eb74a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:57:31.329585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-96d2b411-7cce-4fed-8395-5d10f86650e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:31.330209 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-96d2b411-7cce-4fed-8395-5d10f86650e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:31.331753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1393/2797] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:57:31 2022] DELETE /identity/v3/projects/03370c1aa5eb4eacbccdf95b188eb74a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:31.337456 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e268e-cd68-4744-bb75-c216fc577288 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:31.337922 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e268e-cd68-4744-bb75-c216fc577288 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:31.338039 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e268e-cd68-4744-bb75-c216fc577288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:31.355871 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ee7e268e-cd68-4744-bb75-c216fc577288 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:31.357053 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ee7e268e-cd68-4744-bb75-c216fc577288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:31.415326 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1405/2798] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:31.423358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858b9bf-26cf-4bd1-84c0-08dd343163be None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:31.423645 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858b9bf-26cf-4bd1-84c0-08dd343163be None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:31.423922 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858b9bf-26cf-4bd1-84c0-08dd343163be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:31.441570 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-6858b9bf-26cf-4bd1-84c0-08dd343163be None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:31.442991 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-6858b9bf-26cf-4bd1-84c0-08dd343163be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:31.452047 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1394/2799] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:31.456073 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e268e-cd68-4744-bb75-c216fc577288 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:31.466025 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e268e-cd68-4744-bb75-c216fc577288 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:31.470784 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e711e-e56b-46a8-bd8d-c39fe49274ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:31.471427 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e711e-e56b-46a8-bd8d-c39fe49274ed admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:31.471703 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e711e-e56b-46a8-bd8d-c39fe49274ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:31.471982 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e711e-e56b-46a8-bd8d-c39fe49274ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:31.472696 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e711e-e56b-46a8-bd8d-c39fe49274ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:57:31.472997 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e711e-e56b-46a8-bd8d-c39fe49274ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:31.475195 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e711e-e56b-46a8-bd8d-c39fe49274ed admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:31.486350 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1406/2800] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:57:31.490548 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858b9bf-26cf-4bd1-84c0-08dd343163be None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:31.499640 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858b9bf-26cf-4bd1-84c0-08dd343163be None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:31.504251 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebc443-f847-4c69-9fbc-134c924a1b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:31.504900 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc443-f847-4c69-9fbc-134c924a1b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:31.505186 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc443-f847-4c69-9fbc-134c924a1b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:31.505673 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc443-f847-4c69-9fbc-134c924a1b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:31.506272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebc443-f847-4c69-9fbc-134c924a1b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:31.508232 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebc443-f847-4c69-9fbc-134c924a1b3d admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:31.536449 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1395/2801] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:57:31 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:57:31.539606 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e711e-e56b-46a8-bd8d-c39fe49274ed admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:31.549931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e711e-e56b-46a8-bd8d-c39fe49274ed admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:31.604667 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eee9a7-10ef-4298-ab44-525660d84157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:31.605321 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eee9a7-10ef-4298-ab44-525660d84157 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:31.605600 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eee9a7-10ef-4298-ab44-525660d84157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:31.605872 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eee9a7-10ef-4298-ab44-525660d84157 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:31.606585 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eee9a7-10ef-4298-ab44-525660d84157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:31.608482 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eee9a7-10ef-4298-ab44-525660d84157 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:31.627828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1407/2802] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:57:31 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:57:31.632405 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebc443-f847-4c69-9fbc-134c924a1b3d admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:31.642312 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebc443-f847-4c69-9fbc-134c924a1b3d admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:31.647574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d66ba-9e0f-41a2-b396-bbfd3c3d490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:31.648197 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d66ba-9e0f-41a2-b396-bbfd3c3d490e admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:31.648477 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d66ba-9e0f-41a2-b396-bbfd3c3d490e admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:31.648751 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d66ba-9e0f-41a2-b396-bbfd3c3d490e admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:31.649462 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d66ba-9e0f-41a2-b396-bbfd3c3d490e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:31.651071 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d66ba-9e0f-41a2-b396-bbfd3c3d490e admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:31.661094 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1396/2803] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:57:31.665147 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eee9a7-10ef-4298-ab44-525660d84157 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:31.674903 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eee9a7-10ef-4298-ab44-525660d84157 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:31.679398 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02007680-f336-4bae-bc40-970d27104975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:31.680047 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02007680-f336-4bae-bc40-970d27104975 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:31.680328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02007680-f336-4bae-bc40-970d27104975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:31.680601 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02007680-f336-4bae-bc40-970d27104975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:31.681317 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02007680-f336-4bae-bc40-970d27104975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:31.682914 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02007680-f336-4bae-bc40-970d27104975 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:31.692364 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1408/2804] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:57:31.696864 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d66ba-9e0f-41a2-b396-bbfd3c3d490e admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:31.706855 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d66ba-9e0f-41a2-b396-bbfd3c3d490e admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:31.712417 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaa271-7ce8-49d2-b353-29bcfe01f3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:31.713281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaa271-7ce8-49d2-b353-29bcfe01f3da admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:31.713563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaa271-7ce8-49d2-b353-29bcfe01f3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:31.713840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaa271-7ce8-49d2-b353-29bcfe01f3da admin admin] PATH_INFO: `/v3/projects/777581a80246426ead8fef3d5a517baa/users/629943e2a8054161985230b2ef5a5f9b/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:31.728382 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaa271-7ce8-49d2-b353-29bcfe01f3da admin admin] RBAC: Authorizing `identity:create_grant(project_id=777581a80246426ead8fef3d5a517baa, user_id=629943e2a8054161985230b2ef5a5f9b, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:31.731099 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaa271-7ce8-49d2-b353-29bcfe01f3da admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:31.743778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1397/2805] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:57:31 2022] PUT /identity/v3/projects/777581a80246426ead8fef3d5a517baa/users/629943e2a8054161985230b2ef5a5f9b/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:31.801902 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461d323-e94a-4312-9b4e-c5c3ca54f8f8 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:31.802223 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461d323-e94a-4312-9b4e-c5c3ca54f8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:31.802518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461d323-e94a-4312-9b4e-c5c3ca54f8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:31.834650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-c461d323-e94a-4312-9b4e-c5c3ca54f8f8 None None] MFA Rules not processed for user `629943e2a8054161985230b2ef5a5f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:31.835865 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c461d323-e94a-4312-9b4e-c5c3ca54f8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:31.898079 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1409/2806] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:31.902768 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaa271-7ce8-49d2-b353-29bcfe01f3da admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:31.961527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaa271-7ce8-49d2-b353-29bcfe01f3da admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:31.965996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ad444-50cd-41c3-8e06-44048eb773b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:31.966674 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ad444-50cd-41c3-8e06-44048eb773b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:31.966955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ad444-50cd-41c3-8e06-44048eb773b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:31.967604 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ad444-50cd-41c3-8e06-44048eb773b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:31.968283 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ad444-50cd-41c3-8e06-44048eb773b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:31.970208 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ad444-50cd-41c3-8e06-44048eb773b8 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:31.994562 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1398/2807] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:57:31 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:57:31.998691 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461d323-e94a-4312-9b4e-c5c3ca54f8f8 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:32.009768 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461d323-e94a-4312-9b4e-c5c3ca54f8f8 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:32.063562 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182d8ad-d1bc-4a3e-89f5-a04731f915fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:32.064224 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182d8ad-d1bc-4a3e-89f5-a04731f915fb admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:32.064507 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182d8ad-d1bc-4a3e-89f5-a04731f915fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:32.064778 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182d8ad-d1bc-4a3e-89f5-a04731f915fb admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:32.065468 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182d8ad-d1bc-4a3e-89f5-a04731f915fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:32.067386 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182d8ad-d1bc-4a3e-89f5-a04731f915fb admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:32.086777 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1410/2808] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:57:31 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:57:32.091499 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ad444-50cd-41c3-8e06-44048eb773b8 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:32.102809 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ad444-50cd-41c3-8e06-44048eb773b8 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:32.108654 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da41724-2569-4f74-aa51-9a9777bb1149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:32.109312 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da41724-2569-4f74-aa51-9a9777bb1149 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:32.109596 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da41724-2569-4f74-aa51-9a9777bb1149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:32.109897 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da41724-2569-4f74-aa51-9a9777bb1149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:32.110653 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da41724-2569-4f74-aa51-9a9777bb1149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:32.112241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da41724-2569-4f74-aa51-9a9777bb1149 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:32.123806 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1399/2809] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:57:32.128166 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182d8ad-d1bc-4a3e-89f5-a04731f915fb admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:32.138844 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182d8ad-d1bc-4a3e-89f5-a04731f915fb admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:32.143437 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246e3b6-6b8d-4b82-9550-b2c07f107fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:32.144329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246e3b6-6b8d-4b82-9550-b2c07f107fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:32.144613 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246e3b6-6b8d-4b82-9550-b2c07f107fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:32.144891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246e3b6-6b8d-4b82-9550-b2c07f107fc8 admin admin] PATH_INFO: `/v3/projects/aae955b1da9d4605b27abf1324a0f97d/users/54f37b1248104d8eb312716e9d9a9aad/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:32.159583 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246e3b6-6b8d-4b82-9550-b2c07f107fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae955b1da9d4605b27abf1324a0f97d, user_id=54f37b1248104d8eb312716e9d9a9aad, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:32.162443 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246e3b6-6b8d-4b82-9550-b2c07f107fc8 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:32.175092 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1411/2810] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:57:32 2022] PUT /identity/v3/projects/aae955b1da9d4605b27abf1324a0f97d/users/54f37b1248104d8eb312716e9d9a9aad/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:32.179745 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da41724-2569-4f74-aa51-9a9777bb1149 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:32.189489 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da41724-2569-4f74-aa51-9a9777bb1149 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:32.243614 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575eee94-825d-42f4-a456-95ff08f6f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:32.244196 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eee94-825d-42f4-a456-95ff08f6f543 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:32.244478 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eee94-825d-42f4-a456-95ff08f6f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:32.244779 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eee94-825d-42f4-a456-95ff08f6f543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:32.245482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575eee94-825d-42f4-a456-95ff08f6f543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:32.247122 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575eee94-825d-42f4-a456-95ff08f6f543 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:32.257422 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1400/2811] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:57:32.261552 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246e3b6-6b8d-4b82-9550-b2c07f107fc8 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:32.272594 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246e3b6-6b8d-4b82-9550-b2c07f107fc8 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:32.277206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dea61-300f-4ac7-93c1-29462e9dbb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:32.278079 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dea61-300f-4ac7-93c1-29462e9dbb27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:32.278389 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dea61-300f-4ac7-93c1-29462e9dbb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:32.278662 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dea61-300f-4ac7-93c1-29462e9dbb27 admin admin] PATH_INFO: `/v3/projects/aae955b1da9d4605b27abf1324a0f97d/users/54f37b1248104d8eb312716e9d9a9aad/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:32.280621 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301dea61-300f-4ac7-93c1-29462e9dbb27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae955b1da9d4605b27abf1324a0f97d, user_id=54f37b1248104d8eb312716e9d9a9aad, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:32.283247 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301dea61-300f-4ac7-93c1-29462e9dbb27 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:32.293328 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1412/2812] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:57:32 2022] PUT /identity/v3/projects/aae955b1da9d4605b27abf1324a0f97d/users/54f37b1248104d8eb312716e9d9a9aad/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:32.304026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6adc31-4b20-4dc2-a6e7-b6b3c5f51c9f None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:32.304313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6adc31-4b20-4dc2-a6e7-b6b3c5f51c9f None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:32.304585 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6adc31-4b20-4dc2-a6e7-b6b3c5f51c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:32.330382 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-ad6adc31-4b20-4dc2-a6e7-b6b3c5f51c9f None None] MFA Rules not processed for user `54f37b1248104d8eb312716e9d9a9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:32.331573 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-ad6adc31-4b20-4dc2-a6e7-b6b3c5f51c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:32.397269 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1401/2813] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:32.408455 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dea61-300f-4ac7-93c1-29462e9dbb27 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:32.410146 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-301dea61-300f-4ac7-93c1-29462e9dbb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:32.465251 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dea61-300f-4ac7-93c1-29462e9dbb27 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:32.469160 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f769c11-a3bc-49d9-a883-b02c351c2724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:32.469794 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f769c11-a3bc-49d9-a883-b02c351c2724 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:32.470079 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f769c11-a3bc-49d9-a883-b02c351c2724 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:32.470386 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f769c11-a3bc-49d9-a883-b02c351c2724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:32.479943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f769c11-a3bc-49d9-a883-b02c351c2724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:32.481362 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f769c11-a3bc-49d9-a883-b02c351c2724 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:32.491487 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1413/2814] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:57:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:57:32.555855 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6adc31-4b20-4dc2-a6e7-b6b3c5f51c9f None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:32.617713 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6adc31-4b20-4dc2-a6e7-b6b3c5f51c9f None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:32.622294 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1bae9-16b2-464f-a43b-891e4e82a864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:32.623146 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1bae9-16b2-464f-a43b-891e4e82a864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:32.623431 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1bae9-16b2-464f-a43b-891e4e82a864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:32.623707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1bae9-16b2-464f-a43b-891e4e82a864 admin admin] PATH_INFO: `/v3/users/629943e2a8054161985230b2ef5a5f9b` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:32.624897 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1bae9-16b2-464f-a43b-891e4e82a864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=629943e2a8054161985230b2ef5a5f9b)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:32.626828 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1bae9-16b2-464f-a43b-891e4e82a864 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:32.670762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e3e1bae9-16b2-464f-a43b-891e4e82a864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '629943e2a8054161985230b2ef5a5f9b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:32.671406 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e3e1bae9-16b2-464f-a43b-891e4e82a864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '629943e2a8054161985230b2ef5a5f9b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:32.679184 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e3e1bae9-16b2-464f-a43b-891e4e82a864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '629943e2a8054161985230b2ef5a5f9b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:32.685762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e3e1bae9-16b2-464f-a43b-891e4e82a864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '629943e2a8054161985230b2ef5a5f9b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:32.686424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-e3e1bae9-16b2-464f-a43b-891e4e82a864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '629943e2a8054161985230b2ef5a5f9b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:32.702846 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1402/2815] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:57:32 2022] DELETE /identity/v3/users/629943e2a8054161985230b2ef5a5f9b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:32.707310 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f715a-12d9-4897-9295-0e8dac835f2d None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:32.707607 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f715a-12d9-4897-9295-0e8dac835f2d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:32.707889 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f715a-12d9-4897-9295-0e8dac835f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:32.725984 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-563f715a-12d9-4897-9295-0e8dac835f2d None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:32.727249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-563f715a-12d9-4897-9295-0e8dac835f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:32.782449 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1414/2816] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:32.792282 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1bae9-16b2-464f-a43b-891e4e82a864 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:32.793654 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e3e1bae9-16b2-464f-a43b-891e4e82a864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:32.848389 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1bae9-16b2-464f-a43b-891e4e82a864 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:32.852249 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ed2db-e037-494c-a29f-89e076b68c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:32.852888 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ed2db-e037-494c-a29f-89e076b68c1f service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:32.853164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ed2db-e037-494c-a29f-89e076b68c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:32.853433 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ed2db-e037-494c-a29f-89e076b68c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:32.862676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ed2db-e037-494c-a29f-89e076b68c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:32.864096 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ed2db-e037-494c-a29f-89e076b68c1f service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:32.873842 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1403/2817] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:57:33.137765 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f715a-12d9-4897-9295-0e8dac835f2d None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:33.137765 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-563f715a-12d9-4897-9295-0e8dac835f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:33.149915 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f715a-12d9-4897-9295-0e8dac835f2d None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:33.155244 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:33.155708 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:33.156021 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:33.156293 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a admin admin] PATH_INFO: `/v3/projects/777581a80246426ead8fef3d5a517baa` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:33.157511 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a admin admin] RBAC: Authorizing `identity:delete_project(project_id=777581a80246426ead8fef3d5a517baa)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:33.159434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:33.212048 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777581a80246426ead8fef3d5a517baa', 'request_id': 'req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:33.217146 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777581a80246426ead8fef3d5a517baa', 'request_id': 'req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:33.223178 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777581a80246426ead8fef3d5a517baa', 'request_id': 'req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:33.235163 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a admin admin] The token cache is being invalidate because project 777581a80246426ead8fef3d5a517baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:57:33.235438 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:33.236117 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:33.237655 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1415/2818] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:57:33 2022] DELETE /identity/v3/projects/777581a80246426ead8fef3d5a517baa => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:33.242270 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ed2db-e037-494c-a29f-89e076b68c1f service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:33.251714 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ed2db-e037-494c-a29f-89e076b68c1f service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:33.310641 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbd34a-8d4f-4a21-8e57-f05d10076eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:33.311418 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbd34a-8d4f-4a21-8e57-f05d10076eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:33.311694 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbd34a-8d4f-4a21-8e57-f05d10076eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:33.311966 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbd34a-8d4f-4a21-8e57-f05d10076eff admin admin] PATH_INFO: `/v3/users/54f37b1248104d8eb312716e9d9a9aad` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:33.313150 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbd34a-8d4f-4a21-8e57-f05d10076eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f37b1248104d8eb312716e9d9a9aad)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:33.315145 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbd34a-8d4f-4a21-8e57-f05d10076eff admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:33.360167 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-62cbd34a-8d4f-4a21-8e57-f05d10076eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f37b1248104d8eb312716e9d9a9aad'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:33.360817 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-62cbd34a-8d4f-4a21-8e57-f05d10076eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f37b1248104d8eb312716e9d9a9aad'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:33.368306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-62cbd34a-8d4f-4a21-8e57-f05d10076eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f37b1248104d8eb312716e9d9a9aad'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:33.375043 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-62cbd34a-8d4f-4a21-8e57-f05d10076eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f37b1248104d8eb312716e9d9a9aad'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:33.375665 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-62cbd34a-8d4f-4a21-8e57-f05d10076eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f37b1248104d8eb312716e9d9a9aad'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:33.392478 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1404/2819] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:57:33 2022] DELETE /identity/v3/users/54f37b1248104d8eb312716e9d9a9aad => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:33.654294 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:33.655730 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:33.668465 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fea33-c77c-42f2-8cbe-9b91efe4560a admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:33.727492 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1008ee-4ca2-46da-91f8-b839a40b6178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:33.728349 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1008ee-4ca2-46da-91f8-b839a40b6178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:33.728630 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1008ee-4ca2-46da-91f8-b839a40b6178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:33.728905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1008ee-4ca2-46da-91f8-b839a40b6178 admin admin] PATH_INFO: `/v3/projects/aae955b1da9d4605b27abf1324a0f97d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:33.730075 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1008ee-4ca2-46da-91f8-b839a40b6178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae955b1da9d4605b27abf1324a0f97d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:33.731987 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1008ee-4ca2-46da-91f8-b839a40b6178 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:33.777896 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3a1008ee-4ca2-46da-91f8-b839a40b6178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae955b1da9d4605b27abf1324a0f97d', 'request_id': 'req-3a1008ee-4ca2-46da-91f8-b839a40b6178'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:33.783005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3a1008ee-4ca2-46da-91f8-b839a40b6178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae955b1da9d4605b27abf1324a0f97d', 'request_id': 'req-3a1008ee-4ca2-46da-91f8-b839a40b6178'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:33.789093 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3a1008ee-4ca2-46da-91f8-b839a40b6178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae955b1da9d4605b27abf1324a0f97d', 'request_id': 'req-3a1008ee-4ca2-46da-91f8-b839a40b6178'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:33.800951 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3a1008ee-4ca2-46da-91f8-b839a40b6178 admin admin] The token cache is being invalidate because project aae955b1da9d4605b27abf1324a0f97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:57:33.801253 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3a1008ee-4ca2-46da-91f8-b839a40b6178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:33.801854 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-3a1008ee-4ca2-46da-91f8-b839a40b6178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:33.804057 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1416/2820] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:57:33 2022] DELETE /identity/v3/projects/aae955b1da9d4605b27abf1324a0f97d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:33.808965 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201213d-fc1d-40cd-ab5d-e726fb03b825 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:33.809257 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201213d-fc1d-40cd-ab5d-e726fb03b825 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:33.809531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201213d-fc1d-40cd-ab5d-e726fb03b825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:33.826901 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-a201213d-fc1d-40cd-ab5d-e726fb03b825 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:33.828107 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-a201213d-fc1d-40cd-ab5d-e726fb03b825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:33.884738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1405/2821] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:33.892478 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f1975-f780-41c7-80fb-1ff03823a654 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:33.892795 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f1975-f780-41c7-80fb-1ff03823a654 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:33.893074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f1975-f780-41c7-80fb-1ff03823a654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:33.913005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-659f1975-f780-41c7-80fb-1ff03823a654 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:33.914430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-659f1975-f780-41c7-80fb-1ff03823a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:33.922088 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1417/2822] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:57:33.926052 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201213d-fc1d-40cd-ab5d-e726fb03b825 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:33.936049 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201213d-fc1d-40cd-ab5d-e726fb03b825 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:33.940498 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50fd0e-cfe0-4911-9b72-075031a98c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:33.941134 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50fd0e-cfe0-4911-9b72-075031a98c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:33.941414 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50fd0e-cfe0-4911-9b72-075031a98c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:33.941687 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50fd0e-cfe0-4911-9b72-075031a98c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:33.942434 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50fd0e-cfe0-4911-9b72-075031a98c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:57:33.942772 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50fd0e-cfe0-4911-9b72-075031a98c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:33.944345 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50fd0e-cfe0-4911-9b72-075031a98c64 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:33.955501 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1406/2823] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:57:33.959817 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f1975-f780-41c7-80fb-1ff03823a654 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:33.969008 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f1975-f780-41c7-80fb-1ff03823a654 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:33.973539 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174ab68-8414-4d56-bea5-a4a7dc54b1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:33.974857 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174ab68-8414-4d56-bea5-a4a7dc54b1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:33.975141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174ab68-8414-4d56-bea5-a4a7dc54b1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:33.975414 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174ab68-8414-4d56-bea5-a4a7dc54b1e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:33.976109 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174ab68-8414-4d56-bea5-a4a7dc54b1e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:33.977962 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174ab68-8414-4d56-bea5-a4a7dc54b1e3 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:34.002721 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1418/2824] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:57:33 2022] POST /identity/v3/projects => generated 409 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:57:34.006893 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50fd0e-cfe0-4911-9b72-075031a98c64 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:34.016492 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50fd0e-cfe0-4911-9b72-075031a98c64 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:34.071740 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a7177-910f-41e3-b204-355d7388ea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:34.072403 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a7177-910f-41e3-b204-355d7388ea5a admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:34.072684 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a7177-910f-41e3-b204-355d7388ea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:34.072956 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a7177-910f-41e3-b204-355d7388ea5a admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:34.073637 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a7177-910f-41e3-b204-355d7388ea5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:34.075571 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a7177-910f-41e3-b204-355d7388ea5a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:34.094201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1407/2825] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:57:34 2022] POST /identity/v3/users => generated 305 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:57:34.098270 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174ab68-8414-4d56-bea5-a4a7dc54b1e3 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:34.109043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174ab68-8414-4d56-bea5-a4a7dc54b1e3 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:34.113529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253ea21-0bfe-472f-9a19-f072911d75ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:34.114209 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253ea21-0bfe-472f-9a19-f072911d75ee admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:34.114494 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253ea21-0bfe-472f-9a19-f072911d75ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:34.115386 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253ea21-0bfe-472f-9a19-f072911d75ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:34.116291 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253ea21-0bfe-472f-9a19-f072911d75ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:34.117860 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253ea21-0bfe-472f-9a19-f072911d75ee admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:34.127969 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1419/2826] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:57:34.131996 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a7177-910f-41e3-b204-355d7388ea5a admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:34.141885 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a7177-910f-41e3-b204-355d7388ea5a admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:34.146556 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b18289-1627-4a66-8f9e-ea94d0f98030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:34.147200 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b18289-1627-4a66-8f9e-ea94d0f98030 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:34.147482 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b18289-1627-4a66-8f9e-ea94d0f98030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:34.147757 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b18289-1627-4a66-8f9e-ea94d0f98030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:34.148499 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b18289-1627-4a66-8f9e-ea94d0f98030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:34.150072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b18289-1627-4a66-8f9e-ea94d0f98030 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:34.160287 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1408/2827] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:57:34.164936 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253ea21-0bfe-472f-9a19-f072911d75ee admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:34.174678 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253ea21-0bfe-472f-9a19-f072911d75ee admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:34.180054 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3f1b1-4c3b-4cb6-a734-9f690620a3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:34.180924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3f1b1-4c3b-4cb6-a734-9f690620a3ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:34.181202 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3f1b1-4c3b-4cb6-a734-9f690620a3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:34.181474 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3f1b1-4c3b-4cb6-a734-9f690620a3ce admin admin] PATH_INFO: `/v3/projects/203025de56c64599a3677028c6b0467d/users/d734745cd8d9482ca257ac1ad3d6d86b/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:34.195599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3f1b1-4c3b-4cb6-a734-9f690620a3ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=203025de56c64599a3677028c6b0467d, user_id=d734745cd8d9482ca257ac1ad3d6d86b, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:34.198317 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3f1b1-4c3b-4cb6-a734-9f690620a3ce admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:34.211437 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1420/2828] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:57:34 2022] PUT /identity/v3/projects/203025de56c64599a3677028c6b0467d/users/d734745cd8d9482ca257ac1ad3d6d86b/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:34.222747 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce1256-7abd-40c3-90d1-5a7fb5067fc1 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:34.223037 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce1256-7abd-40c3-90d1-5a7fb5067fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:34.223344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce1256-7abd-40c3-90d1-5a7fb5067fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:34.249463 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-30ce1256-7abd-40c3-90d1-5a7fb5067fc1 None None] MFA Rules not processed for user `d734745cd8d9482ca257ac1ad3d6d86b`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:34.250725 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-30ce1256-7abd-40c3-90d1-5a7fb5067fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:34.311911 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1409/2829] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:34.316472 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3f1b1-4c3b-4cb6-a734-9f690620a3ce admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:34.378272 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3f1b1-4c3b-4cb6-a734-9f690620a3ce admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:34.384986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfdfa4-5f2a-449e-93bc-fde783f6ae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:34.385683 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfdfa4-5f2a-449e-93bc-fde783f6ae53 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:34.386094 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfdfa4-5f2a-449e-93bc-fde783f6ae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:34.386400 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfdfa4-5f2a-449e-93bc-fde783f6ae53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:34.387101 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfdfa4-5f2a-449e-93bc-fde783f6ae53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:34.389062 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfdfa4-5f2a-449e-93bc-fde783f6ae53 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:34.416332 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1421/2830] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:57:34 2022] POST /identity/v3/projects => generated 409 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:57:34.420440 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce1256-7abd-40c3-90d1-5a7fb5067fc1 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:34.431793 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce1256-7abd-40c3-90d1-5a7fb5067fc1 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:34.485603 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4c3d0-ae14-43e2-8ef9-18b84b05dc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:34.486296 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4c3d0-ae14-43e2-8ef9-18b84b05dc62 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:34.486584 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4c3d0-ae14-43e2-8ef9-18b84b05dc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:34.486858 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4c3d0-ae14-43e2-8ef9-18b84b05dc62 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:34.487532 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4c3d0-ae14-43e2-8ef9-18b84b05dc62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:34.489428 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4c3d0-ae14-43e2-8ef9-18b84b05dc62 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:34.510272 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1410/2831] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:57:34 2022] POST /identity/v3/users => generated 311 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:57:34.514009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfdfa4-5f2a-449e-93bc-fde783f6ae53 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:34.524388 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfdfa4-5f2a-449e-93bc-fde783f6ae53 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:34.528892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4ab2a-3797-4bf8-a0b4-21e5e596c9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:34.529569 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4ab2a-3797-4bf8-a0b4-21e5e596c9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:34.529849 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4ab2a-3797-4bf8-a0b4-21e5e596c9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:34.530121 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4ab2a-3797-4bf8-a0b4-21e5e596c9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:34.530881 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4ab2a-3797-4bf8-a0b4-21e5e596c9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:34.532446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4ab2a-3797-4bf8-a0b4-21e5e596c9b7 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:34.542787 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1422/2832] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:57:34.546884 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4c3d0-ae14-43e2-8ef9-18b84b05dc62 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:34.558146 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4c3d0-ae14-43e2-8ef9-18b84b05dc62 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:34.562717 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acf7bc-8097-4e40-9754-d5b69f389f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:34.563581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acf7bc-8097-4e40-9754-d5b69f389f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:34.563865 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acf7bc-8097-4e40-9754-d5b69f389f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:34.564172 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acf7bc-8097-4e40-9754-d5b69f389f4c admin admin] PATH_INFO: `/v3/projects/788a004789184f38baf8e0d14b85b807/users/471431db28d9455c96ade8cfeb6ed2bf/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:34.578951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acf7bc-8097-4e40-9754-d5b69f389f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=788a004789184f38baf8e0d14b85b807, user_id=471431db28d9455c96ade8cfeb6ed2bf, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:34.581566 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acf7bc-8097-4e40-9754-d5b69f389f4c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:34.594648 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1411/2833] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:57:34 2022] PUT /identity/v3/projects/788a004789184f38baf8e0d14b85b807/users/471431db28d9455c96ade8cfeb6ed2bf/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:34.598598 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4ab2a-3797-4bf8-a0b4-21e5e596c9b7 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:34.608648 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4ab2a-3797-4bf8-a0b4-21e5e596c9b7 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:34.662304 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73daa779-542d-4e93-9e39-1f71812d41f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:34.662997 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73daa779-542d-4e93-9e39-1f71812d41f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:34.663323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73daa779-542d-4e93-9e39-1f71812d41f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:34.663625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73daa779-542d-4e93-9e39-1f71812d41f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:34.664340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73daa779-542d-4e93-9e39-1f71812d41f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:34.666546 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73daa779-542d-4e93-9e39-1f71812d41f7 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:34.676150 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1423/2834] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:57:34.680958 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acf7bc-8097-4e40-9754-d5b69f389f4c admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:34.691026 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acf7bc-8097-4e40-9754-d5b69f389f4c admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:34.695886 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7781428-2260-4d62-a2da-3ca841ae471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:34.696752 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7781428-2260-4d62-a2da-3ca841ae471f admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:34.697031 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7781428-2260-4d62-a2da-3ca841ae471f admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:34.697306 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7781428-2260-4d62-a2da-3ca841ae471f admin admin] PATH_INFO: `/v3/projects/788a004789184f38baf8e0d14b85b807/users/471431db28d9455c96ade8cfeb6ed2bf/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:34.699295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7781428-2260-4d62-a2da-3ca841ae471f admin admin] RBAC: Authorizing `identity:create_grant(project_id=788a004789184f38baf8e0d14b85b807, user_id=471431db28d9455c96ade8cfeb6ed2bf, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:34.701908 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7781428-2260-4d62-a2da-3ca841ae471f admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:34.711890 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1412/2835] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:57:34 2022] PUT /identity/v3/projects/788a004789184f38baf8e0d14b85b807/users/471431db28d9455c96ade8cfeb6ed2bf/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:34.721998 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699c42a-5211-4261-be15-bdbc0976569a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:34.722329 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699c42a-5211-4261-be15-bdbc0976569a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:34.722608 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699c42a-5211-4261-be15-bdbc0976569a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:34.751794 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-0699c42a-5211-4261-be15-bdbc0976569a None None] MFA Rules not processed for user `471431db28d9455c96ade8cfeb6ed2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:34.753032 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0699c42a-5211-4261-be15-bdbc0976569a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:34.819971 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1424/2836] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:34.830404 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7781428-2260-4d62-a2da-3ca841ae471f admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:34.832107 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-e7781428-2260-4d62-a2da-3ca841ae471f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:34.888536 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7781428-2260-4d62-a2da-3ca841ae471f admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:34.892101 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1278d-3c52-4e61-8bac-617826a16bb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:34.892731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1278d-3c52-4e61-8bac-617826a16bb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:34.893007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1278d-3c52-4e61-8bac-617826a16bb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:34.893277 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1278d-3c52-4e61-8bac-617826a16bb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:34.901967 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1278d-3c52-4e61-8bac-617826a16bb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:34.903419 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1278d-3c52-4e61-8bac-617826a16bb0 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:34.912956 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1413/2837] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:57:34 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:57:35.055713 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699c42a-5211-4261-be15-bdbc0976569a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:35.065783 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699c42a-5211-4261-be15-bdbc0976569a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:35.070340 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fee530-5eb1-45ed-bfba-18acf2113459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:35.070986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fee530-5eb1-45ed-bfba-18acf2113459 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:35.071266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fee530-5eb1-45ed-bfba-18acf2113459 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:35.071540 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fee530-5eb1-45ed-bfba-18acf2113459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:35.131313 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fee530-5eb1-45ed-bfba-18acf2113459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:35.132914 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fee530-5eb1-45ed-bfba-18acf2113459 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:35.141846 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1425/2838] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:57:35 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:57:42.389563 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1278d-3c52-4e61-8bac-617826a16bb0 service cinder] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:42.449298 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1278d-3c52-4e61-8bac-617826a16bb0 service cinder] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:42.453729 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd90ce4-46ce-4d6b-8771-a697f1b6f16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:42.454624 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd90ce4-46ce-4d6b-8771-a697f1b6f16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:42.454900 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd90ce4-46ce-4d6b-8771-a697f1b6f16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:42.455175 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd90ce4-46ce-4d6b-8771-a697f1b6f16d admin admin] PATH_INFO: `/v3/users/d734745cd8d9482ca257ac1ad3d6d86b` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:42.456337 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd90ce4-46ce-4d6b-8771-a697f1b6f16d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d734745cd8d9482ca257ac1ad3d6d86b)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:42.458945 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd90ce4-46ce-4d6b-8771-a697f1b6f16d admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:42.503388 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-edd90ce4-46ce-4d6b-8771-a697f1b6f16d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd734745cd8d9482ca257ac1ad3d6d86b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:42.503956 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-edd90ce4-46ce-4d6b-8771-a697f1b6f16d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd734745cd8d9482ca257ac1ad3d6d86b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:42.513062 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-edd90ce4-46ce-4d6b-8771-a697f1b6f16d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd734745cd8d9482ca257ac1ad3d6d86b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:42.519973 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-edd90ce4-46ce-4d6b-8771-a697f1b6f16d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd734745cd8d9482ca257ac1ad3d6d86b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:42.520609 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-edd90ce4-46ce-4d6b-8771-a697f1b6f16d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd734745cd8d9482ca257ac1ad3d6d86b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:42.539344 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1414/2839] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:57:42 2022] DELETE /identity/v3/users/d734745cd8d9482ca257ac1ad3d6d86b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:42.544029 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa868615-f145-4455-bb40-61936cd36f8b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:42.544518 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa868615-f145-4455-bb40-61936cd36f8b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:42.544632 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa868615-f145-4455-bb40-61936cd36f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:42.561156 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-fa868615-f145-4455-bb40-61936cd36f8b None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:42.562430 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-fa868615-f145-4455-bb40-61936cd36f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:42.618786 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1426/2840] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:42.628436 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd90ce4-46ce-4d6b-8771-a697f1b6f16d admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:42.629802 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-edd90ce4-46ce-4d6b-8771-a697f1b6f16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:42.684577 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd90ce4-46ce-4d6b-8771-a697f1b6f16d admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:42.688152 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d03bab-0451-4932-a7a3-cfffc5a3b0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:42.688784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d03bab-0451-4932-a7a3-cfffc5a3b0be service neutron] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:42.689062 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d03bab-0451-4932-a7a3-cfffc5a3b0be service neutron] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:42.689332 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d03bab-0451-4932-a7a3-cfffc5a3b0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:42.698292 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d03bab-0451-4932-a7a3-cfffc5a3b0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:42.699706 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d03bab-0451-4932-a7a3-cfffc5a3b0be service neutron] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:42.709654 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1415/2841] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:57:42.973639 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa868615-f145-4455-bb40-61936cd36f8b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:42.975273 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-fa868615-f145-4455-bb40-61936cd36f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:42.986840 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa868615-f145-4455-bb40-61936cd36f8b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:42.991670 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b274a5c-3a00-408d-80e0-4f050cc9190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:42.992537 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b274a5c-3a00-408d-80e0-4f050cc9190d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:42.992816 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b274a5c-3a00-408d-80e0-4f050cc9190d admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:42.993085 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b274a5c-3a00-408d-80e0-4f050cc9190d admin admin] PATH_INFO: `/v3/projects/203025de56c64599a3677028c6b0467d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:42.994296 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b274a5c-3a00-408d-80e0-4f050cc9190d admin admin] RBAC: Authorizing `identity:delete_project(project_id=203025de56c64599a3677028c6b0467d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:42.996188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b274a5c-3a00-408d-80e0-4f050cc9190d admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:43.042280 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0b274a5c-3a00-408d-80e0-4f050cc9190d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203025de56c64599a3677028c6b0467d', 'request_id': 'req-0b274a5c-3a00-408d-80e0-4f050cc9190d'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:43.047541 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0b274a5c-3a00-408d-80e0-4f050cc9190d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203025de56c64599a3677028c6b0467d', 'request_id': 'req-0b274a5c-3a00-408d-80e0-4f050cc9190d'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:43.053491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0b274a5c-3a00-408d-80e0-4f050cc9190d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203025de56c64599a3677028c6b0467d', 'request_id': 'req-0b274a5c-3a00-408d-80e0-4f050cc9190d'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:43.065074 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0b274a5c-3a00-408d-80e0-4f050cc9190d admin admin] The token cache is being invalidate because project 203025de56c64599a3677028c6b0467d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:57:43.065355 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0b274a5c-3a00-408d-80e0-4f050cc9190d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:43.066062 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-0b274a5c-3a00-408d-80e0-4f050cc9190d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:43.068137 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1427/2842] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:57:42 2022] DELETE /identity/v3/projects/203025de56c64599a3677028c6b0467d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:43.072531 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d03bab-0451-4932-a7a3-cfffc5a3b0be service neutron] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:43.082362 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d03bab-0451-4932-a7a3-cfffc5a3b0be service neutron] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:43.135896 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6960041-c59d-45e4-87f5-aaa4c26c5a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:43.136751 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6960041-c59d-45e4-87f5-aaa4c26c5a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:43.137027 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6960041-c59d-45e4-87f5-aaa4c26c5a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:43.137299 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6960041-c59d-45e4-87f5-aaa4c26c5a4a admin admin] PATH_INFO: `/v3/users/471431db28d9455c96ade8cfeb6ed2bf` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:43.138484 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6960041-c59d-45e4-87f5-aaa4c26c5a4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=471431db28d9455c96ade8cfeb6ed2bf)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:43.140361 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6960041-c59d-45e4-87f5-aaa4c26c5a4a admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:43.185327 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f6960041-c59d-45e4-87f5-aaa4c26c5a4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471431db28d9455c96ade8cfeb6ed2bf'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:43.185976 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f6960041-c59d-45e4-87f5-aaa4c26c5a4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471431db28d9455c96ade8cfeb6ed2bf'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:43.193826 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f6960041-c59d-45e4-87f5-aaa4c26c5a4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471431db28d9455c96ade8cfeb6ed2bf'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:43.200421 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f6960041-c59d-45e4-87f5-aaa4c26c5a4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471431db28d9455c96ade8cfeb6ed2bf'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:43.201032 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-f6960041-c59d-45e4-87f5-aaa4c26c5a4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471431db28d9455c96ade8cfeb6ed2bf'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:43.217928 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1416/2843] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:57:43 2022] DELETE /identity/v3/users/471431db28d9455c96ade8cfeb6ed2bf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:43.487828 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b274a5c-3a00-408d-80e0-4f050cc9190d admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:43.489955 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0b274a5c-3a00-408d-80e0-4f050cc9190d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:43.502892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b274a5c-3a00-408d-80e0-4f050cc9190d admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:43.578434 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144e661-8343-4141-8f77-1d5f735286f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:43.579229 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e661-8343-4141-8f77-1d5f735286f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:43.579513 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e661-8343-4141-8f77-1d5f735286f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:43.579793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e661-8343-4141-8f77-1d5f735286f9 admin admin] PATH_INFO: `/v3/projects/788a004789184f38baf8e0d14b85b807` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:43.580999 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144e661-8343-4141-8f77-1d5f735286f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=788a004789184f38baf8e0d14b85b807)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:43.582958 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144e661-8343-4141-8f77-1d5f735286f9 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:43.636309 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4144e661-8343-4141-8f77-1d5f735286f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '788a004789184f38baf8e0d14b85b807', 'request_id': 'req-4144e661-8343-4141-8f77-1d5f735286f9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:43.641411 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4144e661-8343-4141-8f77-1d5f735286f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '788a004789184f38baf8e0d14b85b807', 'request_id': 'req-4144e661-8343-4141-8f77-1d5f735286f9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:43.652028 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4144e661-8343-4141-8f77-1d5f735286f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '788a004789184f38baf8e0d14b85b807', 'request_id': 'req-4144e661-8343-4141-8f77-1d5f735286f9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:43.664521 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4144e661-8343-4141-8f77-1d5f735286f9 admin admin] The token cache is being invalidate because project 788a004789184f38baf8e0d14b85b807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80046) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:57:43.664850 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4144e661-8343-4141-8f77-1d5f735286f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:43.665661 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4144e661-8343-4141-8f77-1d5f735286f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:43.667437 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1428/2844] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:57:43 2022] DELETE /identity/v3/projects/788a004789184f38baf8e0d14b85b807 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:43.672423 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860e361-c770-45ea-a759-f8e58353856e None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:43.673053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860e361-c770-45ea-a759-f8e58353856e None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:43.673053 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860e361-c770-45ea-a759-f8e58353856e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:43.691438 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-3860e361-c770-45ea-a759-f8e58353856e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:43.692660 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-3860e361-c770-45ea-a759-f8e58353856e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:43.752253 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1417/2845] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:43.760257 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d52bd-5eb3-4045-8e03-bd8f4fc6488e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:43.760544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d52bd-5eb3-4045-8e03-bd8f4fc6488e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:43.760813 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d52bd-5eb3-4045-8e03-bd8f4fc6488e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:43.778487 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-7c9d52bd-5eb3-4045-8e03-bd8f4fc6488e None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:43.779677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7c9d52bd-5eb3-4045-8e03-bd8f4fc6488e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:43.788139 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1429/2846] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:43.793547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860e361-c770-45ea-a759-f8e58353856e None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:43.803840 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860e361-c770-45ea-a759-f8e58353856e None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:43.808383 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe6df7-acb7-43ee-a829-347e97a5cd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:43.809023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe6df7-acb7-43ee-a829-347e97a5cd0c admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:43.809313 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe6df7-acb7-43ee-a829-347e97a5cd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:43.809589 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe6df7-acb7-43ee-a829-347e97a5cd0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:43.810350 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe6df7-acb7-43ee-a829-347e97a5cd0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80045) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:57:43.810657 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe6df7-acb7-43ee-a829-347e97a5cd0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:43.812241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe6df7-acb7-43ee-a829-347e97a5cd0c admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:43.823622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1418/2847] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:57:43.827722 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d52bd-5eb3-4045-8e03-bd8f4fc6488e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:43.837040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d52bd-5eb3-4045-8e03-bd8f4fc6488e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:43.841590 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff6287-6697-4faf-b83d-cfb55e162b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:43.842266 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff6287-6697-4faf-b83d-cfb55e162b73 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:43.842807 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff6287-6697-4faf-b83d-cfb55e162b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:43.843083 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff6287-6697-4faf-b83d-cfb55e162b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:43.843764 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff6287-6697-4faf-b83d-cfb55e162b73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:43.845657 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff6287-6697-4faf-b83d-cfb55e162b73 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:43.874009 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1430/2848] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:57:43 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:57:43.875454 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe6df7-acb7-43ee-a829-347e97a5cd0c admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:43.885370 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe6df7-acb7-43ee-a829-347e97a5cd0c admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:43.938853 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92ec56-37eb-445e-9d75-eb1838657b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:43.939507 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92ec56-37eb-445e-9d75-eb1838657b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:43.939790 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92ec56-37eb-445e-9d75-eb1838657b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:43.940070 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92ec56-37eb-445e-9d75-eb1838657b53 admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:43.940751 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92ec56-37eb-445e-9d75-eb1838657b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:43.942781 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92ec56-37eb-445e-9d75-eb1838657b53 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:43.962133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1419/2849] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:57:43 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:57:43.966375 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff6287-6697-4faf-b83d-cfb55e162b73 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:43.976951 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff6287-6697-4faf-b83d-cfb55e162b73 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:43.981573 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016b854-b926-452a-b642-f67587e53a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:43.982267 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016b854-b926-452a-b642-f67587e53a4c admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:43.982553 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016b854-b926-452a-b642-f67587e53a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:43.982827 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016b854-b926-452a-b642-f67587e53a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:43.983544 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016b854-b926-452a-b642-f67587e53a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:43.985115 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016b854-b926-452a-b642-f67587e53a4c admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:43.995793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1431/2850] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:57:43.999629 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92ec56-37eb-445e-9d75-eb1838657b53 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:44.009838 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92ec56-37eb-445e-9d75-eb1838657b53 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:44.014581 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba93855-5b16-4696-a200-1f6a18cf591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:44.015234 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba93855-5b16-4696-a200-1f6a18cf591f admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:44.015520 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba93855-5b16-4696-a200-1f6a18cf591f admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:44.015797 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba93855-5b16-4696-a200-1f6a18cf591f admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:44.016516 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba93855-5b16-4696-a200-1f6a18cf591f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:44.018123 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba93855-5b16-4696-a200-1f6a18cf591f admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:44.028570 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1420/2851] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:57:44.032557 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016b854-b926-452a-b642-f67587e53a4c admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:44.042767 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016b854-b926-452a-b642-f67587e53a4c admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:44.047497 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c6f50-3357-4a6e-9b39-5c95bc7afa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:44.048404 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c6f50-3357-4a6e-9b39-5c95bc7afa5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:44.048689 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c6f50-3357-4a6e-9b39-5c95bc7afa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:44.048967 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c6f50-3357-4a6e-9b39-5c95bc7afa5c admin admin] PATH_INFO: `/v3/projects/259a48e0191141bdbb5ab3b123608999/users/6ada031e614545528e3ff8544adc6651/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:44.063384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c6f50-3357-4a6e-9b39-5c95bc7afa5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=259a48e0191141bdbb5ab3b123608999, user_id=6ada031e614545528e3ff8544adc6651, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:44.066039 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c6f50-3357-4a6e-9b39-5c95bc7afa5c admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:44.079508 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1432/2852] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:57:44 2022] PUT /identity/v3/projects/259a48e0191141bdbb5ab3b123608999/users/6ada031e614545528e3ff8544adc6651/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:44.089812 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a596ea-a09b-4b8c-a920-479f6b54a578 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:44.090044 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a596ea-a09b-4b8c-a920-479f6b54a578 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:44.090358 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a596ea-a09b-4b8c-a920-479f6b54a578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:44.116984 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-35a596ea-a09b-4b8c-a920-479f6b54a578 None None] MFA Rules not processed for user `6ada031e614545528e3ff8544adc6651`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:44.118195 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-35a596ea-a09b-4b8c-a920-479f6b54a578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:44.179594 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1421/2853] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:44.184192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c6f50-3357-4a6e-9b39-5c95bc7afa5c admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:44.243218 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c6f50-3357-4a6e-9b39-5c95bc7afa5c admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:44.247931 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf2a17-32dc-4ff3-9eda-3fb7034f83fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:44.248613 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf2a17-32dc-4ff3-9eda-3fb7034f83fe admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:44.248897 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf2a17-32dc-4ff3-9eda-3fb7034f83fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:44.249205 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf2a17-32dc-4ff3-9eda-3fb7034f83fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:44.249935 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf2a17-32dc-4ff3-9eda-3fb7034f83fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:44.251958 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf2a17-32dc-4ff3-9eda-3fb7034f83fe admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:44.276707 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1433/2854] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:57:44 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:57:44.280806 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a596ea-a09b-4b8c-a920-479f6b54a578 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:44.291574 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a596ea-a09b-4b8c-a920-479f6b54a578 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:44.345920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605478f7-01ce-4404-9f04-7e215aae9e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:44.346534 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605478f7-01ce-4404-9f04-7e215aae9e9e admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:44.346815 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605478f7-01ce-4404-9f04-7e215aae9e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:44.347088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605478f7-01ce-4404-9f04-7e215aae9e9e admin admin] PATH_INFO: `/v3/users` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:44.347762 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605478f7-01ce-4404-9f04-7e215aae9e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:44.350308 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605478f7-01ce-4404-9f04-7e215aae9e9e admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:44.370281 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1422/2855] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:57:44 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:57:44.374446 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf2a17-32dc-4ff3-9eda-3fb7034f83fe admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:44.384616 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf2a17-32dc-4ff3-9eda-3fb7034f83fe admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:44.389439 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5ecd6-6a3c-4721-a2d9-2d420193768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:44.390090 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5ecd6-6a3c-4721-a2d9-2d420193768d admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:44.390393 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5ecd6-6a3c-4721-a2d9-2d420193768d admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:44.390660 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5ecd6-6a3c-4721-a2d9-2d420193768d admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:44.391372 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5ecd6-6a3c-4721-a2d9-2d420193768d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:44.392941 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5ecd6-6a3c-4721-a2d9-2d420193768d admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:44.403502 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1434/2856] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:57:44.407736 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605478f7-01ce-4404-9f04-7e215aae9e9e admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:44.418072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605478f7-01ce-4404-9f04-7e215aae9e9e admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:44.422600 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed1ff2-0470-40c4-ab32-b1deb5a2e2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:44.423461 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed1ff2-0470-40c4-ab32-b1deb5a2e2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:44.423742 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed1ff2-0470-40c4-ab32-b1deb5a2e2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:44.424016 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed1ff2-0470-40c4-ab32-b1deb5a2e2f6 admin admin] PATH_INFO: `/v3/projects/86701799832f46d393ac64ce4743a68e/users/313bf9831f8c4c9187afb14dd13fb279/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:44.438773 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed1ff2-0470-40c4-ab32-b1deb5a2e2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86701799832f46d393ac64ce4743a68e, user_id=313bf9831f8c4c9187afb14dd13fb279, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:44.441383 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed1ff2-0470-40c4-ab32-b1deb5a2e2f6 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:44.454103 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1423/2857] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:57:44 2022] PUT /identity/v3/projects/86701799832f46d393ac64ce4743a68e/users/313bf9831f8c4c9187afb14dd13fb279/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:44.457942 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5ecd6-6a3c-4721-a2d9-2d420193768d admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:44.468566 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5ecd6-6a3c-4721-a2d9-2d420193768d admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:44.524919 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c3c27-4718-4503-876c-df942162d8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:44.525592 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c3c27-4718-4503-876c-df942162d8fb admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:44.525875 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c3c27-4718-4503-876c-df942162d8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:44.526152 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c3c27-4718-4503-876c-df942162d8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:44.526905 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c3c27-4718-4503-876c-df942162d8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:44.528491 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c3c27-4718-4503-876c-df942162d8fb admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:44.538688 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1435/2858] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:57:44.542871 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed1ff2-0470-40c4-ab32-b1deb5a2e2f6 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:44.554147 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed1ff2-0470-40c4-ab32-b1deb5a2e2f6 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:44.558751 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995db49-9669-4cd0-89a7-7279d0515d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:44.559620 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995db49-9669-4cd0-89a7-7279d0515d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:44.559904 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995db49-9669-4cd0-89a7-7279d0515d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:44.560189 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995db49-9669-4cd0-89a7-7279d0515d86 admin admin] PATH_INFO: `/v3/projects/86701799832f46d393ac64ce4743a68e/users/313bf9831f8c4c9187afb14dd13fb279/roles/70f81a43849a47f7bf393b354a46d048` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:44.562155 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995db49-9669-4cd0-89a7-7279d0515d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86701799832f46d393ac64ce4743a68e, user_id=313bf9831f8c4c9187afb14dd13fb279, role_id=70f81a43849a47f7bf393b354a46d048)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:44.564795 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995db49-9669-4cd0-89a7-7279d0515d86 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:44.575345 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1424/2859] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:57:44 2022] PUT /identity/v3/projects/86701799832f46d393ac64ce4743a68e/users/313bf9831f8c4c9187afb14dd13fb279/roles/70f81a43849a47f7bf393b354a46d048 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:44.585649 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a089e9d-5985-4bf2-a1a5-44b01f7233a2 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:44.586123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a089e9d-5985-4bf2-a1a5-44b01f7233a2 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:44.586264 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a089e9d-5985-4bf2-a1a5-44b01f7233a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:44.613023 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-6a089e9d-5985-4bf2-a1a5-44b01f7233a2 None None] MFA Rules not processed for user `313bf9831f8c4c9187afb14dd13fb279`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:44.614159 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6a089e9d-5985-4bf2-a1a5-44b01f7233a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:44.679888 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1436/2860] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:44.690738 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995db49-9669-4cd0-89a7-7279d0515d86 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:44.692473 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-c995db49-9669-4cd0-89a7-7279d0515d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:44.751262 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995db49-9669-4cd0-89a7-7279d0515d86 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:44.754874 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33ecad-2e97-4b63-ac8b-757ae54acf67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:44.755954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33ecad-2e97-4b63-ac8b-757ae54acf67 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:44.755954 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33ecad-2e97-4b63-ac8b-757ae54acf67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:44.756223 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33ecad-2e97-4b63-ac8b-757ae54acf67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:44.810780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33ecad-2e97-4b63-ac8b-757ae54acf67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:44.812211 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33ecad-2e97-4b63-ac8b-757ae54acf67 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:44.821478 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1425/2861] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:57:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:57:47.334873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a089e9d-5985-4bf2-a1a5-44b01f7233a2 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:47.397070 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a089e9d-5985-4bf2-a1a5-44b01f7233a2 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:47.401673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb993d2-47d6-4c98-88df-41a446997f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:47.402574 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb993d2-47d6-4c98-88df-41a446997f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:47.402869 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb993d2-47d6-4c98-88df-41a446997f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:47.403161 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb993d2-47d6-4c98-88df-41a446997f35 admin admin] PATH_INFO: `/v3/users/6ada031e614545528e3ff8544adc6651` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:47.404347 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb993d2-47d6-4c98-88df-41a446997f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ada031e614545528e3ff8544adc6651)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:47.406323 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb993d2-47d6-4c98-88df-41a446997f35 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:47.475480 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-9bb993d2-47d6-4c98-88df-41a446997f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ada031e614545528e3ff8544adc6651'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:47.482441 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-9bb993d2-47d6-4c98-88df-41a446997f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ada031e614545528e3ff8544adc6651'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:47.483157 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-9bb993d2-47d6-4c98-88df-41a446997f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ada031e614545528e3ff8544adc6651'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:47.483757 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-9bb993d2-47d6-4c98-88df-41a446997f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ada031e614545528e3ff8544adc6651'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:47.496141 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-9bb993d2-47d6-4c98-88df-41a446997f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ada031e614545528e3ff8544adc6651'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:47.511620 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1437/2862] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:57:47 2022] DELETE /identity/v3/users/6ada031e614545528e3ff8544adc6651 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:47.516009 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b7c9-b403-4058-8587-8277a8d1bcb2 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:47.516547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b7c9-b403-4058-8587-8277a8d1bcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:47.516547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b7c9-b403-4058-8587-8277a8d1bcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:47.533859 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-17a7b7c9-b403-4058-8587-8277a8d1bcb2 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:47.535128 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-17a7b7c9-b403-4058-8587-8277a8d1bcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:47.602806 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1426/2863] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:47.619133 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb993d2-47d6-4c98-88df-41a446997f35 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:47.620538 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9bb993d2-47d6-4c98-88df-41a446997f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:47.676269 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb993d2-47d6-4c98-88df-41a446997f35 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:47.680564 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc381f4d-0483-4e3c-bc96-05358ff02e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:47.681215 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc381f4d-0483-4e3c-bc96-05358ff02e6d service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:47.681496 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc381f4d-0483-4e3c-bc96-05358ff02e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:47.681773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc381f4d-0483-4e3c-bc96-05358ff02e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:47.691192 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc381f4d-0483-4e3c-bc96-05358ff02e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:47.692673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc381f4d-0483-4e3c-bc96-05358ff02e6d service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:47.703030 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1438/2864] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:57:47.967179 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7b7c9-b403-4058-8587-8277a8d1bcb2 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:47.968937 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-17a7b7c9-b403-4058-8587-8277a8d1bcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:47.981941 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7b7c9-b403-4058-8587-8277a8d1bcb2 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:47.986783 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:47.987669 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:47.987949 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:47.988220 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b admin admin] PATH_INFO: `/v3/projects/259a48e0191141bdbb5ab3b123608999` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:47.989547 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=259a48e0191141bdbb5ab3b123608999)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:47.991616 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:48.040276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '259a48e0191141bdbb5ab3b123608999', 'request_id': 'req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:48.045766 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '259a48e0191141bdbb5ab3b123608999', 'request_id': 'req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:48.052233 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '259a48e0191141bdbb5ab3b123608999', 'request_id': 'req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:48.066948 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b admin admin] The token cache is being invalidate because project 259a48e0191141bdbb5ab3b123608999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:57:48.067238 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:48.070342 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:48.072164 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1427/2865] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:57:47 2022] DELETE /identity/v3/projects/259a48e0191141bdbb5ab3b123608999 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:48.076806 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc381f4d-0483-4e3c-bc96-05358ff02e6d service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:48.087615 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc381f4d-0483-4e3c-bc96-05358ff02e6d service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:48.147705 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98b115-1e0f-4983-b525-944fc760fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:48.148494 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98b115-1e0f-4983-b525-944fc760fc25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:48.148772 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98b115-1e0f-4983-b525-944fc760fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:48.149042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98b115-1e0f-4983-b525-944fc760fc25 admin admin] PATH_INFO: `/v3/users/313bf9831f8c4c9187afb14dd13fb279` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:48.150267 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98b115-1e0f-4983-b525-944fc760fc25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=313bf9831f8c4c9187afb14dd13fb279)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:48.152175 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98b115-1e0f-4983-b525-944fc760fc25 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:48.203817 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4d98b115-1e0f-4983-b525-944fc760fc25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '313bf9831f8c4c9187afb14dd13fb279'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:48.211423 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4d98b115-1e0f-4983-b525-944fc760fc25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '313bf9831f8c4c9187afb14dd13fb279'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:48.212123 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4d98b115-1e0f-4983-b525-944fc760fc25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '313bf9831f8c4c9187afb14dd13fb279'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:48.212754 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4d98b115-1e0f-4983-b525-944fc760fc25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '313bf9831f8c4c9187afb14dd13fb279'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:48.224851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-4d98b115-1e0f-4983-b525-944fc760fc25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '313bf9831f8c4c9187afb14dd13fb279'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:48.237927 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1439/2866] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:57:48 2022] DELETE /identity/v3/users/313bf9831f8c4c9187afb14dd13fb279 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:48.513978 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:48.515491 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:48.532557 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8faf5a-d7a3-4631-b246-978ecbb2ed9b admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:48.589212 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505ea85-c93c-40fe-8af2-92cc3abc7aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:48.590088 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505ea85-c93c-40fe-8af2-92cc3abc7aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:48.590403 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505ea85-c93c-40fe-8af2-92cc3abc7aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:48.590679 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505ea85-c93c-40fe-8af2-92cc3abc7aa0 admin admin] PATH_INFO: `/v3/projects/86701799832f46d393ac64ce4743a68e` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:48.591876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505ea85-c93c-40fe-8af2-92cc3abc7aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86701799832f46d393ac64ce4743a68e)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:48.593997 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505ea85-c93c-40fe-8af2-92cc3abc7aa0 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:48.637638 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1505ea85-c93c-40fe-8af2-92cc3abc7aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86701799832f46d393ac64ce4743a68e', 'request_id': 'req-1505ea85-c93c-40fe-8af2-92cc3abc7aa0'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:48.642784 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1505ea85-c93c-40fe-8af2-92cc3abc7aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86701799832f46d393ac64ce4743a68e', 'request_id': 'req-1505ea85-c93c-40fe-8af2-92cc3abc7aa0'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:48.648943 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1505ea85-c93c-40fe-8af2-92cc3abc7aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86701799832f46d393ac64ce4743a68e', 'request_id': 'req-1505ea85-c93c-40fe-8af2-92cc3abc7aa0'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:48.660199 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1505ea85-c93c-40fe-8af2-92cc3abc7aa0 admin admin] The token cache is being invalidate because project 86701799832f46d393ac64ce4743a68e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:57:48.660496 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1505ea85-c93c-40fe-8af2-92cc3abc7aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:48.661086 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-1505ea85-c93c-40fe-8af2-92cc3abc7aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:48.662650 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1428/2867] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:57:48 2022] DELETE /identity/v3/projects/86701799832f46d393ac64ce4743a68e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:48.667599 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdd8fd-855a-451e-adb0-d478678239cb None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:48.668086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdd8fd-855a-451e-adb0-d478678239cb None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:48.668203 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdd8fd-855a-451e-adb0-d478678239cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:48.686221 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-fbfdd8fd-855a-451e-adb0-d478678239cb None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:48.687344 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-fbfdd8fd-855a-451e-adb0-d478678239cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:48.746034 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1440/2868] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:48.755078 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85388-0654-4cad-8be6-2cfd13794ecd None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:48.755400 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85388-0654-4cad-8be6-2cfd13794ecd None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:48.756189 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85388-0654-4cad-8be6-2cfd13794ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:48.774676 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-45f85388-0654-4cad-8be6-2cfd13794ecd None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:48.775875 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-45f85388-0654-4cad-8be6-2cfd13794ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:48.783786 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1429/2869] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:48.788392 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdd8fd-855a-451e-adb0-d478678239cb None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:48.798380 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdd8fd-855a-451e-adb0-d478678239cb None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:48.803698 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc76d9-25a9-45b4-ac14-9e31c3289e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:48.804431 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc76d9-25a9-45b4-ac14-9e31c3289e0c admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:48.804709 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc76d9-25a9-45b4-ac14-9e31c3289e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:48.804986 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc76d9-25a9-45b4-ac14-9e31c3289e0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:48.805746 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc76d9-25a9-45b4-ac14-9e31c3289e0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:57:48.806052 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc76d9-25a9-45b4-ac14-9e31c3289e0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:48.807695 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc76d9-25a9-45b4-ac14-9e31c3289e0c admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:48.820988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1441/2870] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 05 15:57:48.825810 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f85388-0654-4cad-8be6-2cfd13794ecd None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:48.835753 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f85388-0654-4cad-8be6-2cfd13794ecd None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:48.842797 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32a222-28bd-4445-a20e-25bddb5bc99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:48.843618 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32a222-28bd-4445-a20e-25bddb5bc99e admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:48.843948 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32a222-28bd-4445-a20e-25bddb5bc99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:48.844320 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32a222-28bd-4445-a20e-25bddb5bc99e admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:48.845148 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32a222-28bd-4445-a20e-25bddb5bc99e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:48.847250 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32a222-28bd-4445-a20e-25bddb5bc99e admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:48.874805 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1430/2871] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:57:48 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:57:48.878988 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc76d9-25a9-45b4-ac14-9e31c3289e0c admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:48.889829 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc76d9-25a9-45b4-ac14-9e31c3289e0c admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:48.947239 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4c2f3-f5a6-4d06-a1bb-82a004a76963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:48.947831 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4c2f3-f5a6-4d06-a1bb-82a004a76963 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:48.948116 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4c2f3-f5a6-4d06-a1bb-82a004a76963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:48.948398 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4c2f3-f5a6-4d06-a1bb-82a004a76963 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:48.949101 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4c2f3-f5a6-4d06-a1bb-82a004a76963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:48.951062 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4c2f3-f5a6-4d06-a1bb-82a004a76963 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:48.972336 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1442/2872] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:57:48 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:57:48.977074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32a222-28bd-4445-a20e-25bddb5bc99e admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:48.987300 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32a222-28bd-4445-a20e-25bddb5bc99e admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:48.992749 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb564a3-804d-4502-b01b-006538ce6830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:48.993411 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb564a3-804d-4502-b01b-006538ce6830 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:48.993693 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb564a3-804d-4502-b01b-006538ce6830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:48.993969 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb564a3-804d-4502-b01b-006538ce6830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:48.994735 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb564a3-804d-4502-b01b-006538ce6830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:48.996356 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb564a3-804d-4502-b01b-006538ce6830 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:49.007241 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1431/2873] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 05 15:57:49.011802 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4c2f3-f5a6-4d06-a1bb-82a004a76963 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:49.022627 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4c2f3-f5a6-4d06-a1bb-82a004a76963 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:49.027357 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378bc54-aeec-47cb-aa29-a9b82bad8c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:49.028018 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378bc54-aeec-47cb-aa29-a9b82bad8c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:49.028302 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378bc54-aeec-47cb-aa29-a9b82bad8c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:49.028582 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378bc54-aeec-47cb-aa29-a9b82bad8c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:49.029306 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378bc54-aeec-47cb-aa29-a9b82bad8c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:49.030943 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378bc54-aeec-47cb-aa29-a9b82bad8c30 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:49.041924 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1443/2874] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:57:49.046295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb564a3-804d-4502-b01b-006538ce6830 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:49.057133 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb564a3-804d-4502-b01b-006538ce6830 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:49.061775 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017c808-e616-4e60-b7e1-002791b5ee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:49.062702 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017c808-e616-4e60-b7e1-002791b5ee23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:49.062974 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017c808-e616-4e60-b7e1-002791b5ee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:49.063249 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017c808-e616-4e60-b7e1-002791b5ee23 admin admin] PATH_INFO: `/v3/projects/d0fc7c03cf214c71a63547f08307144a/users/d0b19b1c84d54ddb88a06ac08a6127a9/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:49.078023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017c808-e616-4e60-b7e1-002791b5ee23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc7c03cf214c71a63547f08307144a, user_id=d0b19b1c84d54ddb88a06ac08a6127a9, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:49.080706 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017c808-e616-4e60-b7e1-002791b5ee23 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:49.094778 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1432/2875] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:57:49 2022] PUT /identity/v3/projects/d0fc7c03cf214c71a63547f08307144a/users/d0b19b1c84d54ddb88a06ac08a6127a9/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:49.106007 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3f1a5-e01a-4544-ac30-6d545209560f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:49.106425 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3f1a5-e01a-4544-ac30-6d545209560f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:49.106625 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3f1a5-e01a-4544-ac30-6d545209560f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:49.135038 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-90d3f1a5-e01a-4544-ac30-6d545209560f None None] MFA Rules not processed for user `d0b19b1c84d54ddb88a06ac08a6127a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:49.136089 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-90d3f1a5-e01a-4544-ac30-6d545209560f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:49.201299 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1444/2876] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:49.212981 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017c808-e616-4e60-b7e1-002791b5ee23 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:49.214731 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-4017c808-e616-4e60-b7e1-002791b5ee23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:49.271284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017c808-e616-4e60-b7e1-002791b5ee23 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:49.274977 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603830e-43cd-423d-bb4a-8ab5f3a4a6b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:49.275623 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603830e-43cd-423d-bb4a-8ab5f3a4a6b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:49.275900 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603830e-43cd-423d-bb4a-8ab5f3a4a6b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:49.276173 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603830e-43cd-423d-bb4a-8ab5f3a4a6b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:49.284933 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603830e-43cd-423d-bb4a-8ab5f3a4a6b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:49.286951 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603830e-43cd-423d-bb4a-8ab5f3a4a6b0 service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:49.296247 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1433/2877] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:57:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:57:49.320751 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3f1a5-e01a-4544-ac30-6d545209560f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:49.382793 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3f1a5-e01a-4544-ac30-6d545209560f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:49.387545 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119216-bec2-4cf9-86f2-1640c9854723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:49.388413 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119216-bec2-4cf9-86f2-1640c9854723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:49.388696 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119216-bec2-4cf9-86f2-1640c9854723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:49.388963 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119216-bec2-4cf9-86f2-1640c9854723 admin admin] PATH_INFO: `/v3/users/d0b19b1c84d54ddb88a06ac08a6127a9` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:49.390284 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6119216-bec2-4cf9-86f2-1640c9854723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0b19b1c84d54ddb88a06ac08a6127a9)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:49.392215 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6119216-bec2-4cf9-86f2-1640c9854723 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:49.436759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b6119216-bec2-4cf9-86f2-1640c9854723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0b19b1c84d54ddb88a06ac08a6127a9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:49.443610 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b6119216-bec2-4cf9-86f2-1640c9854723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0b19b1c84d54ddb88a06ac08a6127a9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:49.444384 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b6119216-bec2-4cf9-86f2-1640c9854723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0b19b1c84d54ddb88a06ac08a6127a9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:49.445017 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b6119216-bec2-4cf9-86f2-1640c9854723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0b19b1c84d54ddb88a06ac08a6127a9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:49.462193 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-b6119216-bec2-4cf9-86f2-1640c9854723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0b19b1c84d54ddb88a06ac08a6127a9'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:49.486186 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1445/2878] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:57:49 2022] DELETE /identity/v3/users/d0b19b1c84d54ddb88a06ac08a6127a9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:49.491568 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a01b2-d00d-43ea-92dd-0859252b4593 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:49.491899 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a01b2-d00d-43ea-92dd-0859252b4593 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:49.492217 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a01b2-d00d-43ea-92dd-0859252b4593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:49.510852 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-661a01b2-d00d-43ea-92dd-0859252b4593 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:49.512066 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-661a01b2-d00d-43ea-92dd-0859252b4593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:49.570693 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1434/2879] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:57:49.581091 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119216-bec2-4cf9-86f2-1640c9854723 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:49.582534 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b6119216-bec2-4cf9-86f2-1640c9854723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:49.638926 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119216-bec2-4cf9-86f2-1640c9854723 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:49.642512 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0abd57-984d-4945-889c-6c41665fb634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:49.643153 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0abd57-984d-4945-889c-6c41665fb634 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:49.643440 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0abd57-984d-4945-889c-6c41665fb634 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:49.643716 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0abd57-984d-4945-889c-6c41665fb634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:49.652966 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0abd57-984d-4945-889c-6c41665fb634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:49.654427 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0abd57-984d-4945-889c-6c41665fb634 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:49.664188 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1446/2880] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:57:49.942219 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a01b2-d00d-43ea-92dd-0859252b4593 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:49.943915 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-661a01b2-d00d-43ea-92dd-0859252b4593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:49.957008 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a01b2-d00d-43ea-92dd-0859252b4593 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:49.962792 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf07388-e581-4304-9cad-fb73730aa5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:49.963710 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf07388-e581-4304-9cad-fb73730aa5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:49.963997 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf07388-e581-4304-9cad-fb73730aa5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:49.964545 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf07388-e581-4304-9cad-fb73730aa5f6 admin admin] PATH_INFO: `/v3/projects/d0fc7c03cf214c71a63547f08307144a` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:49.965741 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf07388-e581-4304-9cad-fb73730aa5f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0fc7c03cf214c71a63547f08307144a)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:49.967936 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf07388-e581-4304-9cad-fb73730aa5f6 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:50.017409 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-9cf07388-e581-4304-9cad-fb73730aa5f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0fc7c03cf214c71a63547f08307144a', 'request_id': 'req-9cf07388-e581-4304-9cad-fb73730aa5f6'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:50.023716 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-9cf07388-e581-4304-9cad-fb73730aa5f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0fc7c03cf214c71a63547f08307144a', 'request_id': 'req-9cf07388-e581-4304-9cad-fb73730aa5f6'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:50.029709 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-9cf07388-e581-4304-9cad-fb73730aa5f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0fc7c03cf214c71a63547f08307144a', 'request_id': 'req-9cf07388-e581-4304-9cad-fb73730aa5f6'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:50.042851 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-9cf07388-e581-4304-9cad-fb73730aa5f6 admin admin] The token cache is being invalidate because project d0fc7c03cf214c71a63547f08307144a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:57:50.043140 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-9cf07388-e581-4304-9cad-fb73730aa5f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:50.043780 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-9cf07388-e581-4304-9cad-fb73730aa5f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:50.045318 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1435/2881] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:57:49 2022] DELETE /identity/v3/projects/d0fc7c03cf214c71a63547f08307144a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:50.050305 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e879-ae2f-4806-af3d-2524b5ce17fd None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:50.050773 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e879-ae2f-4806-af3d-2524b5ce17fd None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:50.050892 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e879-ae2f-4806-af3d-2524b5ce17fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:50.068471 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4d36e879-ae2f-4806-af3d-2524b5ce17fd None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:50.069677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4d36e879-ae2f-4806-af3d-2524b5ce17fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:50.130371 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1447/2882] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:50.138632 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b760a-2fda-478b-b5da-cd2f2877bb43 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:50.138920 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b760a-2fda-478b-b5da-cd2f2877bb43 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:50.139202 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b760a-2fda-478b-b5da-cd2f2877bb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:50.159027 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-534b760a-2fda-478b-b5da-cd2f2877bb43 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:50.160220 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-534b760a-2fda-478b-b5da-cd2f2877bb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:50.168910 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1436/2883] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:50.173404 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36e879-ae2f-4806-af3d-2524b5ce17fd None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:50.183358 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36e879-ae2f-4806-af3d-2524b5ce17fd None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:50.188079 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446a94-50fa-4182-8284-bafddc2c9935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:50.188759 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446a94-50fa-4182-8284-bafddc2c9935 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:50.189042 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446a94-50fa-4182-8284-bafddc2c9935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:50.189317 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446a94-50fa-4182-8284-bafddc2c9935 admin admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:50.190062 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53446a94-50fa-4182-8284-bafddc2c9935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 05 15:57:50.190416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53446a94-50fa-4182-8284-bafddc2c9935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:50.192040 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53446a94-50fa-4182-8284-bafddc2c9935 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:50.204175 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1448/2884] 10.222.0.58 () {58 vars in 1152 bytes} [Thu May 5 15:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 05 15:57:50.209276 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b760a-2fda-478b-b5da-cd2f2877bb43 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:50.218953 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b760a-2fda-478b-b5da-cd2f2877bb43 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:50.223554 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8a6aa-2d75-412b-9c81-511fbd3994a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:50.224787 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8a6aa-2d75-412b-9c81-511fbd3994a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:50.225064 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8a6aa-2d75-412b-9c81-511fbd3994a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:50.225334 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8a6aa-2d75-412b-9c81-511fbd3994a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:50.226023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8a6aa-2d75-412b-9c81-511fbd3994a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:50.227950 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8a6aa-2d75-412b-9c81-511fbd3994a6 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:50.254622 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1437/2885] 10.222.0.58 () {60 vars in 1152 bytes} [Thu May 5 15:57:50 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 05 15:57:50.258873 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446a94-50fa-4182-8284-bafddc2c9935 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:50.268847 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446a94-50fa-4182-8284-bafddc2c9935 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:50.324996 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb087cf6-d3f9-44e8-adb0-c5b46a82a8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:50.325677 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb087cf6-d3f9-44e8-adb0-c5b46a82a8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:50.325961 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb087cf6-d3f9-44e8-adb0-c5b46a82a8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:50.326281 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb087cf6-d3f9-44e8-adb0-c5b46a82a8d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:50.326981 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb087cf6-d3f9-44e8-adb0-c5b46a82a8d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:50.328891 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb087cf6-d3f9-44e8-adb0-c5b46a82a8d0 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:50.349376 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1449/2886] 10.222.0.58 () {60 vars in 1143 bytes} [Thu May 5 15:57:50 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 05 15:57:50.353527 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8a6aa-2d75-412b-9c81-511fbd3994a6 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:50.363862 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8a6aa-2d75-412b-9c81-511fbd3994a6 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:50.369359 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef49378-4a0d-4890-ad71-4b2791d3d878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:50.370023 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef49378-4a0d-4890-ad71-4b2791d3d878 admin admin] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:50.370331 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef49378-4a0d-4890-ad71-4b2791d3d878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:50.370608 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef49378-4a0d-4890-ad71-4b2791d3d878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:50.371338 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef49378-4a0d-4890-ad71-4b2791d3d878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:50.372935 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef49378-4a0d-4890-ad71-4b2791d3d878 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:50.384374 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1438/2887] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:57:50.388368 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb087cf6-d3f9-44e8-adb0-c5b46a82a8d0 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:50.399697 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb087cf6-d3f9-44e8-adb0-c5b46a82a8d0 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:50.404334 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98456b3-2dae-4449-8fa6-54c50ef9f6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:50.404992 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98456b3-2dae-4449-8fa6-54c50ef9f6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:50.405275 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98456b3-2dae-4449-8fa6-54c50ef9f6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:50.405549 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98456b3-2dae-4449-8fa6-54c50ef9f6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:50.406292 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98456b3-2dae-4449-8fa6-54c50ef9f6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:50.407872 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98456b3-2dae-4449-8fa6-54c50ef9f6f9 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:50.419045 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1450/2888] 10.222.0.58 () {58 vars in 1121 bytes} [Thu May 5 15:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 05 15:57:50.423284 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef49378-4a0d-4890-ad71-4b2791d3d878 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:50.433391 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef49378-4a0d-4890-ad71-4b2791d3d878 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:50.437968 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c13243-3ae6-4448-8982-91179962fde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:50.438876 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13243-3ae6-4448-8982-91179962fde8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:50.439163 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13243-3ae6-4448-8982-91179962fde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:50.439435 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13243-3ae6-4448-8982-91179962fde8 admin admin] PATH_INFO: `/v3/projects/8440d8aabf004bfa88794ebbd4841840/users/c6eebed674dc4651bd8a1895bff7d401/roles/8f649e044d134d799d7bbaf6e0715e34` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:50.454625 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c13243-3ae6-4448-8982-91179962fde8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8440d8aabf004bfa88794ebbd4841840, user_id=c6eebed674dc4651bd8a1895bff7d401, role_id=8f649e044d134d799d7bbaf6e0715e34)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:50.457288 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c13243-3ae6-4448-8982-91179962fde8 admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:50.471098 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1439/2889] 10.222.0.58 () {60 vars in 1482 bytes} [Thu May 5 15:57:50 2022] PUT /identity/v3/projects/8440d8aabf004bfa88794ebbd4841840/users/c6eebed674dc4651bd8a1895bff7d401/roles/8f649e044d134d799d7bbaf6e0715e34 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:50.482684 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcc95e-d668-455f-8cec-29bae9f8a02b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:50.482978 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcc95e-d668-455f-8cec-29bae9f8a02b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:50.483311 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcc95e-d668-455f-8cec-29bae9f8a02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:50.516732 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a8bcc95e-d668-455f-8cec-29bae9f8a02b None None] MFA Rules not processed for user `c6eebed674dc4651bd8a1895bff7d401`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:50.518033 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a8bcc95e-d668-455f-8cec-29bae9f8a02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:50.590005 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1451/2890] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 05 15:57:50.603472 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c13243-3ae6-4448-8982-91179962fde8 admin admin] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:50.605295 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-d1c13243-3ae6-4448-8982-91179962fde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:50.662201 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c13243-3ae6-4448-8982-91179962fde8 admin admin] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:50.666102 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c4f4f-4fad-4523-a617-943ba287a69c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9a301df6534b499d60486060df7068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:50.666785 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c4f4f-4fad-4523-a617-943ba287a69c service cinder] REQUEST_METHOD: `GET` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:50.667072 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c4f4f-4fad-4523-a617-943ba287a69c service cinder] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:50.667345 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c4f4f-4fad-4523-a617-943ba287a69c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:50.676068 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c4f4f-4fad-4523-a617-943ba287a69c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:50.677558 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c4f4f-4fad-4523-a617-943ba287a69c service cinder] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:50.686442 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1440/2891] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:57:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 05 15:57:57.705802 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcc95e-d668-455f-8cec-29bae9f8a02b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:57.770221 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcc95e-d668-455f-8cec-29bae9f8a02b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:57.775086 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfea1e-24be-49ca-a414-2e0cb016b5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:57.775950 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfea1e-24be-49ca-a414-2e0cb016b5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:57.776228 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfea1e-24be-49ca-a414-2e0cb016b5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:57.776501 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfea1e-24be-49ca-a414-2e0cb016b5e3 admin admin] PATH_INFO: `/v3/users/c6eebed674dc4651bd8a1895bff7d401` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:57.777673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfea1e-24be-49ca-a414-2e0cb016b5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6eebed674dc4651bd8a1895bff7d401)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:57.779717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfea1e-24be-49ca-a414-2e0cb016b5e3 admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:57.834908 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-49dfea1e-24be-49ca-a414-2e0cb016b5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6eebed674dc4651bd8a1895bff7d401'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:57.842618 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-49dfea1e-24be-49ca-a414-2e0cb016b5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6eebed674dc4651bd8a1895bff7d401'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:57.843687 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-49dfea1e-24be-49ca-a414-2e0cb016b5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6eebed674dc4651bd8a1895bff7d401'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:57.844316 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-49dfea1e-24be-49ca-a414-2e0cb016b5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6eebed674dc4651bd8a1895bff7d401'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:57.856501 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [None req-49dfea1e-24be-49ca-a414-2e0cb016b5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6eebed674dc4651bd8a1895bff7d401'} {{(pid=80046) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:57.869195 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1452/2892] 10.222.0.58 () {58 vars in 1223 bytes} [Thu May 5 15:57:57 2022] DELETE /identity/v3/users/c6eebed674dc4651bd8a1895bff7d401 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 15:57:57.873955 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d6cab-0e5d-4b39-8b7c-014f3d3547f9 None None] REQUEST_METHOD: `POST` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:57.874659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d6cab-0e5d-4b39-8b7c-014f3d3547f9 None None] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:57.874659 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d6cab-0e5d-4b39-8b7c-014f3d3547f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:57.904961 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.auth.core [None req-7d0d6cab-0e5d-4b39-8b7c-014f3d3547f9 None None] MFA Rules not processed for user `8497965f53ce4709b6b853568b47ea71`. Rule list: `[]` (Enabled: `True`). {{(pid=80045) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 05 15:57:57.906867 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7d0d6cab-0e5d-4b39-8b7c-014f3d3547f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:57.978544 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1441/2893] 10.222.0.58 () {58 vars in 957 bytes} [Thu May 5 15:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 05 15:57:57.988249 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfea1e-24be-49ca-a414-2e0cb016b5e3 admin admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:57.989673 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-49dfea1e-24be-49ca-a414-2e0cb016b5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:58.049418 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfea1e-24be-49ca-a414-2e0cb016b5e3 admin admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:58.053118 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0b84c-6f28-41fc-8075-9840d2bc2e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe9f8eb94c84c36ad7a49507b2c8360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:58.053851 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0b84c-6f28-41fc-8075-9840d2bc2e18 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:58.054289 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0b84c-6f28-41fc-8075-9840d2bc2e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:58.054567 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0b84c-6f28-41fc-8075-9840d2bc2e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:58.064211 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0b84c-6f28-41fc-8075-9840d2bc2e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:58.065644 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0b84c-6f28-41fc-8075-9840d2bc2e18 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:58.075343 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1453/2894] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 15:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 05 15:57:58.369969 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d6cab-0e5d-4b39-8b7c-014f3d3547f9 None None] Authenticating user token {{(pid=80045) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 15:57:58.371743 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.fernet_utils [None req-7d0d6cab-0e5d-4b39-8b7c-014f3d3547f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80045) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 15:57:58.386369 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d6cab-0e5d-4b39-8b7c-014f3d3547f9 None None] Validating token access rules against request {{(pid=80045) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 15:57:58.391007 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2665cf-181b-4e0f-96e8-3b2c040cfbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8497965f53ce4709b6b853568b47ea71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e901518e00104463a2aa36d4de393e28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80045) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 15:57:58.391870 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2665cf-181b-4e0f-96e8-3b2c040cfbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 15:57:58.392150 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2665cf-181b-4e0f-96e8-3b2c040cfbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 15:57:58.392424 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2665cf-181b-4e0f-96e8-3b2c040cfbeb admin admin] PATH_INFO: `/v3/projects/8440d8aabf004bfa88794ebbd4841840` {{(pid=80045) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 15:57:58.393707 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2665cf-181b-4e0f-96e8-3b2c040cfbeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8440d8aabf004bfa88794ebbd4841840)` {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 15:57:58.395636 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2665cf-181b-4e0f-96e8-3b2c040cfbeb admin admin] RBAC: Authorization granted {{(pid=80045) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 15:57:58.442417 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cc2665cf-181b-4e0f-96e8-3b2c040cfbeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8440d8aabf004bfa88794ebbd4841840', 'request_id': 'req-cc2665cf-181b-4e0f-96e8-3b2c040cfbeb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:58.448285 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cc2665cf-181b-4e0f-96e8-3b2c040cfbeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8440d8aabf004bfa88794ebbd4841840', 'request_id': 'req-cc2665cf-181b-4e0f-96e8-3b2c040cfbeb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:58.454696 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cc2665cf-181b-4e0f-96e8-3b2c040cfbeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8440d8aabf004bfa88794ebbd4841840', 'request_id': 'req-cc2665cf-181b-4e0f-96e8-3b2c040cfbeb'} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:58.469445 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cc2665cf-181b-4e0f-96e8-3b2c040cfbeb admin admin] The token cache is being invalidate because project 8440d8aabf004bfa88794ebbd4841840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80045) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 05 15:57:58.469734 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cc2665cf-181b-4e0f-96e8-3b2c040cfbeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:58.470386 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: DEBUG keystone.notifications [None req-cc2665cf-181b-4e0f-96e8-3b2c040cfbeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80045) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 05 15:57:58.472074 dv-cinder-839793-9-iscsi devstack@keystone.service[80045]: [pid: 80045|app: 0|req: 1442/2895] 10.222.0.58 () {58 vars in 1232 bytes} [Thu May 5 15:57:58 2022] DELETE /identity/v3/projects/8440d8aabf004bfa88794ebbd4841840 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 05 16:00:33.729995 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0b84c-6f28-41fc-8075-9840d2bc2e18 service neutron] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 05 16:00:33.731416 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a8e0b84c-6f28-41fc-8075-9840d2bc2e18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 16:00:33.798206 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0b84c-6f28-41fc-8075-9840d2bc2e18 service neutron] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 05 16:00:33.857076 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a5b97-d670-451f-b806-6587d573bcb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a12f5d874be84f1ca79eb439267c7b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd58b84c6394504beb84d13d13d60a1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 05 16:00:33.857717 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a5b97-d670-451f-b806-6587d573bcb6 service placement] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 05 16:00:33.857995 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a5b97-d670-451f-b806-6587d573bcb6 service placement] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 05 16:00:33.859602 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a5b97-d670-451f-b806-6587d573bcb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 05 16:00:33.861529 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c83a5b97-d670-451f-b806-6587d573bcb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 05 16:00:33.873043 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a5b97-d670-451f-b806-6587d573bcb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 05 16:00:33.874650 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a5b97-d670-451f-b806-6587d573bcb6 service placement] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 05 16:00:33.884592 dv-cinder-839793-9-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1454/2896] 10.222.0.58 () {60 vars in 1365 bytes} [Thu May 5 16:00:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)